At the moment, when onboarding a data model or when updating an existing one, it is required to go to the blueprint definition and update it according to the additions/changes/removal of properties from the blueprint.
It would make data model changes much easier if it was possible for Port to auto-discover the correct data model for the blueprint based on the ingested data.
For example:
If the key -
logs_url
is ingested and it matches a URL schema, then add a new
logs_url
property (if it doesn’t already exist) to the blueprint definition, and set its type to
string
and format to
url
.
Similar logic can be applied for
number
,
boolean
,
object
and other property types.
This auto discovery does have some limitations - for example if a property already exists under a specific schema (i.e. string) and now a pure number is being imported, it will be converted to string, and the schema will not be updated (this is the current behavior today).