Auto-discover blueprint properties from reported data
Mor Paz - Port team
At the moment, when onboarding a data model or when updating an existing one, it is required to go to the blueprint definition and update it according to the additions/changes/removal of properties from the blueprint.
It would make data model changes much easier if it was possible for Port to auto-discover the correct data model for the blueprint based on the ingested data.
For example:
If the key -
logs_url
is ingested and it matches a URL schema, then add a new logs_url
property (if it doesn’t already exist) to the blueprint definition, and set its type to string
and format to url
.Similar logic can be applied for
number
, boolean
, object
and other property types.This auto discovery does have some limitations - for example if a property already exists under a specific schema (i.e. string) and now a pure number is being imported, it will be converted to string, and the schema will not be updated (this is the current behavior today).