Configuration for OpenMetadataWorkflowConfig

[giacomochiarella]

Hi,
I'm trying to ingest postgres metadata into Open Metadata but I'm having hard time when I configure the workflow.
My code:

om_workflow_config = yaml.safe_load(config)
om_workflow_model = OpenMetadataWorkflowConfig.parse_obj(om_workflow_config)
workflow = PrefectOpenMetadataIngestion(om_workflow_model)
workflow.execute()
workflow.log_flow_status()
workflow.raise_from_status()
workflow.stop()

the configuration I'm setting is:

c = """
source:
  type: postgres
  serviceName: dwh_{ENV}
  serviceConnection:
    config:
      username: {{db_username}}
      password: {{db_password}}
      hostPort: {{db_host}}:{{db_port}}
      database: {{db_name}}
  sourceConfig:
    config:
      type: DatabaseMetadata
      markDeletedTables: true
      includeTables: true
      includeViews: true
      generateSampleData: false
      schemaFilterPattern:
        includes:
          - raw_*
sink:
  type: metadata-rest
workflowConfig:
  openMetadataServerConfig:
    hostPort: {{om_url}}/api
    authProvider: openmetadata
    securityConfig:
      jwtToken: '{{om_jwt_token}}'
"""

but it seems wrong because I get the following error:

File "/tmp/tmprykh7pprprefect/dags/staging/etl/open_metadata_api_integration/ingestion.py", line 57, in run_ingestion_task
    om_workflow_model = OpenMetadataWorkflowConfig.parse_obj(om_workflow_config)
  File "pydantic/main.py", line 526, in pydantic.main.BaseModel.parse_obj
  File "pydantic/main.py", line 342, in pydantic.main.BaseModel.__init__
pydantic.error_wrappers.ValidationError: 63 validation errors for OpenMetadataWorkflowConfig
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'DatabaseUsage' (type=type_error.enum; enum_values=[<DatabaseUsageConfigType.DatabaseUsage: 'DatabaseUsage'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'DatabaseLineage' (type=type_error.enum; enum_values=[<DatabaseLineageConfigType.DatabaseLineage: 'DatabaseLineage'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'DashboardMetadata' (type=type_error.enum; enum_values=[<DashboardMetadataConfigType.DashboardMetadata: 'DashboardMetadata'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'MessagingMetadata' (type=type_error.enum; enum_values=[<MessagingMetadataConfigType.MessagingMetadata: 'MessagingMetadata'>])
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'Profiler' (type=type_error.enum; enum_values=[<ProfilerConfigType.Profiler: 'Profiler'>])
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'PipelineMetadata' (type=type_error.enum; enum_values=[<PipelineMetadataConfigType.PipelineMetadata: 'PipelineMetadata'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'MlModelMetadata' (type=type_error.enum; enum_values=[<MlModelMetadataConfigType.MlModelMetadata: 'MlModelMetadata'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'TestSuite' (type=type_error.enum; enum_values=[<TestSuiteConfigType.TestSuite: 'TestSuite'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'MetadataToElasticSearch' (type=type_error.enum; enum_values=[<MetadataToESConfigType.MetadataToElasticSearch: 'MetadataToElasticSearch'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'dataInsight' (type=type_error.enum; enum_values=[<DataInsightConfigType.dataInsight: 'dataInsight'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> type
  value is not a valid enumeration member; permitted: 'DBT' (type=type_error.enum; enum_values=[<DbtConfigType.DBT: 'DBT'>])
source -> sourceConfig -> config -> generateSampleData
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> includeViews
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> markDeletedTables
  extra fields not permitted (type=value_error.extra)
source -> sourceConfig -> config -> schemaFilterPattern
  extra fields not permitted (type=value_error.extra)

I'm executing this in a Prefect flow. Is there documentation on the available attributes and how to set?