Skip to content

[c] Lakehouse-based pipeline MVP (sqlmesh+Trino)

No due date 57% complete

We want to transition more of the data pipeline to:
sqlmesh on top of Trino over Iceberg on GCS.

This on the way to deprecate the use of dbt.
We should build this out of band without breaking the existing dbt pipeline.
Plan is to grow the existing sqlmesh pipleine until it is a superset of the dbt pipeline, then swap.

We want to transition more of the data pipeline to:
sqlmesh on top of Trino over Iceberg on GCS.

This on the way to deprecate the use of dbt.
We should build this out of band without breaking the existing dbt pipeline.
Plan is to grow the existing sqlmesh pipleine until it is a superset of the dbt pipeline, then swap.

Loading