Flow of Flows - Orchestrating ELT with Prefect and dbt

Workflow orchestration platforms have historically allowed managing task dependencies within individual data pipelines. While this is a good start, what if you have dependencies between data pipelines?

This post looks at the entire ELT lifecycle, from building independent ingestion workflows through data transformations with dbt up to triggering downstream flows that use that data for reporting and analytics. Prefect orchestrates all those steps and ensures that dependencies between flows and tasks are met.

Link to the blog post