Hi all. We're just starting to use Prefect & Dask to coordinate our open source US energy data processing pipeline so we can do complete nightly continuous integration runs with all of the data, instead of just a small subset. Also interested in the potential for integration with Airbyte and dbt. https://github.com/catalyst-cooperative/pudl
k
Kevin Kho
12/06/2021, 8:38 PM
Hi @Zane Selvans! Welcome to Prefect! We have a new Airbyte integration and Anna’s blog on dbt here may help you
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.