hi all, does prefect have a way of letting me specify how to write the results of a flow / subflow to a database, so I can keep the ETL logic and database logic seperate?
✅ 1
a
Anna Geller
09/05/2022, 12:48 PM
configurable ResultsConfig is on the roadmap, but to your question, you can already separate ETL and DB logic in your project. If you need some examples, perhaps this one can help, showing how you can e.g. use a dataflowops package for such custom modules https://github.com/anna-geller/dataflow-ops
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.