Adam Brusselback
02/02/2021, 5:45 PMJim Crist-Harif
02/02/2021, 6:09 PMflow.storage = GitHub("your-repo", "path/to/yourflow.py")
At runtime, your flows will be pulled from github and executed, no need for an external storage mechanism. This also lets you make small changes to the flow source without requiring you to re-register the flow.
This is just one opinion though, there are lots of ways people manage and organize their flows. Perhaps others in the community can give you a longer response.
Is there something specific you're wondering about? A more specific question may be easier to answer.Adam Brusselback
02/02/2021, 9:17 PMJim Crist-Harif
02/02/2021, 9:21 PMShellTask
useful for wrapping your existing shell scripts as prefect tasks (https://docs.prefect.io/api/latest/tasks/shell.html#shelltask)Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by