Satheesh K
04/07/2021, 5:15 PMZanie
Zanie
Zanie
prefect build --help
Zanie
Satheesh K
04/07/2021, 5:28 PMDylan
Dylan
Satheesh K
04/07/2021, 5:36 PMflow:
task:
name: run_detection_model
inputs: [model1,model2,model3]
output: [model1_dets,model2_dets,model3_det]
task:
name: do_something_with_model1_dets
inputs: [model1_dets]
output: [model1_dets_filtered]
....
Satheesh K
04/07/2021, 5:37 PMSatheesh K
04/07/2021, 5:37 PMDylan
Dylan
Dylan
Task
and creating your own specialized Prefect Tasks. Then, package them up and share that code in a python package.
Take a look at our own Task Library for some inspiration: https://docs.prefect.io/core/task_library/overview.htmlDylan
Dylan
Satheesh K
04/07/2021, 5:54 PM.py
file for each flow. I think we are looking more at something like having one file decode_flow.py
to decode DAG definition written in yaml config etc. Here I have to mention all our tasks and flows are very much similar, but we also thinking about extensibility in future.Satheesh K
04/07/2021, 5:55 PMSub-Flows
will check it in more detail.Dylan
Dylan