Eamon Keane06/17/2020, 10:10 AM
with 10 parameters, fan out to 10 pods when an initial task has finished. Basically I mainly want to use prefect as a plain orchestrator of pods like airflow pod operator. I see in the docs it documents a similar use case with Dask, but couldn't see an example which did similar with kubernetes pods.
josh06/17/2020, 12:55 PM
Eamon Keane06/17/2020, 12:55 PM
work in this case? This is basically what happens with kuberentes pod operator in airflow where the status of the pods is monitored (via kubernetes api) and results reported back to task db.