Sam Werbalowsky
12/21/2022, 10:24 PMsubmit
? Even if the flow is written in a way that there is no dependencies between tasks?Zanie
12/21/2022, 10:29 PMSam Werbalowsky
12/21/2022, 10:31 PMZanie
12/21/2022, 10:38 PMSam Werbalowsky
12/21/2022, 10:44 PMZanie
12/21/2022, 10:47 PMSam Werbalowsky
12/21/2022, 10:54 PMZanie
12/21/2022, 10:54 PMSam Werbalowsky
12/21/2022, 10:54 PMZanie
12/21/2022, 10:55 PMTask
and override __call__
to do that, I think?Sam Werbalowsky
12/21/2022, 10:57 PMsubmit
with a list makes a bit more intuitive sense (here), but if we’re just running a flow that wants to run a bunch of steps that aren’t related it seems like something we need to explicitly tell everyone….hopefully that makes senseZanie
12/21/2022, 11:01 PMSam Werbalowsky
12/21/2022, 11:03 PMZanie
12/21/2022, 11:03 PMSam Werbalowsky
12/21/2022, 11:05 PMZanie
12/21/2022, 11:05 PM@task
decorator that would always submit if you get stuck.Sam Werbalowsky
12/21/2022, 11:05 PMZanie
12/21/2022, 11:05 PMSam Werbalowsky
12/21/2022, 11:06 PMPeyton Runyan
12/23/2022, 1:11 PMLike I know we have jobs that take a bunch of inputs and then want to run the same function over those inputs,
We have map for that: https://docs.prefect.io/concepts/tasks/#map