Newskooler
08/12/2021, 9:24 AMfrom prefect.executors import LocalDaskExecutor
from prefect import Flow
with Flow(name=name, executor=LocalDaskExecutor(scheduler="threads", num_workers=1)) as flow:
...
Do I need to use another executer or where can I learn more about this?Kevin Kho
Newskooler
08/12/2021, 2:41 PMKevin Kho
DaskExecutor()
instead of LocalDaskExecutor()
, even if this is on Local. I thinkt he DaskExecutor tends more to be depth first from experience. You might get into issues with warnings about freeze_support()
so you may have to do:
if __name__ == "__main__":
flow.run()
If doing a local run.Newskooler
08/12/2021, 2:52 PMKevin Kho
Newskooler
08/12/2021, 3:20 PMKevin Kho
Newskooler
08/12/2021, 3:35 PM