Greg Desmarais
07/02/2020, 10:55 PM@task(log_stdout=True)
def say_hello(name):
print(f'{datetime.now()}: workflow hello {name}', flush=True)
worker = get_worker()
return f'done on {worker.name}, scheduler at {worker.scheduler.address}'
name = Parameter('name')
with Flow("Simple parallel hello") as flow:
# Since there is no return value dependency, we end up with possible parallel operations
for i in range(10):
say_hello(name)
If I run the flow from my script, targeting a particular Dask cluster, I can hit the right Dask workers:
executor = DaskExecutor(address=dask_scheduler_address)
flow.run(executor=executor)
My question is about registering this flow and running it, say, from the prefect ui. I can easily register the flow with:
flow.register()
But then trying to run it from the ui just hangs. I'm pretty sure it is because the executor isn't registered with the flow. Am I missing something? Thanks in advance...Chris White
07/02/2020, 10:56 PMGreg Desmarais
07/03/2020, 10:59 PMChris White
07/04/2020, 12:57 AMGreg Desmarais
07/07/2020, 4:34 AMLaura Lorenz (she/her)
07/09/2020, 2:18 PMGreg Desmarais
07/09/2020, 10:23 PM