Serdar Tumgoren
08/06/2021, 5:43 PMKevin Kho
08/06/2021, 8:11 PMshutdown_on_close
, which terminates it after the Flow.
executor = DaskExecutor(
cluster_class=coiled.Cluster,
cluster_kwargs={
"software": "kvnkho/prefect",
"shutdown_on_close": True,
"name": "prefect-cluster",
},
)
flow.executor = executor
flow.register(...)
dask_cloudprovider
GCPCluster has an auto_shutdown
arg so that might be the easiest way to do it right? Just get the value to True
Serdar Tumgoren
08/06/2021, 8:23 PMKevin Kho
08/06/2021, 8:27 PMSerdar Tumgoren
08/06/2021, 8:28 PMKevin Kho
08/06/2021, 8:29 PMGreg Smith
08/06/2021, 8:30 PMSerdar Tumgoren
08/06/2021, 8:31 PMGreg Smith
08/06/2021, 8:37 PMSerdar Tumgoren
08/06/2021, 8:40 PM