Jenia Varavva
07/25/2022, 5:16 PMKubernetes Agent
, KubernetesRun
and DaskExecutor
in the face of various components outages. E.g. what will Prefect be able to recover on its own, and which case would require a manual intervention, if during a flow execution one of the following dies: prefect server (I suppose it’s ok as it’s stateless), kubernetes agent, KubernetesRun
job executing a flow, dask scheduler, dask workers.Mason Menges
07/25/2022, 11:02 PMJenia Varavva
07/25/2022, 11:23 PM__exit__
. In my case, as the dask cluster is “ephemeral” i.e. allocated from dask gateway for a flow, this results in an orphaned dask clusterMason Menges
07/25/2022, 11:30 PMMichael Smith
08/01/2022, 5:04 PM