<@ULVA73B9P>: Why does flow fail in between when r...
# ask-marvin
s
@Marvin: Why does flow fail in between when running on a dask cluster with an error
No nodename nor server name provided
?
m
The error "No nodename nor server name provided" when running a flow on a Dask cluster can often be attributed to an issue with the cluster configuration or communicating with the workers in the cluster. Here are some steps to consider: 1. Cluster Configuration: - Check your cluster initialization code. Ensure that the cluster is properly initialized with valid connection parameters. 2. Network Issues: - Ensure that there are no network connectivity issues between your Dask scheduler and the workers. Both the scheduler and workers need to know how to reach each other. 3. Dask Client Details: - When using
DaskTaskRunner
, ensure that you are properly configuring the Dask client and awaiting the compute results properly. Here is the link to the Prefect + Dask integration usage guide which can help you understand better: https://docs.prefect.io/latest/integrations/prefect-dask/usage_guide/. To help you debug further, ensure you are following the correct steps for setting up temporary clusters or managed clusters as mentioned in the documentation. You might also want to check if all required dependencies and network configurations specific to Dask and your environment are correct. If you want more specific help, feel free to provide more details about your cluster setup and the specific steps you are taking.