Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi folks, I'm trying to set up a LocalAgent to trigger DaskExecutor runs on my pre-existing Dask cluster. I have been using KubernetesRuns up til now but I figured it was inefficient to create a Kubernetes job every time I wanted to start a new Dask run.

I'm getting a ` Failed to load and execute Flow's environment` error when the flow starts though. I can see that it's missing the Azure storage connection string in the run config. In a KubernetesRun I handled this with a custom job definition but I don't know what to do with a LocalRun. I have the necessary secrets in the LocalAgent's container's environment, but they're coming up null.

Am I missing something simple here? Thanks everyone.

Sorry, fixed it. I had put the wrong env var in the RunConfig. I stripped that back out and let the LocalRun get the Azure conn string from the environment on its own and that seemed to work. Thanks!