https://prefect.io logo
Title
a

Aiden Price

06/28/2021, 8:07 AM
Hi folks, I'm trying to set up a LocalAgent to trigger DaskExecutor runs on my pre-existing Dask cluster. I have been using KubernetesRuns up til now but I figured it was inefficient to create a Kubernetes job every time I wanted to start a new Dask run. I'm getting a
Failed to load and execute Flow's environment
error when the flow starts though. I can see that it's missing the Azure storage connection string in the run config. In a KubernetesRun I handled this with a custom job definition but I don't know what to do with a LocalRun. I have the necessary secrets in the LocalAgent's container's environment, but they're coming up null. Am I missing something simple here? Thanks everyone.
1
Sorry, fixed it. I had put the wrong env var in the RunConfig. I stripped that back out and let the LocalRun get the Azure conn string from the environment on its own and that seemed to work. Thanks!
1
k

Kevin Kho

06/28/2021, 1:47 PM
Glad you figured it out @Aiden Price!
a

Aiden Price

06/28/2021, 10:40 PM
Thank you Kevin!