Rob Fowler

    Rob Fowler

    1 year ago
    has anyone else used LocalDaskExecutor in k8s? It seems the dask parent management process does not actually work under k8s. I'm getting all sorts of wacky errors. If it is not supported, it might be an anti-pattern, parallel processes inside k8s for prefect?
    Michael Adkins

    Michael Adkins

    1 year ago
    Hey @Rob Fowler -- can you share some of the errors you're encountering? This should work just fine afaik.
    Rob Fowler

    Rob Fowler

    1 year ago
    I'll make a simple example tomorrow. It basically does not work under an agent. In the meantime I am doing single threaded flows.
    Weird messages.