Hello everyone, I’ve managed to set up Prefect locally on k8s with k8s agent, with Dusk executor using KubeCluster cluster class. Is this the best configuration for utilising k8s cluster resources? Also, I can’t see task logs in UI when using this setup and I’m guessing this is due to workers being managed by dusk scheduler. Is there anything to do about this?

Hi @Dominik Prester, yes that sounds good. So this is hard because Dask does not natively send logs from workers to the scheduler, so you would need to set up some other kind of service to send those logs somewhere.

Thanks!