Hi all! I’m doing some testing with the DaskExecutor and spinning up an ephemeral Dask cluster on ECS Fargate. Although it seems to work, I ran into the same issue that was described here. I understand that the clean spin-down issue might not be super high priority since the workers seem to execute what is assigned to them but I did have a question about logging. Specifically, my logs look more like this (Beginning Flow Run, then Flow Run SUCCESS, then the RuntimeError) with none of the intermediary logging being captured from the

list_sum

function in the flow. Is there a configuration I might be missing that enables this, or has there been any progress in getting the output of DaskExecutor logs into Prefect Cloud?

I looked at the issue before and summarized in the conclusion that this is something that would need to be tackled on the Dask distributed side I would encourage you to ask Dask experts here https://dask.discourse.group/

Thank you Anna. I will reach out to them. I did notice that in your example, you were able to see the logs on for the output of the flow as well (attached). Do you remember if this was this in your dask worker or your Prefect worker? The logger class does not seem to print anything out for me in the logs using the same flow beside Beginning Flow Run/Flow Run SUCCESS so the output of list_sum is not available anywhere for example.

sorry, I described everything I know about the issue there keep us posted if you find out more 🙌