Is there a way to get the logs from a single eleme...
# ask-community
j
Is there a way to get the logs from a single element of a mapped task?
k
Hey @Jeremy Phelps, are you using a DaskExecutor?
j
Yes.
Looks like the error is being reported as a "state message" instead of being put into the log stream.
k
In general no there isn’t a way because Dask itself does not move the logs around between client and workers so we don’t innately get worker logs. Even if the Prefect logger is configured to send stuff to the backend, the Python logger gets reinstantiated when it gets to Dask workers. The users who really need to get the logs from Dask workers set up their own service to collect it.
j
Why is Prefect able to get any logs, then?
k
You can see this. That’s from the client side logs.
There is a thread with more info somewhere. Looking for it.
Here is the thread.