Hi everyone! I'm facing issues with prefect logger...
# prefect-community
d
Hi everyone! I'm facing issues with prefect logger, as I'm using ThreadPoolExecutor, I want to ensure that future is completed successfully or at least know the reason of failure. The flow and task with parallel execution looks like this. The deal is that when running locally, I'm able to see the logs, but couldn't see them on Prefect UI, though I'm able to explore other logs outside this task. I'm using
prefect.context.get("logger")
as logger. Could anyone guess how to fix this? Thanks
k
Yeah from what I’ve seen you either need to explicitly pass the logger to the
process_item
, but really maybe you can just use the LocalDaskExecutor and mapping to parallelize the task. You should not need both ThreadPoolExecutor and LocalDaskExecutor.