Aleksandr Liadov12/13/2021, 5:11 PM
as backend all logs are displayer correctly (both Prefect logs and my custom logs).
Kevin Kho12/13/2021, 5:13 PM
Aleksandr Liadov12/13/2021, 5:13 PM
"PREFECT__LOGGING__FORMAT": "[%(asctime)s] %(levelname)s - %(name)s | %(message)s",
I provide the following env variables for my flows.
"PREFECT__LOGGING__EXTRA_LOGGERS": "['lib1', 'lib2']"
and for my local test
Kevin Kho12/13/2021, 5:17 PM
Aleksandr Liadov12/13/2021, 5:36 PM
Kevin Kho12/13/2021, 5:41 PM
on a Dask cluster does not shuffle logs between workers and the scheduler. This happens with or without Prefect so you need some external service with to ship the logs to a centralized location. The question here would be if you see those logs in the worker logs.
Aleksandr Liadov12/13/2021, 5:43 PM
, but this doesn’t work ( like you said “Dask cluster does not shuffle logs between workers and the scheduler”). Do you know, maybe someone has tried to resolve the similar problem?
Kevin Kho12/14/2021, 3:45 PM
Aleksandr Liadov12/14/2021, 4:57 PM