Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi Community,

We are using Prefect + ECS Tasks to train various keras models we have. We’ve run into an issue where the logging from Keras’s fit method does not appear within the Flow run logs, only within AWS. We have added the “log_prints=True” as part of our flow annotation, which did allow some log prints to come through, but it seems the actual model.fit logs are not showing up.

Has anyone run into this issue with Keras logs not appearing on an ECS task?

The logging call originates here: <https://github.com/keras-team/keras/blob/master/keras/utils/io_utils.py#L82> which appears to be using the absl library for logging.

Hi Cole! I'm not terribly familiar with Keras. Maybe there needs to be an extra logger added to your prefect config? Something like this: <https://discourse.prefect.io/t/how-to-add-extra-loggers-to-prefect-2-0/1040>