https://prefect.io logo
Title
c

Cole Murray

03/30/2023, 3:16 AM
Hi Community, We are using Prefect + ECS Tasks to train various keras models we have. We’ve run into an issue where the logging from Keras’s fit method does not appear within the Flow run logs, only within AWS. We have added the “log_prints=True” as part of our flow annotation, which did allow some log prints to come through, but it seems the actual model.fit logs are not showing up. Has anyone run into this issue with Keras logs not appearing on an ECS task?
👀 1
The logging call originates here: https://github.com/keras-team/keras/blob/master/keras/utils/io_utils.py#L82 which appears to be using the absl library for logging.
b

Bianca Hoch

03/30/2023, 5:15 PM
Hi Cole! I'm not terribly familiar with Keras. Maybe there needs to be an extra logger added to your prefect config? Something like this: https://discourse.prefect.io/t/how-to-add-extra-loggers-to-prefect-2-0/1040