Hi Community,
We are using Prefect + ECS Tasks to...
# ask-communityc
Cole Murray
03/30/2023, 3:16 AMHi Community,
We are using Prefect + ECS Tasks to train various keras models we have. We’ve run into an issue where the logging from Keras’s fit method does not appear within the Flow run logs, only within AWS. We have added the “log_prints=True” as part of our flow annotation, which did allow some log prints to come through, but it seems the actual model.fit logs are not showing up.
Has anyone run into this issue with Keras logs not appearing on an ECS task?
👀 1
Cole Murray
03/30/2023, 4:57 AMThe logging call originates here: https://github.com/keras-team/keras/blob/master/keras/utils/io_utils.py#L82 which appears to be using the absl library for logging.
b
Bianca Hoch
03/30/2023, 5:15 PMHi Cole! I'm not terribly familiar with Keras. Maybe there needs to be an extra logger added to your prefect config? Something like this: https://discourse.prefect.io/t/how-to-add-extra-loggers-to-prefect-2-0/1040