and then have the CloudWatch agent in there pick it up. But I'm sure there's a way to pass the
awslogs
driver to the container with a dockerfile or maybe with the job_variables section in the prefect.yaml/deploy(). When I first started with Prefect I had a docker-compose file that I was able to specify the
awslogs
driver in, and that worked for each container it created.
s
Sergio Shevtsov
12/06/2023, 7:19 PM
Hi Jack, thanks for your input. I can get the logs from worker, but in my case I need to debug the requests boto3 library is sending to aws. Boto3 is used by prefect-~ecs~aws, and for some reason it is unable to validate my custom network configuration. If I just could to see how prefect "talks" to EC2, this might spot the problem.
j
Jack Goslin
12/06/2023, 7:25 PM
ohh sorry, I misunderstood. Is it this?
https://github.com/PrefectHQ/prefect-aws/blob/main/prefect_aws/ecs.py
In the logging.yml you might be able to see more info if you set everything to debug level. I did that once while troubleshooting and I saw all the HTTP traffic in there
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.