Hey
@Jimmy Le,
Happy to oblige here.
Prefect empowers you to orchestrate your workflows using Python in many ways, but particularly in regards to third-party tooling and your chosen Cloud Platform, both of which can vary greatly. Prefect’s
Hybrid Model ensures your code and data never leave your infrastructure to maintain the sanctity of your data, leaving you in charge of your code/data specifics like
execution and
code storage and that’s where AWS comes into play (or any Cloud Platform for that matter).
So typically, users in the AWS space will choose
ECR for containerized code storage, to be retrieved by an
ECS/Fargate Agent, to be executed on the cluster that the Agent lives on (outside of Prefect entirely), all the while relaying metadata metrics back to your Cloud UI. As a sidenote, if you need help with your infrastructure, we do have partners we work with so I can have someone reach out! (I work @ Prefect btw )
Hope that helps!