Hey! I'm looking to use Prefect in an ML orchestration pipeline that involves some ETL and data preprocessing (only needs CPU) and training deep learning models with pytorch (needs GPU's). I wanted to ask what the current recommendation would be in terms of infra setup here (given that we already use Kubernetes and AWS)? Thank you!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.