Does Prefect offer any solutions if you do not want to run on your own cloud service? Can Prefect provide any cloud infrastructure solution?
k
Kevin Kho
07/07/2021, 6:11 PM
We don’t offer any hosted compute if that’s what you mean. I think the easiest approach is to have a lightweight VM with a long running process that is responsible for spinning up compute (AWS ECS, Dask Clusters through Coiled, Trigger Databricks Jobs, etc.)
m
Madison Schott
07/07/2021, 6:15 PM
Got it- is there documentation on how to do this?
k
Kevin Kho
07/07/2021, 7:34 PM
This would help for the Flows run on ECS. The agent would just need to be a process on a lightweight VM, then outsources the work to ECS.