Choenden Kyirong
10/18/2023, 6:36 PMMarvin
10/18/2023, 6:36 PMserve
method of the Flow object or the serve
utility for managing multiple flows simultaneously. This process will stay in communication with the Prefect API, monitoring for work and submitting each run within an individual subprocess.
However, remember that because runs are submitted to subprocesses, any external infrastructure configuration will need to be set up beforehand and kept associated with this process.
If your flows have heterogeneous infrastructure needs across runs, it will be more difficult to configure and schedule. Also, large volumes of deployments can be harder to track.
If you want Prefect to exercise greater control of the infrastructure on which flows run, you might consider running flows on dynamically provisioned infrastructure with workers and work pools.
You can find more details in the Prefect documentation. I know, reading documentation can be a drag, but sometimes it's the only way.Jake Kaplan
10/18/2023, 6:59 PMChoenden Kyirong
10/18/2023, 7:00 PM