https://prefect.io logo
a

Ashish Gupta

07/05/2023, 11:32 AM
am exploring prefect for event based scheduling framework. Event produced by micros service and event based prefect must listen to event and schedule a job. Each event based job must execute in isolated parallel environment. Services runs over K8 infra on internal network. I see it has a plugin of dask and ray. Is it possible to listen event via consumer and execute the flow and flow task must execute in parallel? Is it possible without using dask/ray can I directly schedule my flows over K8. On demand K8 pods get scheduled via event
1
w

Will Raphaelson

07/05/2023, 1:13 PM
Hi Ashish - based on my understanding of the question, all of this seems very doable. • Using the K8s worker will spin up jobs for flows. • You can use webhooks, or the events API with automations to listen for events and kick off deployments. This is an active area of product work for me, if you’d like to hop on a call to discuss implementation, please send me a DM and we can get a time on the books for this week!
🙌 2