am exploring prefect for event based scheduling framework. Event produced by micros service and event based prefect must listen to event and schedule a job. Each event based job must execute in isolated parallel environment. Services runs over K8 infra on internal network.
I see it has a plugin of dask and ray.
Is it possible to listen event via consumer and execute the flow and flow task must execute in parallel?
Is it possible without using dask/ray can I directly schedule my flows over K8. On demand K8 pods get scheduled via event
07/05/2023, 1:19 PM
Is Prefect Cloud an option for you, or are you looking to accomplish this with self-hosting a Prefect server?