How does Prefect achieve HA for scheduling component ( Not the web/monitoring component which uses DB) ? Can Prefect run multiple servers( or pods but less relevant in k8s world) of the scheduler component. What's the underlying mechanism for coordination?
For example, Celery archives HA through redis. At the very high level, redis uses Raft consensus underneath.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
