Anyone know if this is actually right? Multiple ba...
# ask-community
m
Anyone know if this is actually right? Multiple background services can be ran in one cluster without issues? https://prefect-community.slack.com/archives/C079VLLH5D3/p1773321271676739?thread_ts=1773320974.101999&cid=C079VLLH5D3
j
n
hello! you can indeed scale background services horizontally because of docket
@Jordan Jones i don't think this is actually the same question
don’t autoscale the Prefect “services” container, and definitely not on Redis queue depth.
you're looking for an autoscaling rule, is that right? not asking whether or not you can run more than one replica of the background services
j
@Nate I think maybe both. I need to look into Docket not sure how that works.
n
we can add an example here with multiple replicas: https://docs.prefect.io/v3/advanced/self-hosted#docker-compose but generally if you just want to run multiple
prefect server services start
replicas, you can, because docket coordinates perpetual tasks (background services in prefect) via your redis instance autoscaling the
prefect server services start
pods is not something folks typically ask for, but if you have a use case, opening a discussion on why you want to do that would be very helpful!
j
Thanks for the link to docket also, an oddly hard thing to search for..
n
it should be mostly an implementation detail as far as prefect is concerned, but if you're interested in learning more the docs are at https://docket.lol
j
@Nate is it as easy as just using
PREFECT_SERVER_DOCKET_URL
instead of
PREFECT_SERVER_REDIS_URL
(not sure on the exact ENV name)
j
Oh perfect thanks.
catjam 1