Running a self-hosted server and agent in k8s and wondering the best way to upgrade to use workers. Can agents and workers be deployed and work with the same server? Or should we setup a new server with workers and move jobs over to that one?
Nick DeCraene
02/09/2024, 7:46 PM
I've read through the agent -> worker doc and while it helps with deployment changes, it doesn't seem to mention anything about self hosting and compatibility
n
Nate
02/14/2024, 2:29 PM
the relationship between your self-hosted server and your workers should be pretty much the same as the one you had between your server and agents
if you want an incremental migration strategy, I would just create a new work pool and start registering new deployments to that work pool and starting moving deployments over piecemeal
n
Nick DeCraene
02/14/2024, 3:18 PM
oh that makes sense, so have both agents and workers running, but consuming from different work pools. Thanks!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.