Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
y
Ying Ting Loo
05/04/2023, 11:12 AMhello, need help on understanding/troubleshooting:
I have just deployed a new agent. call it agent b on top of agent a (current agent) to my prefect server (version 2) (self hosted) all on rancher.
I am able to deploy the flow in agent b cli, and it appears in the ui of prefect server, however when i trigger the run, it says
Flow could not be retrieved from deployment. FileNotFoundError: [Errno 2] No such file or directory✅ 1
versions on agent:
>prefect version
Version: 2.10.2
API version: 0.8.4
Python version: 3.9.16
OS/Arch: linux/x86_64
Profile: default
Server type: servero
Oscar Björhn
05/04/2023, 11:20 AMHey, have you looked into work pools/queues?
y
Ying Ting Loo
05/04/2023, 11:21 AMthe flows are on the right queue
do you need a different work pool for each agent?
o
Oscar Björhn
05/04/2023, 11:22 AMIf you want certain deployments to only be picked up by a specific agent, yes. Otherwise no.
I'm guessing that's what you want, based on what you wrote
Otherwise both agents will check if there is something for them to do and Prefect will give the job to whoever polled first.
y
Ying Ting Loo
05/04/2023, 11:23 AMso agent b has a different set of flows than agent a, they should be polling different work pool?
o
Oscar Björhn
05/04/2023, 11:23 AMUnless I'm misunderstanding what you're trying to do, yeah. It's the only way you have to control which agent runs what flow
👍 1
y
Ying Ting Loo
05/04/2023, 11:24 AMthanks. lemme try
👍 1
o
Oscar Björhn
05/04/2023, 11:26 AMBy the way, maybe this is nitpicking but it might help you figuring out how things work:
"How does prefect server knows which agent to search from when a run happens?"
The server doesn't send job to any agents, it just puts them in pools/queues. It's the agent that then poll the pools/queues you told it to poll every x seconds to check if there is work to do.
👍 2
y
Ying Ting Loo
05/04/2023, 1:09 PMworks now! thanks for the help
o
Oscar Björhn
05/04/2023, 1:14 PMThat's great! No problem. 🙂