Channels
pacc-may-31-2023
prefect-ai
pacc-clearcover-june-12-2023
marvin-in-the-wild
data-ecosystem
geo-israel
pacc-june-14-2023
geo-japan
pacc-london-2023
prefect-cloud
ppcc-may-16-2023
prefect-azure
prefect-docker
prefect-recipes
gratitude
geo-nyc
geo-bay-area
geo-boston
geo-london
geo-dc
geo-chicago
geo-berlin
geo-texas
geo-seattle
geo-colorado
prefect-community
data-tricks-and-tips
prefect-aws
prefect-gcp
introductions
find-a-prefect-job
prefect-dbt
random
events
ask-marvin
show-us-what-you-got
prefect-getting-started
prefect-integrations
prefect-contributors
best-practices-coordination-plane
announcements
prefect-server
prefect-ui
prefect-kubernetes
Title
d
Daniel Sääf
08/23/2022, 9:00 AMHi!
After playing around a bit with the prefect 2-beta i am now trying to get the public version up and running - but running into issues with the new deployment.
My scenario is that i would like to build the deployments locally and have a VM (GCE) running as my agent.
The problem is that when i am building the deployment file. my local path is hard-coded as a path - which results in an error when the agent tries to fetch the flow.
Is there a way to solve this? Or is this a complete abuse of how it’s supposed to work?
✅ 1
Error message from the agent running in the VM:
08:56:05.298 | ERROR | Flow run 'chi667-adhil-cloud' - Flow could not be retrieved from deployment.
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 246, in retrieve_flow_then_begin_flow_run
flow = await load_flow_from_flow_run(flow_run, client=client)
File "/usr/local/lib/python3.10/site-packages/prefect/client.py", line 105, in with_injected_client
return await fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/prefect/deployments.py", line 55, in load_flow_from_flow_run
await storage_block.get_directory(from_path=None, local_path=".")
File "/usr/local/lib/python3.10/site-packages/prefect/filesystems.py", line 98, in get_directory
shutil.copytree(from_path, local_path, dirs_exist_ok=True)
File "/usr/local/lib/python3.10/shutil.py", line 556, in copytree
with os.scandir(src) as itr:
FileNotFoundError: [Errno 2] No such file or directory: '/Users/daniel/code/MarketingData''/Users/daniel/code/MarketingData'o
Oscar Björhn
08/23/2022, 9:02 AMI believe you need to define a remote storage block for this kind of scenario.
d
Daniel Sääf
08/23/2022, 9:02 AMah
o
Oscar Björhn
08/23/2022, 9:02 AMSorry, it's called a remote file system storage block. 😄
d
Daniel Sääf
08/23/2022, 9:03 AMhehe, that explains the issue. I realize that i am missing the storage since the beta-releases..
Thanks! I will try that out
That solved the issue, thanks! 😃
🙌 1
o
Oscar Björhn
08/23/2022, 9:47 AMNo problem! 👍