https://prefect.io logo
Title
n

Nicholas Torba

05/26/2023, 3:14 PM
hey @Jenny has your team ever seen prefect agents running locally on a windows laptop stalling at the download code from storage phase? It is a local process, so trying to copy code from a local directory, but it never completes. The same code works on my ubuntu laptop. We tried running the agent in a docker container as well, but still stalls at the same step
j

Jenny

05/26/2023, 3:35 PM
Let me check with the team on this one!
Double checking - do you have the right filesystem package dependencies installed: https://docs.prefect.io/latest/concepts/filesystems/#filesystem-package-dependencies
n

Nicholas Torba

05/26/2023, 3:59 PM
if they are running the prefect agent locally on a windows laptop, would they need any of these installed?
only place windows is referenced is smb, but when the agent is running locally, the flow isn't ubuntu basee
*based
j

Jenny

05/26/2023, 5:35 PM
I guess I should ask my question a different way - when you say "download code from storage" what storage are you using? Can you share any error messages?
a

Ameya

05/26/2023, 5:53 PM
jumping in here as I'm facing this issue: just local file storage. No error message - the flow just never starts - it always stays in pending
j

Jenny

05/26/2023, 6:51 PM
Hmmm... One of our engineers kindly spun up a windows VM to test and they can't reproduce.
Double checking here @Ameya are you on 2.10.11? Want to make sure we're testing the right thing.
a

Ameya

05/26/2023, 7:20 PM
I was on 2.10.5, but I just upgraded and same issue
I see the submitted run in the UI, my local agent is "checking for scheduled flow runs...", I see
INFO    | Flow run 'adept-panther' - Downloading flow code from storage at None
, but then the flow never moves past this step
flow run id
8659bc10-46a5-4301-ac08-18e04ca32aa3
if helpful
o actually it looks like it finally ran! but it was 8 minutes of downloading flow code
any tips for getting that to be faster?
n

Nicholas Torba

05/26/2023, 7:35 PM
Compare your local files to the .perfect ignore
My best guess is a big csv file is sneaking in somehow
a

Ameya

05/26/2023, 9:37 PM
is there anyway to check what prefect is actually downloading? not seeing any big files that aren't in prefect ignore
@Jenny - do you know if there is a way to check what prefect is downloading?
j

Jenny

05/31/2023, 8:00 PM
Hey @Ameya! (Copying this from an earlier conversation) Perhaps have your flow print the current directory name then sleep forever on start then go there and look at the files? It's also just going to be a copy of "some/location". Do you have large files there? We recursively copy directories, do you have a lot of files in nested directories? Do you have a
.git
directory there? What's excluded by your
.prefectignore
? There's an older issue here that could be useful for debugging your flow as it's going through the steps you are asking about: https://github.com/PrefectHQ/prefect/issues/8178
Did this help you or are you still seeing the issue?