Morning all I have a deployment scheduled which seems to be

Question

Morning all I have a deployment scheduled which seems to be working majority of the time but randomly sometimes it ll fail with the below error I m struggling to understand why the file directory wouldn t exist when the same flow is working fine at other times Any suggestions on where to start `Flow could not be retrieved from deployment ` `Traceback most recent call last ` `File usr local lib python3 8 dist packages prefect engine py line 276 in retrieve flow then begin flow run` `flow = await load flow from flow run flow run client=client ` `File usr local lib python3 8 dist packages prefect client utilities py line 40 in with injected client` `return await fn args kwargs ` `File usr local lib python3 8 dist packages prefect deployments py line 195 in load flow from flow run` `await storage block get directory from path=deployment path local path= ` `File usr local lib python3 8 dist packages prefect filesystems py line 147 in get directory` `copytree from path local path dirs exist ok=True ` `File usr lib python3 8 shutil py line 557 in copytree` `return copytree entries=entries src=src dst=dst symlinks=symlinks ` `File usr lib python3 8 shutil py line 513 in copytree` `raise Error errors ` `shutil Error home user prefect prefect db shm tmp tmp791im88hprefect prefect prefect db shm Errno 2 No such file or directory home user prefect prefect db shm `

flapili · Answer

I don t have any hint about this error but I would recommand to switch to postgres if it s for production

flapili · Answer

even for local dev booting a psql container isn t bad

Ash · Answer

Just development environment atm but definitely something I ll look into Thanks

flapili · Answer

sound like the temp folder is deleted before getting copied as prefect db shm

flapili · Answer

something else is deleting this folder

flapili · Answer

could be the OS a cleaning app a cleaning routine ect

Ash · Answer

Does Prefect delete the tmp folders after the flow run has completed

Ash · Answer

I noticed the tmp folders were including the whole folder including a lot of vscode plugins and thought that strange as it takes up a lot of memory I changed the upcoming schedules to be a maximum of 10 to stop it creating many tmp folders

flapili · Answer

idk according to the paths you are on linux right

flapili · Answer

not a container

Ash · Answer

correct

flapili · Answer

you could look at auditctl tools

flapili · Answer

it permit to track what change files folders

flapili · Answer

it will tell you as example what folder was deleted by what process in tmp

flapili · Answer

but it s probably overthinking sweat smile

flapili · Answer

but anyway if you are curious you could take a look at

Ash · Answer

Great will take a look slightly smiling face I m thinking maybe I can change the local storage to be something other than tmp if it is indeed something clearing out tmp folders before prefect can access

flapili · Answer

not sure prefect probably use tempfile stdlib

Ash · Answer

I will attempt postgres first as that seems to be the best practice

Ash · Answer

Thanks again for the help