https://prefect.io logo
Title
s

Sam Garvis

09/12/2022, 5:36 PM
https://github.com/PrefectHQ/prefect/issues/6779 We are on Prefect 2.3.2 using GCS storage and k8s helm agents. I just commented on somebody else's issue on GitHub, but just to reiterate, this error is the only thing that is preventing our team from truly upgrading to Prefect 2.0. It has been going on since we started transitioning and it won't go away.
ValueError: Path /root/.prefect/storage/72ed22dddb494741872cffe99e581ee9 does not exist.
It's an incredibly vague error that is hard to debug. However, the flows all complete successfully, they just show as crashed. But if we were to transition to 2.0, we need reliable error monitoring, and we can't do that with 90% of flows crashing for no reason.
1
I would love if this issue was bumped incredible high on the priority list. Once this is out of the way we can actually use prefect 2.0, but it's virtually impossible for us rn. I've been struggling with this for a while. We use the prefect-gcp package frequently if that has anything to do with it, but it also fails on tasks without that
m

Mason Menges

09/12/2022, 5:44 PM
Hey @Sam Garvis I think this issue might actually be related to this https://github.com/PrefectHQ/prefect/issues/6086 as well, the latest comment suggests it might be related to the k8s configuration but it's also still being looked into
s

Sam Garvis

09/12/2022, 5:51 PM
Sounds good, thank you. I'll try some of those solutions and see if they affect anything
n

Nate

09/12/2022, 6:04 PM
@Sam Garvis are you attempting to cache results on any of your tasks?
s

Sam Garvis

09/12/2022, 6:14 PM
What do you mean by this? I am frequently returning pandas dataframes
I believe this is resolved by https://github.com/PrefectHQ/prefect/pull/6730 And it sounds like it's gonna be pushed by EOD tomorrow, so hopefully that fixes this
🙌 1