Prefect has been working great for the last year or so. ~45 days ago we began using Work Pools with Docker images on a single Ec2. We updated the
prefect
library from 2.14.21 ->2.15.0 and
prefect-docker
from 0.1.0 -> 0.4.4. We now intermittently and seemingly randomly receive
Flow could not be retrieved from deployment ScriptError: Script at '{script_path}' encountered an exception: FileNotFoundError(2, 'No such file or directory')
, though the same job typically runs upon retry without issue. We deploy in a python script attached to our cicd using the
flow.deploy
method. Any help is appreciated, thanks!
Jordan Davie
04/12/2024, 1:52 PM
Figured this out. We had an old Prefect agent still running
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.