Hi team, hope you're all doing well. I'm reaching out because I could really use some help.
I previously had a self-hosted Prefect instance running version 2.14.21. We were told to migrate to Prefect 3, so all my existing flows needed to be moved over — the version installed at the time was 3.6.17.
On the code side, I've only had to make a couple of changes, but there's one error I've been stuck on for weeks now.
My flows on version 2 use pre-built Docker images (since my self-hosted instance runs on Kubernetes), and they also have some additional dependencies — things like ChromeDriver installation, special configurations, etc.
However, I can't get them to work. The errors I get say either that the dependencies don't exist, or the flow just fails outright. I tried spinning up a flow from scratch and everything worked fine, but as soon as I reference any of the dependencies that are supposed to be installed in the image, it falls back into the same "dependencies not found" error.
One thing I tried was setting up the flow using a
prefect.yaml where I do a
git_clone
of the repository, but I keep hitting the same issue. I always provide the correct Docker image along with its tag, and I've even run the image locally on my machine and it works fine.