Has anybody migrated from 1.x to Prefect 2? And ho...
# ask-community
a
Has anybody migrated from 1.x to Prefect 2? And how was the journey?
marvin duck 2
k
Hi Andrei, there's a lot of helpful documentation about migration from 1 to 2. I found that understanding deployments to be the most useful when migrating flows. Take all the metadata from the flow such as the run config, storage, parameters, schedule etc and that goes in the deployment. https://upgrade.prefect.io/
o
Hi Andrei. My company migrated a fairly big setup back in August. It took us a couple of weeks due to the variety of use cases we had to migrate, but once we understood the conceptual differences it wasn't particularly complicated. If you have any particular questions I'd be happy to answer them. I also agree with Kalise, understanding deployments and how they relate to flow runs and infrastructure is key.
🙏 1
👍 2
marvin 1
a
we also migrated in august. there are definitely a lot of conceptual differences, but we decided to pull the trigger on the migration because the new concept of
work queues
allowed us to remove a lot of "hacky" code. we've been on 2.x for a couple months now, and i can say that the experience and reliability has improved tenfold with each release. Migrating the actual flows was pretty simple, refactoring the "flow register" automation to "deployment" automation was a bit difficult, but it would have been a lot easier if we didn't have such a restrictive setup (we're basically running prefect agents in a heroku-like setup) The UI is also completely different, and we had a couple of non-engineers working in prefect to kick things off, so there was a series of trainings i had to give to walk folks through the new concepts. the UI still isn't quite as usable as 1.X, but with a couple of browser shortcuts, our team has little problem finding the deployments they want to run. IMO, if you have very few (like 10 or less), you won't have too much of a problem with the new UI. We have ~40+ flow/deployments (and growing) and we run 10k+ flow runs a day, so the search-ability has been a bit of a pain point, you definitely have to learn a couple tricks.
🙏 1
a
@Alix Cook so pro points are only reliability? vs 1.x ? Anything else that you have seen improving ? We work with prefect1.x + AWS (ECS) and the problem is that I took something, somebody has built and I am trying to learn by doing :))
o
There are a ton of pros. The GUI performs much better and is nicer to use, deployments and tags are great for separating dev/test/etc environments, being able to use a single agent for multiple types of infrastructure. The codebase ends up being cleaner and it's easier to write unit tests for your Prefect 2 flows and tasks than it was in Prefect 1. Those are some of my favorite features but I'm probably missing a few. I was in the same situation as you where I didn't design our original Prefect 1 solution, that's likely the reason for a good chunk of the time I spent performing our migration.
gratitude thank you 1
👍 1
114 Views