Hi! I have 2 questions about flows versioning -
1. Is it possible to run archived version of a flow?
2. The documentation states:
You could override the automatic version promotion to unarchive and enable old versions (for example, for A/B testing)
How can I do that?
a
Anna Geller
10/26/2021, 9:31 AM
@Gabi Pi
1. It’s not possible atm
2. You could build a custom function that you pass as idempotency key to prevent from incrementing a Version upon each registration, but this would also not unarchive, but only prevent bumping up the version number
So I think that docs are a bit misleading in this case. It seems that there is no option to run A/B testing leveraging the flow versioning feature...
a
Anna Geller
10/26/2021, 10:08 AM
Thanks, yeah this comes not from a documentation but from a blog post (from over 2 years) so maybe it was possible or considered at that time, but it’s not possible atm. However, it will be possible in Orion 🙂
For now, you can probably have two flows: flow A and flow B and do AB testing this way. Or build some conditional logic based on Parameter values? I’m sure there is a nice way to do it in Prefect without using versioning for it.
this is a 1:1 copy of this blog post 😂 https://www.prefect.io/blog/why-not-airflow/
Thanks for letting me know. We certainly need to remove this misleading sentence from the docs.
LMK if you have any issues with that AB testing.
🙏 1
k
Kevin Kho
10/26/2021, 2:02 PM
Hey @Gabi Pi, the issue is we don’t have guarantees that the previous will be around. For example, you can modify Module Storage/Git Storage/S3 Storage and the old one won’t be available because we just pull it during runtime rather than storing the code. Yes you are right versioning doesn’t do much in current Prefect.
g
Gabi Pi
10/26/2021, 2:09 PM
@Kevin Kho thanks for the explanation. I totally understand it although I would prefer that my flow will fail on something like "version not found" rather than disable this feature at all. Flows versioning is such a promising feature that other orchestration systems don't have (as far as I know) so it's a pity it cannot be used.
k
Kevin Kho
10/26/2021, 2:11 PM
We agree, which is why in Prefect 2.0, simultaneous versions of a flow will be allowed and you can choose which one to run.
🙏 1
🚀 1
g
Gabi Pi
10/26/2021, 2:12 PM
Sounds good! Is there any resource where can I find all the new features and bug fixes that will be part of Prefect 2.0?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.