Hi. I'm wondering what is the recommended way to run only parts of a flow. For example only tasks with certains tags.
n
nicholas
05/13/2020, 3:46 PM
Hi @Emmanuel Klinger - right now Prefect doesn't have a concept of running single tasks within a Flow. However, you could accomplish something like this by using conditional branches, ifelse tasks, or switch tasks
z
Zachary Hughes
05/13/2020, 3:46 PM
Hi @Emmanuel Klinger! We don't support that in a first-class way at the moment, but it's definitely on our radar. If you don't mind sharing, we'd love to hear your use case and have you chime in on this issue!
https://github.com/PrefectHQ/prefect/issues/2269
upvote 1
e
Emmanuel Klinger
05/13/2020, 5:31 PM
Thanks for the hints. I guess it relates also to best practices using prefect. I'm essentially building an ETL style flow. Now I only want to run the "T" part of it and I'm wondering how to best achieve this in prefect.
n
nicholas
05/13/2020, 8:23 PM
My suggestion for now would be to use parameters to accomplish this, where perhaps E and L would be skipped given a certain parameter value and T would run even if E was skipped.
nicholas
05/13/2020, 8:24 PM
but as Zachary mentioned, we're actively looking into how we can make that possible without additional code! 🙂
e
Emmanuel Klinger
05/14/2020, 6:17 PM
Thanks a lot again. I'm really enjoying prefect a lot from a developer/data science perspective.