https://prefect.io logo
Title
j

Jacopo Tagliabue

04/02/2021, 4:43 PM
Ciao! I'm Jacopo from Coveo! I love prefect and also Metaflow - and I thought to hack together a simple shellTask allowing a Metaflow Flow to live as a task inside prefect (for us, metaflow is typically after dbt and great expectations, so it's a dag inside a dag). I share here the code and 3 mins video of me showing the flow working with the local agent -> Open repo (WIP - don't read too much into it)
<https://github.com/jacopotagliabue/metaflow-as-prefect-task>
Screenshot Overview Here
<https://drive.google.com/file/d/1XoG8UfPpiCSuXYvp9Y27zm6_E4D3C9NX/view>
Open to feedback, especially if you think it's a broad enough use case to deserve a much better polished task class (which can totally be done and I'm happy to work together with others on it!)
❤️ 6
n

nicholas

04/02/2021, 4:45 PM
This is really cool @Jacopo Tagliabue!
🙏 1
d

Dylan

04/02/2021, 7:04 PM
This is awesome! 💯
j

Jacopo Tagliabue

04/02/2021, 7:24 PM
@Dylan @nicholas -> let me know if you think you would like an "official" MF task for the library: you know where to find me 😉
👍 1
d

Dylan

04/04/2021, 5:04 PM
@Jacopo Tagliabue we’d love one 💯
If you have any questions about contributing, please let us know in #prefect-contributors