Prefect Tasks library in 2 0

Question

Todd de Quincey · Answer

In Prefect 1 0 we have quite an extensive library of pre built tasks For example the `SnowflakeQuery` task Looking at the Prefect 2 0 docs we have a new concept called Collections and a However the Collections Catalog is looking a little sad at the moment and several of the pre built tasks that I need e g Snowflake aren t listed there Is there a roadmap for porting all of the existing tasks over from 1 0 to 2 0

Anna Geller · Answer

Prefect 1 0 task library is to a large extent built through community contributions Since Prefect 2 0 is still so new we are just getting started with Prefect Collections and that s the main reason why there are not as many yet as in Prefect 1 0 Which integrations specifically are you interested in apart from Snowflake tasks If you interested in contributing check including even a video walkthrough cc < alex>

Todd de Quincey · Answer

Gotcha At this stage the biggest pieces of the puzzle are Snowflake and potentially a wider selection of AWS services

Todd de Quincey · Answer

We are a very small team at the moment and researching if we use Prefect over the incumbent Airflow but given our size we don t have lots of resources to build out a lot of custom Tasks etc If I get some spare time I ll give the cookie cutter a whirl to see how simple it is to build these out ourselves

alex · Answer

Hey < Todd de Quincey> We recently released `prefect snowflake` which give you the ability to easily query Snowflake within a Prefect flow Here s a link to the `prefect snowflake` GitHub Would you also mind sharing what AWS services your team is using This would help give our team an idea of what integrations to prioritize next for `prefect aws`

Todd de Quincey · Answer

Legendary as always