https://prefect.io logo
Title
t

Todd de Quincey

05/23/2022, 10:28 AM
Prefect Tasks library in 2.0
In Prefect 1.0, we have quite an extensive library of pre-built tasks. For example, the
SnowflakeQuery
task here. Looking at the Prefect 2.0 docs, we have a new concept called Collections and a Collections Catalog. However, the Collections Catalog is looking a little sad at the moment, and several of the pre-built tasks that I need (e.g. Snowflake) aren’t listed there. Is there a roadmap for porting all of the existing tasks over from 1.0 to 2.0?
a

Anna Geller

05/23/2022, 12:43 PM
Prefect 1.0 task library is to a large extent built through community contributions. Since Prefect 2.0 is still so new, we are just getting started with Prefect Collections and that's the main reason why there are not as many yet as in Prefect 1.0. Which integrations specifically are you interested in apart from Snowflake tasks? If you interested in contributing, check this page including even a video walkthrough cc @alex
t

Todd de Quincey

05/23/2022, 12:45 PM
Gotcha. At this stage, the biggest pieces of the puzzle are Snowflake and potentially a wider selection of AWS services.
We are a very small team at the moment and researching if we use Prefect over the incumbent (Airflow), but given our size we don’t have lots of resources to build out a lot of custom Tasks etc. If I get some spare time, I’ll give the cookie cutter a whirl to see how simple it is to build these out ourselves.
a

alex

05/23/2022, 1:16 PM
Hey @Todd de Quincey! We recently released
prefect-snowflake
which give you the ability to easily query Snowflake within a Prefect flow. Here’s a link to the
prefect-snowflake
GitHub: https://github.com/PrefectHQ/prefect-snowflake. Would you also mind sharing what AWS services your team is using? This would help give our team an idea of what integrations to prioritize next for
prefect-aws
.
:thank-you: 1
t

Todd de Quincey

05/23/2022, 1:17 PM
Legendary (as always)!