https://prefect.io logo
Join Slack
Powered by
Prefect Tasks library in 2.0
# ask-community
t
Prefect Tasks library in 2.0
In Prefect 1.0, we have quite an extensive library of pre-built tasks. For example, the 
SnowflakeQuery
task here. Looking at the Prefect 2.0 docs, we have a new concept called Collections and a Collections Catalog. However, the Collections Catalog is looking a little sad at the moment, and several of the pre-built tasks that I need (e.g. Snowflake) aren’t listed there. Is there a roadmap for porting all of the existing tasks over from 1.0 to 2.0?
a
Prefect 1.0 task library is to a large extent built through community contributions. Since Prefect 2.0 is still so new, we are just getting started with Prefect Collections and that's the main reason why there are not as many yet as in Prefect 1.0. Which integrations specifically are you interested in apart from Snowflake tasks? If you interested in contributing, check this page including even a video walkthrough cc @alex
t
Gotcha. At this stage, the biggest pieces of the puzzle are Snowflake and potentially a wider selection of AWS services.
We are a very small team at the moment and researching if we use Prefect over the incumbent (Airflow), but given our size we don’t have lots of resources to build out a lot of custom Tasks etc. If I get some spare time, I’ll give the cookie cutter a whirl to see how simple it is to build these out ourselves.
a
Hey @Todd de Quincey! We recently released 
prefect-snowflake
which give you the ability to easily query Snowflake within a Prefect flow. Here’s a link to the 
prefect-snowflake
GitHub: https://github.com/PrefectHQ/prefect-snowflake. Would you also mind sharing what AWS services your team is using? This would help give our team an idea of what integrations to prioritize next for 
prefect-aws
.
🙏 1
t
Legendary (as always)!
107 Views
Open in Slack
PreviousNext
Powered by