justabill
flow:"Daily ETL"
into the filter bar. This update also includes a query builder UI, so you can utilize and learn these operators quickly and easily. Download the latest version, pip install -U "prefect>=2.0a"
, and check it out!justabill
Environments
have been removed; finalizing the transition to RunConfigs
Weβve written a handy upgrade guide to help you make the transition. Learn more about other breaking changes and refinements in the changelog and how this release fits in the broader P progression in the blog post.
Big thanks to everyone who downloaded the release candidate and provided feedback! Even bigger thanks to those who contributed enhancements and tasks to this release, including:
β’ @ale
β’ Aneesh Makala
β’ @Connor Martin
β’ Gebing
β’ Julio Faracco
β’ @Kevin Mullins
β’ @Mathijs Miermans
β’ @Oliver Mannion
β’ @Raymond YuChris Reuter
03/03/2022, 6:43 PMChris Reuter
03/07/2022, 3:35 PMChris Reuter
03/08/2022, 5:20 PMChris Reuter
03/14/2022, 1:16 PMChris Reuter
03/14/2022, 1:24 PMChris Reuter
03/15/2022, 1:19 PMjustabill
orion
branch of the prefect
repo. Both the Orion engine and Prefect 2.0 as a whole will remain under active development in beta for the next several months, with a number of major features yet to come. Thank you for your feedback through the technical preview and please continue to provide feedback through the beta phase!
Today's release, 2.0b1, includes some exciting additions:
β’ Flows and deployments are now represented in the UI! If you've ever created a deployment without a schedule, you know it can be difficult to find that deployment in the UI. Flows and their deployments now have a dedicated home π on the growing left sidebar navigation.
β’ With the 2.0a13 release, we introduced work queues, which could only be created through the CLI. Now, you can create and edit work queues directly from the UI, then copy, paste, and run a command that starts an agent that pulls work from that queue.
β’ We're rolling out Collections, groupings of pre-built tasks and flows used to quickly build data flows with Prefect. Learn more about them in the the docs, with more info to come later this week!
β’ We also introduced profiles in the last release. We think you'll want to use more than one. Now, you can switch your active profile with prefect profile use <name>
Check out the release notes for more information.
...but wait there's more billy mays
Getting started with Prefect 2.0 is now even easier with Prefect Cloud 2.0, which has just been made available as a public beta. We'll tell the rest of the world π later this week, but we wanted to start with this community, without which it wouldn't have been possible β€οΈ. You can create a personal account for free, which will stay free forever. If you've been waiting to try out the Orion engine powering Prefect 2.0, now is the time do it!Chris Reuter
03/16/2022, 1:59 PMChris Reuter
03/16/2022, 8:02 PMChris Reuter
03/17/2022, 2:00 PMChris Reuter
03/17/2022, 5:05 PMChris Reuter
03/17/2022, 8:21 PMjustabill
Chris Reuter
03/18/2022, 8:38 PMChris Reuter
03/22/2022, 1:22 PMChris White
Chris Reuter
03/25/2022, 6:39 PMAndrew Black
03/28/2022, 1:22 PMChris Reuter
03/28/2022, 5:00 PMwork queues
and tags
. Register here!
β¦ At 3pm Eastern, Club club42 member @Henning Holgersen will be on PrefectLive showing off how he uses P to keep Docker images up-to-date.Andrew Black
03/29/2022, 4:02 PMAnna Geller
Chris Reuter
04/01/2022, 1:00 PMAndrew Black
04/08/2022, 5:58 PMjustabill
retry_on
setting. A slew of enhancements have been made to the ECSAgent, Azure Storage, Dask behavior on Kubernetes, Cloud CLI login, flow.run
error handling and more!
The task library also continues to improve with some additions and enhancements. In particular, a new task to create materializations with Transform has been added transform.
Special thanks to @ale, @emre, @Josh, @psimakis, and eedokl for their contributions to this release!
Learn more about the release in the release notes and on discourse.Chris Reuter
04/11/2022, 5:42 PMAnna Geller
run_checkpoint_validation(checkpoint_name="your_checkpoint")
You can find more details in this Discourse announcement.
Happy Engineering!Chris Reuter
04/25/2022, 1:00 PMAnna Geller