nathaniel
Anna Geller
disable_run_logger
allowing to disable Prefect logger for testing tasks and flows
β’ new task run UI page
β’ several fixes and enhancements -- many of those include improvements to Deployments.
As always, thanks to all contributors and everyone reporting issues on GitHub! π
For a detailed overview of changes, see the blog post for the release.
Happy Engineering! PJeff Hale
09/01/2022, 9:37 PMrun
for all infrastructure types β #6654
β’ Update Docker container name collision log to INFO
level for clarity β #6657
β’ Refactor block documents queries for speed β‘οΈ β #6645
β’ Update block CLI to match standard styling β #6679
Fixes
β’ Add git
to the Prefect image β #6653
β’ Update Docker container runs to be robust to container removal β #6656
β’ Fix parsing of PREFECT_TEST_MODE
in PrefectBaseModel
β #6647
β’ Fix handling of .prefectignore
paths on Windows β #6680
Contributors
β’ @Mars made their first contribution β #6639
β’ @pdashk made their first contribution β #6640
pip install -U prefect
to upgrade! πAnna Geller
Chris White
Chris Reuter
09/13/2022, 12:45 PMAnna Geller
ECSTask
infrastructure block - shoutout to @Zanie for making it so easy to use and applicable to a variety of use cases (Fargate, EC2, Spot instances, and tons of flexible configuration options). Note that we are currently releasing this as an experimental block β οΈ - it's ready for early feedback, but if you plan to use it in production, be aware that this block may change without notice in the next couple of releases,
β’ Support for setting custom parameter values directly from the deployment build CLI
β’ New CLI for interacting with and setting custom timezone-dependent schedules for your deployments incl. the ability to pause or resume a schedule directly from the CLI
---
On top of that, this release includes some really cool enhancements and important fixes, a.o.:
β’ improved query performance and protecting against race conditions when disabling and reenabling schedules,
β’ fixes to blocks and orchestration metadata context
β’ several documentation improvements, including the brand new catalog of Prefect Recipes π§βπ³
As always, to upgrade: pip install prefect -U
Thanks to all contributors and everyone reporting issues on GitHub! For a detailed overview of changes, see the release notes.
Happy Engineering! PJeff Hale
09/22/2022, 8:23 PMAnna Geller
Anna Geller
Anna Geller
prefect-gcp
in the PR PrefectHQ/prefect-gcp#48
As always, thanks to everyone reporting issues on GitHub, and kudos to two new contributors:
β’ @Hongbo Miao - in #6956
β’ @hateyouinfinity - in #6955
Happy Engineering! PAnna Geller
Will Raphaelson
10/04/2022, 6:14 PMnathaniel
Anna Geller
run_deployment
utility, allowing you to trigger flow runs from deployments, wait for their completion, schedule runs for later (even from a custom application), coordinate parametrized dataflows across teams, and run each part of your workflow in a separate infrastructure (e.g., a Docker container or a Kubernetes job). Huge thanks to @Dustin Ngo and @Zanie for building this so quickly based on user feedback
β’ improvements to serverless deployments, including a.o. Google Cloud Run infrastructure block, and ECS customizations
β’ batch deletion of flow runs from the UI (and more UI features coming soon!) - kudos to @Marichka Offen
Check the release post to find out more.
Thanks to everyone reporting issues on GitHub and to @ale and @StΓ©phan Taljaard for contributing.Jenny
10/07/2022, 1:16 PMChris Reuter
10/12/2022, 7:48 PMAnna Geller
allow_failure
annotation, dynamic work-queue patterns for easier configuration of concurrency limits, and more. Check out the release blog post and release notes for more details.
Happy Engineering! marvin duckKalise Richmond
10/17/2022, 5:24 PMAnna Geller
Anna Geller
ECSTask
infrastructure block is production-ready! We've got great feedback from the community that we used to improve the UX, and now this block is no longer experimental! Thanks to everyone who shared feedback and contributed feature requests on the prefect-aws repository.
azure AzureContainerInstanceJob
infrastructure block for running containers on Azure is now released as part of the prefect-azure collection - @Ryan Peden will share a blog post demonstrating how to use this infrastructure block very soon. One of the coolest characteristics of Azure Container Instances is that it allows you to run serverless containers with GPUs - extremely helpful for all data scientists using Prefect and Azure to run GPU-powered ML workflows.
π a new key-value store collection contributed by @Zanie!
Apart from collections, this release includes bug fixes and enhancements to the core library. See the release notes for details.
If you haven't checked out 2.6 yet, you should now! We launched first-class configuration of results in 2.6.0, and every release since includes additional improvements to result handling.
Happy Engineering!Andrew Black
10/20/2022, 9:06 PMChris Reuter
10/25/2022, 3:09 PMAnna Geller
prefect config set PREFECT_RESULTS_PERSIST_BY_DEFAULT=true
.
Other enhancements include:
β’ support for Python 3.11 python
β’ a new API route for work queue status check (UI work queue health check page is on the roadmap, as well) βοΈ
β’ documentation showing how you can configure SSO for Prefect Cloud directly from the UI
β’ two new π¦ Prefect Collections: prefect-docker and prefect-census
For more info about all fixes and enhancements, see the release notes.
As always, to upgrade: pip install prefect -U
Have a great rest of the week!Kalise Richmond
11/01/2022, 3:02 PMJon Chittenden
11/03/2022, 2:41 PMAnna Geller
nathaniel
Anna Geller
prefect-hightouch
collection for Hightouch to help you reverse your ETL π
As always, you can see the release notes for more details.Anna Geller