allowing to disable Prefect logger for testing tasks and flows • new task run UI page • several fixes and enhancements -- many of those include improvements to Deployments. As always, thanks to all contributors and everyone reporting issues on GitHub! 💙 For a detailed overview of changes, see the blog post for the release. Happy Engineering! P
Jeff Hale09/01/2022, 9:37 PM
for all infrastructure types — #6654 • Update Docker container name collision log to
level for clarity — #6657 • Refactor block documents queries for speed ⚡️ — #6645 • Update block CLI to match standard styling — #6679 Fixes • Add
to the Prefect image — #6653 • Update Docker container runs to be robust to container removal — #6656 • Fix parsing of
— #6647 • Fix handling of
paths on Windows — #6680 Contributors • @Mars made their first contribution — #6639 • @pdashk made their first contribution — #6640
to upgrade! 🎉
pip install -U prefect
Chris Reuter09/13/2022, 12:45 PM
infrastructure block - shoutout to @Zanie for making it so easy to use and applicable to a variety of use cases (Fargate, EC2, Spot instances, and tons of flexible configuration options). Note that we are currently releasing this as an experimental block ⚠️ - it's ready for early feedback, but if you plan to use it in production, be aware that this block may change without notice in the next couple of releases, • Support for setting custom parameter values directly from the deployment build CLI • New CLI for interacting with and setting custom timezone-dependent schedules for your deployments incl. the ability to pause or resume a schedule directly from the CLI --- On top of that, this release includes some really cool enhancements and important fixes, a.o.: • improved query performance and protecting against race conditions when disabling and reenabling schedules, • fixes to blocks and orchestration metadata context • several documentation improvements, including the brand new catalog of Prefect Recipes 🧑🍳 As always, to upgrade:
Thanks to all contributors and everyone reporting issues on GitHub! For a detailed overview of changes, see the release notes. Happy Engineering! P
pip install prefect -U
in the PR PrefectHQ/prefect-gcp#48 As always, thanks to everyone reporting issues on GitHub, and kudos to two new contributors: • @Hongbo Miao - in #6956 • @hateyouinfinity - in #6955 Happy Engineering! P
Will Raphaelson10/04/2022, 6:14 PM
utility, allowing you to trigger flow runs from deployments, wait for their completion, schedule runs for later (even from a custom application), coordinate parametrized dataflows across teams, and run each part of your workflow in a separate infrastructure (e.g., a Docker container or a Kubernetes job). Huge thanks to @Dustin Ngo and @Zanie for building this so quickly based on user feedback • improvements to serverless deployments, including a.o. Google Cloud Run infrastructure block, and ECS customizations • batch deletion of flow runs from the UI (and more UI features coming soon!) - kudos to @Marichka Offen Check the release post to find out more. Thanks to everyone reporting issues on GitHub and to @ale and @Stéphan Taljaard for contributing.
Jenny10/07/2022, 1:16 PM
annotation, dynamic work-queue patterns for easier configuration of concurrency limits, and more. Check out the release blog post and release notes for more details. Happy Engineering! marvin duck
Kalise Richmond10/17/2022, 5:24 PM
infrastructure block is production-ready! We've got great feedback from the community that we used to improve the UX, and now this block is no longer experimental! Thanks to everyone who shared feedback and contributed feature requests on the prefect-aws repository. azure
infrastructure block for running containers on Azure is now released as part of the prefect-azure collection - @Ryan Peden will share a blog post demonstrating how to use this infrastructure block very soon. One of the coolest characteristics of Azure Container Instances is that it allows you to run serverless containers with GPUs - extremely helpful for all data scientists using Prefect and Azure to run GPU-powered ML workflows. 🔑 a new key-value store collection contributed by @Zanie! Apart from collections, this release includes bug fixes and enhancements to the core library. See the release notes for details. If you haven't checked out 2.6 yet, you should now! We launched first-class configuration of results in 2.6.0, and every release since includes additional improvements to result handling. Happy Engineering!
Andrew Black10/20/2022, 9:06 PM
Chris Reuter10/25/2022, 3:09 PM
. Other enhancements include: • support for Python 3.11 python • a new API route for work queue status check (UI work queue health check page is on the roadmap, as well) ☑️ • documentation showing how you can configure SSO for Prefect Cloud directly from the UI • two new 📦 Prefect Collections: prefect-docker and prefect-census For more info about all fixes and enhancements, see the release notes. As always, to upgrade:
prefect config set PREFECT_RESULTS_PERSIST_BY_DEFAULT=true
Have a great rest of the week!
pip install prefect -U
Kalise Richmond11/01/2022, 3:02 PM
Jon Chittenden11/03/2022, 2:41 PM
collection for Hightouch to help you reverse your ETL 😎 As always, you can see the release notes for more details.