• Jim Crist-Harif

    Jim Crist-Harif

    1 year ago
    Prefect 0.14.11 has been released 🎉 Highlights: • New
    prefect server config
    command that outputs a standalone
    docker-compose.yaml
    file that can be used without the prefect CLI. • New task library tasks for working with files/filesystems in
    prefect.tasks.files
    • Added
    project_name
    /project_id to flow run execution context in orchestrated flow runs Thanks to all our community contributors this week 👏 • David Zucker • Jacob Hayes • Joël Luijmes • Timo S. • Yogi Patel The full changelog can be found here: https://github.com/PrefectHQ/prefect/releases/tag/0.14.11.
  • Jim Crist-Harif

    Jim Crist-Harif

    1 year ago
    Prefect 0.14.12 has been released 🚀 Highlights: • Complete redesign of the ECS agent to better support per-flow-run configuration and pre-registered ECS task definitions • Two new filesystem tasks Thanks to all our community contributors this week 👏 • Ben Fogelson • Marwan S. • Timo S. The full changelog can be found here: https://github.com/PrefectHQ/prefect/releases/tag/0.14.12
  • Jim Crist-Harif

    Jim Crist-Harif

    1 year ago
    Additionally! Thanks to several community members (and our own @Michael Adkins), we have our first official Prefect Server Helm Chart release! 😛arty-parrot: 😛arty-parrot: The chart had been marked as "experimental" for the last few months, but today that flag has been removed. The Helm chart is now versioned, which pins each chart release to compatible releases of Prefect Server, the Prefect UI, and Prefect Core. Versions are published to a helm repo at https://prefecthq.github.io/server/. See the README for installation instructions. On Friday next week (3/19) at 4 EDT @Laura Lorenz will be doing a livestream of how to deploy this helm chart on Azure, see the meetup link for more information
  • Hiro Rodriguez

    Hiro Rodriguez

    1 year ago
    Hi everyone! 👋 As some of you know, for the last 2+ months we’ve been piloting a new pricing model for Prefect Cloud and we’ve been pleasantly surprised by the wonderful reception by the community. Many of you have already explored this new way to join Prefect Cloud, through our expanded free tier. With feedback from community members, four ideas became central to what we call “success-based pricing”: 👍 Pay only for what you need  A generous free tier that includes 10,000 free runs every month (enough to power the majority of small business ETL use cases) 📉 Automatic volume discounts based on your usage 🚀 Committed usage plans for those looking for even deeper discounts or predictable pricing What makes it “success-based”? Pricing is based only on the number of successful task runs processed. We never charge for retries, failures, or even successful tasks that take less than a second to run. And we heard your feedback: all plans come with unlimited concurrency! Whether you’re on a free plan or an enterprise user, we want to make sure that Prefect Cloud is accessible to all in an aligned way. This simple, success-based pricing is available for all new users today, and existing users can choose to upgrade to a free plan from your team settings. Happy Engineering! https://www.prefect.io/pricing
    Hiro Rodriguez
    1 replies
    Copy to Clipboard
  • Jim Crist-Harif

    Jim Crist-Harif

    1 year ago
    Prefect 0.14.13 has been released 🚀 This release introduces two new CLI commands:
    prefect register
    for easier registration of flows (docs). •
    prefect build
    for building flows without registration (docs). Combined, these expose a lot of new & interesting deployment options. One is automatic flow reloading. The
    prefect register
    CLI supports a
    --watch
    flag which will watch your source files, and auto-register them on save. This can be useful for development, but also exposes an airflow-like pattern where new flows can be deployed by adding them to a directory. We have several additional CLI improvements in the works, so stay tuned. As always, big thanks to all our community contributors this release 👏 : - Abid Ahmad - Alexandr N. Zamaraev - Jacob Hayes - Timo S. The full changelog can be viewed here: https://github.com/PrefectHQ/prefect/releases/tag/0.14.13 Happy Engineering!
  • Kevin Kho

    Kevin Kho

    1 year ago
    Hello Prefect community! 👋 Join Laura this Friday (4 PM ET) for a livestream about data science on Prefect. This livestream will demo using Prefect in an end-to-end data science workflow, which will illustrate why Prefect is the tool of choice for workflow orchestration. I’ll send a reminder on the day of the event with a direct link as well - hope to see you there!
  • Michael Adkins

    Michael Adkins

    1 year ago
    Hello everyone! Today we're happy to announce we've released version 0.14.17 🚀 Some highlights from the last few releases:- New
    Git
    storage allows you to use any
    git
    based service for flow storage (this includes deploy token/key authentication!)- Error messages have been improved in more than five places to help guide users to a resolution -
    ShellTask

    now works on Windows and supports more configurable logging

    Bitbucket
    storage now supports cloud servers- A custom terminal state handler can now be placed on a flow, allowing users to customize the final state of their flow with access to the states of their flow's reference tasks - An architecture diagram has been added to the docs (https://docs.prefect.io/orchestration/#architecture-overview)- The required docker-compose version to run
    prefect server start
    has been lowered and documented- Environment variables can be passed to the
    UniversalRun

    config

    PostgresFetch

    can return data column names

    prefect server start
    can now connect to an separately managed postgres instance There's always more, see the full changelog at https://github.com/PrefectHQ/prefect/blob/master/CHANGELOG.md Thanks to our community contributors!- Alessandro Lollo - David Zucker - Greg Lu - James Lamb - Sean Talia - Jonathan Wright - Ben Fogelson - Gabriel Montañola Remember this list isn't exhaustive and for every person listed in it, there are many more who have helped report issues and written PRs that help move us forward even if they aren't merged. Thanks to everyone here in our Slack community!
  • Zach Angell

    Zach Angell

    1 year ago
    Hi everyone! 👋 Today we’re introducing KV Store: managed metadata for Prefect Cloud flows! KV Store allows you to share small pieces of metadata in the form of key-value pairs across your team and flows. You can use it to track useful information and state across your team. Some example use cases we've come across include:🔢 the last processed value🤝 easily share state across flows⚙️ custom configuration Read more about the feature here https://www.prefect.io/blog/introducing-the-prefect-kv-store Please note: you'll need to upgrade to Prefect Core 0.14.21 to get full functionality.
  • Jeremiah

    Jeremiah

    1 year ago
    Hi folks -- today we announced Prefect’s Series B! :marvin: :marvin-duck: 🎉 Thank you all for your advice and encouragement - and yes, even your complaints - that helped steer the product and make it as useful as possible. This funding will let us focus on relentlessly delivering value to our users and customers, and we’re excited to do so for years to come. We’re turning everything up to 11, and you can read more about it on our blog! We’ll have many more exciting announcements for this group soon. Until then, happy engineering from our team to yours!
  • Chris White

    Chris White

    1 year ago
    Hello everyone! The Prefect team will be performing infrastructure upgrades on Prefect Cloud this Saturday, June 19th, between 6:30pm UTC - 7:30pm UTC (2:30pm ET-3:30pm ET). We do expect intermittent periods of disruption during this time window; to stay up-to-date please follow along on our status page: https://prefect.status.io/pages/maintenance/5f33ff702715c204c20d6da1/60cb9ef4ffceea053471149d