https://prefect.io logo
Docs
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
announcements
  • c

    Chris White

    02/04/2020, 4:57 PM
    Hi <!channel> - we’d like to welcome you all as Prefect’s very first Launch Partners! If we haven’t already told you, we truly appreciate all of the questions and feedback you provide us, as well as the support you offer to each other! As a token of our appreciation, we have gone ahead and whitelisted all of you for Prefect Cloud access where you can choose between various tiers of service (including our completely free Scheduler tier). As we prepare for a fully public launch in the near future, we wanted to give you all early access (with discounted pricing if you choose to upgrade). If you haven’t already received an email, you can still head over to https://cloud.prefect.io/ and click “Sign up” to create your Auth0 user and login! (Note that you’ll need to use the email address you use for Slack). As always, we appreciate your continued feedback and support - thank you for being our very first Prefect Launch Partners!
    💯 13
    :marvin: 18
    :prefect: 18
    🚀 27
    😛refect-cloud: 13
    🤘 3
    🎊 14
    🚁 7
    🍾 14
    🎉 14
    🐿 2
  • j

    Jeremiah

    02/10/2020, 6:16 PM
    Hello <!here> — Prefect Cloud launched to the public a few minutes ago! We absolutely would not be in a position to launch such a rock-solid product without the support, feedback, and comments from all of you in the Prefect community. This is also one of the first times we’ve been able to publicly discuss the hybrid model that many of you have gotten to know so well. And this is just the beginning! Now that we’ve got the foundation in place, you wouldn’t believe some of the stuff we’re able to build on top of it. As part of the initial Cloud rollout, we’ll begin publishing a roadmap and soliciting your thoughts on where we should focus our efforts most. Thank you as always for your guidance. We’re excited to be part of your data team. — All of us at Prefect https://twitter.com/PrefectIO/status/1226930659823931394?s=20
    💯 15
    :prefect: 9
    🤖 5
    :marvin: 13
    🎊 6
    👍 6
    😍 10
    ⭐ 6
    👏 7
    😛refect-cloud: 9
    🍾 7
    🚀 24
    🤩 11
    💻 5
    🚁 3
  • j

    Jeremiah

    02/25/2020, 2:39 PM
    Hi <!here> — Dask has dropped Python 3.5 support and we are talking about doing the same for Prefect Core. We’ve opened an issue for discussion (https://github.com/PrefectHQ/prefect/issues/2075) — please leave a note if you want to weigh in.
    👍 5
    :upvote: 1
    👋 1
  • l

    Laura Lorenz (she/her)

    02/27/2020, 4:17 PM
    Hey <!here>! We will be attending PyCon this year and hope to hang out with some of you IRL! We’ve started up a channel #pycon2020 for any Prefect users or contributors who will be there ー we’re already talking about organizing a centralized meetup while we are all in Pittsburg so let us know if you are interested. We also plan to be sticking around for some of the developer sprint week, for anyone who is interested in contributing to core while we’re there!
    🚀 7
    🆒 2
    🐍 3
    :upvote: 5
    :marvin: 1
    😛ython: 5
    😍 2
  • l

    Laura Lorenz (she/her)

    03/17/2020, 10:23 PM
    Hey <!here>! If you are or want to be a contributor to Prefect, I made a dedicated channel #prefect-contributors for contributors to get announcements or ask questions. It’s been awesome to be working with contributors on github, and I think this would be a nice additional communication channel for anything outside a given issue or PR or just general interest or questions. I’ll also use that channel to publicize some Hangouts, first one this Friday, where I will be available for synchronous discussion as well for any one who wants to voice or video in. See you there!
    :marvin: 5
    :upvote: 6
    :prefect: 5
    🤘 1
  • j

    Jeremiah

    03/27/2020, 12:22 PM
    Hello everyone <!here>! Next week we’re going to take a BIG step and release an open-source version of the Prefect UI. We know this has been high on everyone’s wish list and we’re excited to be able to deliver it. One of our major motivations is to ensure that businesses can start taking advantage of Prefect with the least friction possible, and we have learned that the UI is an important part of that adoption. We will continue to offer our complete workflow platform, Prefect Cloud, including features that are appropriate for production use, but we know this step will bring immediate value to a lot of businesses that need it now. Here’s our blog post about our plans and I’ll report back when the release is available! https://medium.com/the-prefect-blog/project-earth-an-open-source-ui-for-prefect-7276ee359ecb
    🚂 8
    🎉 6
    :marvin: 17
    ❤️ 27
    :upvote: 9
    🎂 10
  • z

    Zachary Hughes

    03/27/2020, 2:34 PM
    Hi folks <!here>! To help support the increased traffic we've been seeing, the Prefect Cloud API will undergo a spot of scheduled maintenance tomorrow afternoon. Some runs may kick off late, but we anticipate no other impact. As always, feel free to reach out with any questions/comments/concerns!
    👍 4
  • j

    Jeremiah

    03/30/2020, 4:55 PM
    It’s finally here: Prefect 0.10 has been released and includes an open-source orchestration layer and UI! We are extremely excited to reach this milestone for our product, and grateful to this enormous and enthusiastic community - you all made it possible. If you know Prefect, you know we like things to be simple. Getting started with the new backend and UI is as simple as upgrading, running
    prefect server start
    , and visiting http://localhost:8080.  We hope that open-sourcing the platform directly benefits our our open-source community at a moment when saving time and money is especially important. Please help us in sharing this announcement as widely as possible - a like on Twitter or a clap on Medium goes a surprisingly long way toward helping us continue our mission to eliminate negative engineering. Happy engineering! https://twitter.com/PrefectIO/status/1244669032281890816
    🚀 19
    :upvote: 6
    💯 11
    :marvin: 15
    🚁 8
    🎉 16
    ❤️ 13
  • d

    Dylan

    03/30/2020, 5:40 PM
    We’re hosting a fireside chat this Wednesday, April 1st at 2pm Eastern - join @Jeremiah and @Chris White and ask them anything! https://www.meetup.com/Prefect-Community/events/269746269
    :marvin: 5
    :prefect: 3
    🔥 9
    🤓 3
    🤔 4
    🚁 6
    :upvote: 4
  • l

    Laura Lorenz (she/her)

    03/31/2020, 5:07 PM
    Hey community! Just a quick note that there is a new channel, #tech-good-reads, for anyone who wants to share/discuss what you’ve been reading (blogs/books/videos/etc), and a few of us are voting now on a technical book to read at the same time (April’s theme is going to be streaming data) and keep an open forum on. Hope to see you there 📚 🤓
    📚 4
  • d

    Dylan

    04/01/2020, 6:22 PM
    We’re live! Our Q&A with @Jeremiah (our CEO) and @Chris White (out CTO) is going on right now in Google Hangouts until 3pm! https://meet.google.com/ige-wygj-dcb
  • d

    Dylan

    04/01/2020, 6:59 PM
    Thanks to everyone who came out for our Q&A! Let us know if you had a good time and what you’d like to see next time: https://forms.gle/A72FSTW29vGd7K4KA
    1 reply · 1 participant
  • c

    Chris White

    04/03/2020, 8:01 PM
    @Laura Lorenz (she/her) is now live streaming a demo of the new Prefect Server setup on YouTube right now:

    https://youtu.be/k9arDAr1GeA▾

    — feel free to stop by!
    👍 6
    :prefect: 2
    ▶️ 3
    l
    1 reply · 2 participants
  • l

    Laura Lorenz (she/her)

    04/07/2020, 4:37 PM
    Hi all — FYI the recording of the Q&A with the Prefect CEO and CTO from last Wednesday April 1 is up on our Youtube channel now for you to watch, rewatch or share!

    https://www.youtube.com/watch?v=Y2ndi6P4OhA&amp;feature=youtu.be▾

    🏄‍♂️ 1
    :prefect: 6
    🎉 12
    :marvin: 9
    😄 3
    :upvote: 2
    🚁 2
  • l

    Laura Lorenz (she/her)

    04/20/2020, 1:41 PM
    Hi all! If you haven’t been following in #pycon2020 or #prefect-contributors, we are hosting sprints today in the spirit of PyCon — a whole day long Zoom where contributors, new and old, can hack together on Prefect core! Since PyCon isn’t in Pittsburg the whole thing is digital, so feel free to stop by sometime today before 7 EDT. https://zoom.us/j/92984979179
    😛ython: 3
    :marvin: 3
    🚀 3
  • d

    Dylan

    04/28/2020, 7:23 PM
    Hi all! We’re going to start sending a survey to everyone who joins our community to learn a bit more about what people hope to use Prefect for and how we can make it better. If you all would take a moment to fill it out we’d really appreciate it! https://forms.gle/VACEykPWths5f1cu5
    :marvin: 2
    🚁 2
    👍 7
    📝 2
    👋 2
  • n

    nicholas

    04/29/2020, 3:05 PM
    Hi everyone, we're experiencing some outages with Prefect Cloud right now. We're working on getting service restored as quickly as possible and will update you as soon as possible.
  • z

    Zachary Hughes

    04/29/2020, 3:10 PM
    Our API is back up and running. We're still investigating issues logging into the UI, and will update the channel as soon as possible.
  • z

    Zachary Hughes

    04/29/2020, 3:13 PM
    The Prefect Cloud UI is back up. Thank you for your patience.
    :upvote: 6
  • z

    Zachary Hughes

    05/11/2020, 8:03 PM
    Hi folks, We're seeing some issues with Prefect Cloud. We're actively investigating, and will update this channel as soon as we have an update. Edit: this issue appears to be resolved. Thank you for your patience.
    👍 5
  • n

    nicholas

    05/15/2020, 2:44 PM
    Hi all, we're experiencing some intermittent disruptions in the Prefect Cloud API; you may see some disruptions in the Prefect Cloud UI, including some issues logging in and viewing flows. All data is intact but you may have some brief flow and task run downtime. We're working on getting service restored as soon as possible and will update the channel as more information becomes available. Feel free to each out to me if you have any questions or concerns.
    :upvote: 1
  • n

    nicholas

    05/15/2020, 3:13 PM
    Hi all, service has been full restored. I'll be posting shortly about what happened and what we're doing to fix it.
    👍 2
  • n

    nicholas

    05/15/2020, 3:50 PM
    As a follow up to my earlier message, we wanted to let everyone know what went wrong and what we're doing to prevent similar outages in the future. _What happened_: During a routine API release at approximately 09:28 EST, one of our API nodes became out of sync with the others due to a hanging application of metadata. As a result, traffic served to the unhealthy node incorrectly received 400 errors on any requests containing reference to flow schedules. While investigating the issue, our Cloud engineers were forced to re-apply the metadata, leading to a complete service disruption that lasted approximately 9 minutes. In this window, all communication with the API was severed, which means runs that were scheduled during that time may have been late and runs happening at that time may have become zombies. The intermittent disruptions lasted from approximately 09:45 EST to 11:00 EST. _What we're doing to respond_: One of the services that make up the Cloud architecture has a mechanism that we use when applying database migrations; this mechanism is one that we've outgrown, and was the source of the disruption. Moving forward, we're moving to a more scalable API metadata application (removing the mechanism altogether) and introducing safeguards to the process in the form of pre-production replica DBs.
    :prefect: 1
    👍 10
  • c

    Chris White

    05/16/2020, 12:55 AM
    Hey folks! Apologies for the late Friday announcement but we are super excited to announce the release of Prefect 0.11.0 / 0.11.1! The headline feature of this release is first class file-based caching semantics (similar to Make / Luigi) for efficient reuse of task results. We wrote up a blog post describing these changes and more here: https://medium.com/the-prefect-blog/prefect-0-11-0-improved-apis-and-targets-79fef9d90aec Happy Engineering!
    🚁 5
    😍 9
    🕚 4
    🚀 17
    :hattip: 4
    💯 7
    :marvin: 10
  • l

    Laura Lorenz (she/her)

    05/29/2020, 4:32 PM
    Hey everyone! Just wanted to blast out that I’m hosting a zoom call today for Prefect users at 4pm EDT / 1 pm PDT. This is a casual chance to get connected with other Prefect users over voice and see what they’re up to! We will do a few polls to break the ice and see what everyone is using in Prefect, and I’ve set up some breakout rooms so we can split up into smaller groups over topics if need be. One breakout room will be for totally new Prefect users where I will do a little demo for 10 minutes, so if you are are new or just curious about Prefect, please do stop by! :marvin:
    🚀 2
    :upvote: 5
    2 replies · 1 participant
  • j

    Jeremiah

    06/05/2020, 6:11 PM
    Hey everyone! We have a flood of features and announcements queued up, but a few have already slipped out. Cloud users, you’ll notice a new graph whenever you’re looking at a flow or group of flows. This live-updating visualization will show you recent history, states, durations, and scheduled runs, as well as letting you jump quickly to runs of interest. Most importantly, it’ll give you an “at-a-glance” look at the health of your system. It’s the first in a series of “higher-order” ways of working with your data that @nicholas has been spearheading in the UI, and frankly we think it’s awesome. Please give us feedback and suggestions - you’ll see this popping up more and more soon!
    🚀 10
    💯 7
    😛refect-cloud: 13
    🙌 18
    📊 6
    👏 8
    :marvin: 11
  • d

    Dylan

    06/11/2020, 4:31 PM
    Hey Everyone! I’d like to ask for your help to make Prefect Cloud and Prefect Server even better. Would you take 4 minutes to fill out this feedback survey? https://forms.gle/GArq27SyxBd8v4MCA Thank you! <!here>
    😛refect-cloud: 3
    🙏 6
    :prefect: 1
    ✔️ 1
  • l

    Laura Lorenz (she/her)

    06/22/2020, 2:37 PM
    Hi all! Just want to officially circle back on the “Developing on Prefect’s Vue.js UI” livestream from May — we had many technical difficulties day-of 😬 but between some heavy editing and reshooting some of the screencasts and audio, the same content is now “remixed” and ready to view here 😁:

    https://www.youtube.com/watch?v=mXbTuAZYm6g▾

    In it we walk you through setting up your development environment for front-end development on Prefect, and then walk through the front-end code for a PR I made with @nicholas’s help adding the “API Status” tile on Server’s UI. Enjoy!
    🚀 5
    💯 6
    🚢 2
    :marvin: 4
    🎨 2
    👍 1
  • c

    Chris White

    06/25/2020, 5:34 PM
    Hey folks! @Laura Lorenz (she/her) just published an excellent blog post on one of Prefect’s most popular features: mapping! If you’ve ever heard us talking about “DFE” and want to learn what it’s all about, or if you’re curious to know a bit more about the past and future of Prefect mapping, give it a read: https://medium.com/the-prefect-blog/map-faster-mapping-improvements-in-prefect-0-12-0-7cacc3f14e16
    🚀 14
    :marvin: 1
    💯 9
    👏 13
  • d

    Dylan

    07/08/2020, 4:27 PM
    Hey folks! We want to know which tools you’re using with Prefect so that we can build better experiences and more streamlined integrations. Let us know what you’d like to see! https://forms.gle/FdpQd29KthNEFFMj7
    🛠️ 1
    🚀 3
    :upvote: 4
Powered by Linen
Title
d

Dylan

07/08/2020, 4:27 PM
Hey folks! We want to know which tools you’re using with Prefect so that we can build better experiences and more streamlined integrations. Let us know what you’d like to see! https://forms.gle/FdpQd29KthNEFFMj7
🛠️ 1
🚀 3
:upvote: 4
View count: 2