https://prefect.io logo
Title
t

Todd de Quincey

10/12/2022, 11:31 AM
Hi all, I’m curious if the Prefect team have any plans to introduce concepts similar to Dagster’s Software-defined-assets or Airflow’s Data-aware scheduling? I haven’t used either of the above, but conceptually, they are very attractive solutions (especially Dagster’s implementation).
1
1
👀 1
b

Bianca Hoch

10/12/2022, 3:45 PM
Hi Todd! We are working on a much more explicit (yet still flexible) way to track such metadata related to your workflows using Resources and Events, which will additionally allow you to track SLAs related to your data. For instance, you'll be able to define that a given Snowflake table should always be updated by 9 AM, and if such SLA is not satisfied, you can take automated actions and track related failures in a more robust way, allowing for faster detection and resolution.
💯 1
t

Todd de Quincey

10/12/2022, 3:47 PM
Any rough ETAs?
b

Bianca Hoch

10/12/2022, 5:59 PM
No firm ETAs yet, but these are high priority features that are actively being worked on for release in the near future. Definitely monitor our posts in the #announcements channel, where we share release notes for each new version of Prefect.
t

Todd de Quincey

10/14/2022, 7:03 AM
Thanks, @Bianca Hoch . Is there a project or any key tickets on GitHub that I can follow?
a

Anna Geller

10/14/2022, 10:03 AM
the #announcements channel is the easiest to follow, but if you would like to open a GitHub issue (without mentioning other tools, just focusing on what problems you want to solve, and what specific use cases you want to cover), that would be great