Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

HI all,

Hope you all are good and safe, 

Can I have a realtime task in prefect ETL??

Thanks in advance :pray::grin:

image.png

Hey, it depends to some extent what this realtime task involves. Prefect &lt;= 1.0 currently has a lowest scheduling frequency of 1 minute so if this satisfies your realtime requirements, you can absolutely do that in Prefect.

If you need more info, <https://www.prefect.io/blog/you-no-longer-need-two-separate-systems-for-batch-processing-and-streaming/|this post> discusses real-time use cases in Orion and <https://annageller.com/blog/is-real-time-processing-worth-it-for-your-analytical-use-cases|this post> shows a hack so that you can get subminute execution in minutely batch jobs