One question that’s not related to automations. Is...
# pacc-may-31-2023
e
One question that’s not related to automations. Is is possible to use prefect to orquestrate flows that gets data in real time (streaming)?
e
Hey @Emiliano 👋 it can, but depending on your specific use case it may not be a good solution. If you want to run a deployment for each message, that’s probably not going to scale super well. However, if you have an event processor/subscriber that uses the flow decorator, that should work well enough. Better yet is to have a longer-lived flow that consumes messages and processes them as tasks. In the end it all comes down to scale. You can read more about our rate limits here.
1
e
Thanks, yeah, I was thinking something like getting data from an API and producing messages into a Kafka Cluster with minor processing.
The idea would be to have a 24/7 flow