Hello guys, I have a data source for real-time. An...
# random
m
Hello guys, I have a data source for real-time. And comes 10k data every minute. I want to process these data with dag. Do you think prefect is a good choice?
a
Definitely! Check this blog post showing an example of a streaming use case in Prefect 2.0
upvote 1
m
What about the performance? Could i handle?
k
With 2.0 there is less spin up time. You could have a long running flow that keeps submitting tasks and it might be lightweight enough.