Airflow, for instance, have Sensors. Sensors wait for something external to happen.
k
Kevin Kho
05/06/2022, 2:29 AM
We don’t have sensors, but you could put the polling logic inside a task or a flow. Or you can make the event trigger the flow like i mentioned above
g
Gustavo Frederico
05/06/2022, 2:32 AM
I suppose that is not as good as exposing blocking tasks as REST endpoints. I’ll need to find another product. I see that Google Workflows have callbacks ( https://cloud.google.com/workflows/docs/creating-callback-endpoints ) . It’s unfortunate that Prefect doesn’t have this.
a
Anna Geller
05/06/2022, 10:15 AM
@Gustavo Frederico we have a detailed walkthrough about how you can approach it here
Prefect provides several methods of approaching that problem, even if we don't call it sensors. Happy to answer your questions about this orchestration pattern - what's the use case you tried to solve with sensors? Are you waiting for some files to arrive?