Good morning from Belgium.
I'm in the process of trying to switch from Airflow to Prefect.
• In a certain Airflow DAG (process_emails) I have to continuously do some natural language processing on emails in a database.
• The DAG starts with an SQLSensor which queries a "select count() from emails" and next if there are rows in that count() statement starts other Bashrunoperators which do the natural language processing.
• At the end of that airflow DAG I just trigger with a dagrunoperator the same DAG (process_emails) again.
I couldn't find a way to do this easily in Prefect. What would be the best solution to do this same setup in Prefect?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.