Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi Team,
I need some guidance on designing an architecture in *Prefect Cloud* for the following use case:
I will be receiving daily files in *Azure Data Lake/File System*. Once the files are dropped, I would like to trigger an event that runs a job in *Prefect Orchestration* to process these files automatically.
Could you please advise on how this can be achieved? If there is any relevant documentation or best practices you could share, that would be greatly helpful.
Looking forward to your suggestions.
Thank you!

Hi Sushil! Here's a <https://prefect-community.slack.com/archives/CL09KU1K7/p1738046606250629|previous thread> that may help. It seems like the pattern you and Tobias want to implement sound similar.

As a side note, there is an <https://github.com/PrefectHQ/prefect-demos/tree/main/flows/aws/datalake|AWS Datalake> example that may help you mentally map out the different components you'll need (Prefect webhooks, automations, etc.). I understand you're using Azure, but the pattern can be translated between cloud solutions, with some adjustments of course.