Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hey Prefect Community! For those of you using `LOOP` signals in your Flows, would you be up to sharing what you use them for? We’re considering a change to the behavior and we’re interested in your thoughts /thread

Our original stated use case for creating `LOOP` signals was for web crawling

I plan to use `LOOP` signals to split my database extract task into batches. As of now, there is one extract task per table, which fetches the relevant table content in batches. There is a feeble amount of error handling inside the task, which I would be happy to delegate to prefect via `LOOP` signals.
I have a couple ideas on how to achieve this, but haven’t got my hands on it yet.

My plan is to use a loop signal to check the result of some convergence condition. I'm still not entirely sure that's an intended use, but it sounds like it should fit to me.