What is the recommendation for a long running flow...
# data-tricks-and-tips
d
What is the recommendation for a long running flow (30-90 minutes) which is simply polling an endpoint to check if it is finished yet? My thoughts were either • leave the flow running, maybe disable the warning that the flow is still running • Separate into a flow which initiates the refresh and then trigger flows to check and close periodically until it returns complete
d
A few points to consider 1. Where are you running this? (local/cloud) 2. How large of a resource is it running on? (memory/cpu) 3. Is the resource shared with other flow runs? 4. How often are you running it? If you're paying for an expensive resource in the cloud, idling for 30-90 minutes a day, you should go for option two. Likewise, if it's local or on a pre-defined instance, you should check if a lot of memory is being pre-allocated and it is interfering with other jobs. If this is true, again go for option 2. Besides that, it's really your discretion. Option 2 has a larger upfront development cost. Depending on your growth and resources, it may save you money and time down the line.