HI all,
I have the following method thats defined as a Task.
@task(
#caching parameters here, result stored on the cloud , with concurrency tag limit set to 3
)
def get_response(url):
# send request to a highly rate limited API
return response
Is there some way so that if its a cache hit, the function is not limited by the concurrency tag and if a cache miss occurs, the request is rate limited via the concurrency tag?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.