Loup
10/12/2024, 9:47 AMConcurrency
:Loup
10/12/2024, 9:48 AMConcurrency Limit
, Active Slots
are made for ?Nate
10/12/2024, 2:59 PMLoup
10/13/2024, 9:47 AMLoup
10/13/2024, 9:47 AMSlot Decay per Second
its gonna be slower right ?Loup
10/13/2024, 9:50 AMTo configure slot decay, set the slot_decay_per_second parameter when creating or updating a concurrency limit. This value determines how quickly slots refresh:
A higher value (for example, 5.0) means slots refresh quickly. Tasks can run more frequently, but with short pauses between them.
A lower value (for example, 0.1) means slots refresh slowly. Tasks run less frequently, with longer pauses between them.
Mhh Im kinda lost here ๐ญNate
10/13/2024, 5:14 PMBecause I dont care how many concurrency there is, just wanna slow down when rate limit is reached ๐then Im not sure you need to worry about slot decay at all - just keep it at zero and use the
rate_limit
ctx manager and it sounds like what you describe is the default behaviorLoup
10/14/2024, 9:38 AMJainish Savalia
12/06/2024, 8:27 AM