Elijas/token-throttle

Multi-resource rate limiting for LLM APIs. Reserve tokens before you call, refund what you don't use, stay under the limit across workers.

21Stars on the repository
1Mods indexed here, across every type
5d agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

Elijas/token-throttle

Instructions file

Instructions for Elijas/token-throttle, covering token-throttle, releasing a new version, trigger a release, what the workflow does and version is tracked in two places.

21 5d ago A 894 tokens original Apache-2.0