Simple Multi-Resource Rate Limiting That Saves Unused Tokens. Rate limit API requests across different resources and workers without wasting your quota. Reserve tokens upfront, get refunds for what you don't use, and avoid over-limiting.
ai rate-limiting tokens openai rate-limit rate-limiter throttler ai-agents throttle-requests rate-limit-redis ai-engineering openai-api llm llms llm-token
-
Updated
Apr 30, 2025 - Python