Add rate limiting with retry logic to flashlight API queries

[Copilot]

Flashlight API queries lacked rate limiting and retry capabilities, risking throttling errors during high-volume usage.

Implementation

Rate limiter utility (src/helpers/rateLimiter.ts):

• Module-scoped PQueue instances with configurable concurrency and interval limits
• retryOnRateLimit(): Exponential backoff retry wrapper (5 attempts max, 1s → 10s delays)
• checkRateLimit(): Pre-execution queue capacity validation (prevents unbounded growth at 10x concurrency)

Query updates:

• Added rate limiter constants to all flashlight queries (uuid.ts, username.ts, sessions.ts, history.ts, wrapped.ts)
• Configured at 10 requests/second per endpoint
• Wrapped query functions with automatic retry logic

Example

// Module-scoped rate limiter
const uuidRateLimiter = createRateLimiter({
    concurrency: 1,
    interval: 1000,
    intervalCap: 10,
});

// Query wrapped with retry logic
queryFn: async () => {
    return retryOnRateLimit(
        async () => {
            const response = await fetch(/* ... */);
            // ... handle response
        },
        uuidRateLimiter,
    );
}

Rate limit errors automatically retry with exponential backoff rather than failing immediately.

Original prompt

Add ratelimiting to all the queries to flashlight in the queries folder. Above each query definition, add a module scopes constant containing the rate limiter. In the query ensure the limiter has a limit left, and if not throw an error, then add a retry function that retries up to 5 times on ratelimiting errors. Use p-queue and throwontimeout

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

[cloudflare-workers-and-pages]

Deploying rainbow with    Cloudflare Pages

Latest commit:	9e89868
Status:	✅  Deploy successful!
Preview URL:	https://7efdc746.rainbow-ctx.pages.dev
Branch Preview URL:	https://copilot-add-ratelimiting-to.rainbow-ctx.pages.dev

View logs