AI
AI gateway rate limiting: token bucket vs sliding window
Implement dual-dimensional rate limiting for AI gateways to handle TPM and RPM limits while preventing 429 errors during…
// tag archive
rate-limiting
5 articles
Backend Dev
Redis rate limiting for AI gateway resilience
Build a resilient AI gateway using Redis rate limiting, Lua scripts, and fallback routing to handle 50k req/sec…
System Desgin
Designing a Rate Limiter: 5 Patterns (2026 Guide)
A mis-configured limiter throttled healthy traffic, showing the need for atomic cleanup and low latency. See a Go…
System Desgin
Rate Limiter Design: 5 Patterns That Scale (2026)
A 4k RPS 429 surge exposed a broken in‑memory limiter; I rebuilt a rate limiter with Token Bucket and…
Node Js
BullMQ Retries, Rate Limiting & Delayed Tasks (2024 Guide)
Configure BullMQ with exponential backoff, jitter, rate limiting and delayed jobs so Node.js workers stay resilient, avoid thundering‑herd…