cover
AI
AI gateway circuit breaker pattern for LLM fallback routing
Deploy a state-aware AI gateway circuit breaker that routes around degraded LLM providers in under 50ms with zero…
// tag archive
ai-gateway
2 articles
Backend Dev
Redis rate limiting for AI gateway resilience
Build a resilient AI gateway using Redis rate limiting, Lua scripts, and fallback routing to handle 50k req/sec…