#speculative-decoding

Speculative decoding threshold tuning for code generation

Configure speculative decoding acceptance thresholds to optimize code generation throughput and prevent costly inference latency regressions.