Upgrade SGLang to v0.5.22: Long Prompts Leaked Other Users' Data
Cloudflare's GLM-5.3 Workers AI incident: 155 responses leaked other users' data because SGLang's KV pool (681,280 tokens) was smaller than context. Fixed in v0.5.22.
2 posts
Cloudflare's GLM-5.3 Workers AI incident: 155 responses leaked other users' data because SGLang's KV pool (681,280 tokens) was smaller than context. Fixed in v0.5.22.
Z.ai open-sourced GLM-5.3 (753B MoE). 88.2 on Terminal Bench 2.1 and 28.3 on TB 3.0, serving via vLLM/SGLang with a reasoning_effort flag and 23 existing quantizations.