# AI security digest for 2026-11-16

Canonical page: https://jonathanglass.cloud/ai-security/2026-11-16.html

Each item is the publisher's title, date, and excerpt.

## Amazon SageMaker AI now supports KV cache-aware routing for real-time inference endpoints

- Source: AWS What's New
- Date: 2026-11-16
- URL: https://aws.amazon.com/about-aws/whats-new/2026/11/sagemaker-kv-cache-routing/
- Publisher excerpt: Amazon SageMaker AI now supports KV cache-aware routing for real-time inference endpoints, enabling you to reduce time to first token for LLM workloads with long or repeated prompts. Serving engines such as vLLM store the computed key-value (KV) cache for repeated prompt starts such as shared system prompts, documents, and conversation history, to skip repeated work. Across several instances, a request that lands where the cache is missing recomputes it. Under high load... (excerpt trimmed)
