KV Cache Persistent Memory Demo

In this video, HPE demonstrates how HPE Alletra Storage MP X10000 accelerates AI inference by extending KV cache beyond GPU memory, enabling up to 20x faster time to first token and significantly higher throughput for agentic AI workloads.
https://www.hpe.com