FIELD NOTES TOPIC
position-independent kv reuse
1 note, newest first.
HijackKV: New Threat in Position-Independent KV Cache Reuse
Researchers have identified a new threat called KV Cache Hijacking in position-independent KV cache reuse, which is used to reduce inference latency in large language models. This threat allows an attacker to silently…
