Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding
arXiv:2610.12939v1 Announce Type: new Abstract: Decoder hidden states from different layers of large language models (LLMs) often encode complementary information. However, existing speculative decoding methods typically rely on a small set of target-model layers chosen using fixed, position-based…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-12 04:00 · arXiv cs.CL
Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding