FIELD NOTES TOPIC
practical investigation
1 note, newest first.
A Practical Investigation of Training-free Relaxed Speculative Decoding
The paper investigates training-free methods to speed up the sampling process of autoregressive Language Models (LLMs) by relaxing some strict guarantees in standard speculative decoding. The authors provide insights…
