FIELD NOTES TOPIC
training-free techniques
1 note, newest first.
A Practical Investigation of Training-free Relaxed Speculative Decoding
The study investigates training-free methods of relaxed speculative decoding, which can speed up sampling from an autoregressive Language Model (LLM) by using a faster auxiliary model to draft tokens that are then…
