FIELD NOTES TOPIC
autoregressive language model
2 notes, newest first.
A Practical Investigation of Training-free Relaxed Speculative Decoding
The paper investigates training-free methods to speed up the sampling process of autoregressive Language Models (LLMs) by relaxing some strict guarantees in standard speculative decoding. The authors provide insights…
A Practical Investigation of Training-free Relaxed Speculative Decoding
The study investigates training-free methods of relaxed speculative decoding, which can speed up sampling from an autoregressive Language Model (LLM) by using a faster auxiliary model to draft tokens that are then…
