Speculative Decoding
Methods for training draft models and verifying speculative decoding to accelerate language model inference.
1 papers
Where this stands
The written synthesis of this thread is for subscribers. Subscribe.
News without the noise
Methods for training draft models and verifying speculative decoding to accelerate language model inference.
1 papers
The written synthesis of this thread is for subscribers. Subscribe.