Autoregressive Sampling Articles

Page 1 of 1 (1 article)

2/8/2023 • EN

Explains speculative sampling, a technique using a draft and target model to accelerate large language model text generation.

Autoregressive Sampling Language Models LLM Decoding Speculative Sampling time complexity

Select Language