Speculative Decoding Articles

Page 1 of 1 (3 articles)

3/12/2026 • EN

Analysis of NVIDIA's Nemotron 3 Super 120B-A12B model focusing on its accuracy-throughput trade-off design and efficiency features.

Gqa Mamba 2 Mixture Of Experts Speculative Decoding Throughput Optimization

3/12/2026 • EN

Analysis of NVIDIA's Nemotron 3 Super 120B-A12B model focusing on accuracy-throughput trade-off with Mamba-2 and MoE layers.

large language models Mamba 2 Mixture Of Experts Speculative Decoding Throughput Optimization

4/2/2024 • EN

A technical guide on accelerating the Mixtral 8x7B LLM using speculative decoding (Medusa) and quantization (AWQ) for deployment on Amazon SageMaker.

Amazon Sagemaker LLM Inference Mixtral 8x7b Quantization Speculative Decoding

Select Language