Sparse Moe Articles

Page 1 of 1 (4 articles)

7/26/2026 • EN

A Few Notable Open-Weight Models This Week

Overview of recent notable open-weight AI model releases, including Nanbeige, Laguna, Motif, Solar Open, and Antares.

AI Ecosystem Model Architecture Open Weight Models Sparse Moe Transformer Architecture

Sebastian Raschka

7/26/2026 • EN

A Few Notable Open-Weight Models This Week

Overview of recent notable open-weight AI models including Nanbeige, Laguna, Motif, Solar, and Antares with architectural details.

AI Ecosystem Model Architecture Open Weight Models Sparse Moe Transformer Architecture

Sebastian Raschka

5/27/2026 • EN

MiniMax M2 and Production-Oriented Model Design

Analysis of MiniMax M2 LLM technical report: sparse MoE, full attention, agent training, and production-oriented model design.

Agent Training Long Context Attention Minimax M2 Production Model Design Sparse Moe

Sebastian Raschka

5/27/2026 • EN

MiniMax M2 and Production-Oriented Model Design

Analysis of MiniMax M2 LLM technical report highlighting production-oriented design choices like full attention, fine-grained MoE, and agent training pipelines.

Agent Training Attention Variants Coding Agents llm Sparse Moe

Sebastian Raschka

Sparse Moe Articles

A Few Notable Open-Weight Models This Week

A Few Notable Open-Weight Models This Week

MiniMax M2 and Production-Oriented Model Design

MiniMax M2 and Production-Oriented Model Design

Select Language

We use cookies