Transformer Articles

Page 1 of 1 (4 articles)

9/6/2025 • EN

A hands-on guide to understanding and implementing the Qwen3 large language model architecture from scratch using pure PyTorch.

llm Mixture Of Experts Pytorch Qwen3 Transformer

5/12/2024 • EN

A technical review of April 2024's major open LLM releases (Mixtral, Llama 3, Phi-3, OpenELM) and a comparison of DPO vs PPO for LLM alignment.

Dpo llm Ppo Reinforcement Learning Transformer

2/23/2023 • EN

Learn techniques to speed up PyTorch model training by 8x using PyTorch Lightning, maintaining accuracy while reducing training time.

Model Training performance optimization Pytorch Pytorch Lightning Transformer

2/9/2023 • EN

A technical guide to coding the self-attention mechanism from scratch, as used in transformers and large language models.

Natural Language Processing Neural Networks Python Self Attention Transformer

Select Language