Distributed Training Articles

Page 1 of 1 (4 articles)

12/20/2024 • EN

A technical guide on optimizing and scaling the fine-tuning of open-source large language models using Hugging Face tools in 2025.

Distributed Training Hugging Face LLM Fine Tuning Peft Qlora

1/25/2022 • EN

A guide to accelerating multilingual BERT fine-tuning using Hugging Face Transformers with distributed training on Amazon SageMaker.

Amazon Sagemaker Distributed Training Hugging Face Transformers Multilingual Bert Pytorch

9/24/2021 • EN

Explores parallelism techniques and memory optimization strategies for training massive neural networks across multiple GPUs.

Distributed Training Gpu Memory large language models Model Parallelism Neural Networks

4/9/2021 • EN

A tutorial on using Hugging Face Transformers and Amazon SageMaker for distributed training of BART/T5 models on a text summarization task.

Amazon Sagemaker Bart Distributed Training T5

Select Language