Submit Blog

Sign up Sign in

Search Articles

Filter by Tag

Sort By

Popular Tags

Gpu Optimization Articles

Page 1 of 1 (2 articles)

Accelerating Large Language Models with Mixed-Precision Techniques

5/11/2023 • EN

Accelerating Large Language Models with Mixed-Precision Techniques

Exploring mixed-precision techniques to speed up large language model training and inference by up to 3x without losing accuracy.

Deep Learning Floating Point Precision Gpu Optimization large language models Mixed Precision Training

Sebastian Raschka

No, We Don't Have to Choose Batch Sizes As Powers Of 2

7/5/2022 • EN

No, We Don't Have to Choose Batch Sizes As Powers Of 2

Challenges the common practice of using powers of 2 for neural network batch sizes, examining the theory and practical benchmarks.

Batch Size Deep Learning Gpu Optimization memory alignment Neural Networks

Sebastian Raschka