Floating Point Precision Articles

Page 1 of 1 (3 articles)

1/6/2026 • EN

Analyzes the rational approximation of log2(3) and log2(5) using continued fractions, comparing their approximation errors.

Continued Fractions Floating Point Precision Irrationality Measure Logarithm Approximation mathematics

5/11/2023 • EN

Exploring mixed-precision techniques to speed up large language model training and inference by up to 3x without losing accuracy.

Deep Learning Floating Point Precision Gpu Optimization large language models Mixed Precision Training

5/11/2023 • EN

Explores how mixed-precision training techniques can speed up large language model training and inference by up to 3x, reducing memory use.

Deep Learning Floating Point Precision Gpu Optimization large language models Mixed Precision Training

Select Language