David Mytton 2/14/2025

How useful is GPU manufacturer TDP for estimating AI workload energy?

Read Original

This article critiques the common practice of using GPU Thermal Design Power (TDP) to estimate energy use for AI workloads. It explains why TDP is a poor proxy for actual power draw, presents real-world measurement data from benchmarks like MLPerf, and discusses how workload configuration significantly impacts energy consumption.

How useful is GPU manufacturer TDP for estimating AI workload energy?

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser