A. Jesse Jiryu Davis • 12/21/2025

YCSB Is Obsolete, We Need New Benchmarks

The article critiques standard database benchmarks like YCSB and TPC for using a closed-loop model, where a fixed number of clients wait for a response before making a new request. It argues real-world cloud systems are open-loop, with requests arriving independently, leading to queueing under load. The author uses a coffee shop analogy and provides code examples to illustrate the difference, calling for new benchmarks that reflect modern, open-system realities.

0 comments

#benchmarking #Database Performance #Open Loop