Let's Not Waste Time on Excessive Benchmarking

Originally published on the MongoDB Research Blog. There’s an arms race in database research. Every year, papers have more and more benchmarks. Researchers are spending more effort, writing more words, and making more charts about benchmarking. This has gone far past the point of diminishing returns: much of this work is wasted effort that takes time away from real discoveries. I’m not criticizing