A cautionary tale of using the right data set when measuring performance
We did some performance testing of our analytics crunching machinery during the holidays. Initially the results were very disappointing. We ran more tests, tweaked the code, ran even more tests and tried a few optimizations we’ve had up our sleeves for some time but hadn’t thought necessary yet. It helped, but still the numbers were less than what we had hoped for.