Back in May of this year, we had a Call to Action where we talked about setting up a new microbenchmark framework. This framework was meant to allow for standardization between different tests to allow for consistency between tests in the short term. And with the long term goal being that this would allow for folks in the Chips and Cheese community to add to the test suite at a rate that the Chips and Cheese team could write on its own. This would also diversify the number of folks writing tests and allow Chester to become an Editor-in-Chief for the Chips and Cheese benchmark suite as it grows and expands.
To expand on the long term goal, we hope that there won’t just be tests that measure different parts of the silicon but also to have multiple tests that test the same thing just with different methodologies so that we can cross check and validate results.
Well today I am happy to announce that we have published our framework thanks to the incredible work from Nintonito and Lillith Beatrix!