2023.April »
We have successfully validated our new MLCommons CM reproducibility and automation language
during the 1st MLPerf inference community submission challenge.
We are honored that our technology and expertise has helped the community and companies automate, unify and reproduce more than 80% of recent MLPerf inference benchmark submissions
(and 98% of power results) with very diverse technology from Neural Magic, Qualcomm,
Krai, DELL, HPE, Lenovo, Hugging Face, Nvidia, AMD, Intel and Apple across diverse CPUs, GPUs and DSPs with PyTorch, ONNX, QAIC, TF/TFLite,
TVM and TensorRT using popular cloud providers (GCP, AWS, Azure) and individual servers and edge devices provided
by our volunteers and contributors.
Following this success, we are leading an open MLCommons taskforce on automation and reproducibility
to develop Collective Knowledge Playground
- a free, open-source and technology-agnostic platform to collaboratively benchmark and optimize AI, ML and other emerging applications
via reproducible challenges and tournaments.
See the Forbes article abour our technology and LinkedIn report.