Has a Chinese physical AI start-up manipulated a global ranking to beat Nvidia?
Spirit AI’s Spirit v1.6 briefly dethroned Nvidia on the RoboArena robotics benchmark, but the model was then removed following a methodology overhaul.
Source excerpt
A Chinese physical AI start-up’s brief claim to global dominance in robotics has run into controversy, underscoring the intense US-China competition to develop next-generation artificial intelligence and the challenges of evaluating autonomous systems.
In June, Spirit AI, a Hangzhou, Zhejiang province-based firm founded in 2024, briefly overtook United States tech giant Nvidia to take the top spot on RoboArena – a global benchmark for physical AI – with its new Spirit v1.6 model, launched at the beginning of that month.
Just days later, the benchmark’s creators overhauled its methodology and removed the model from the official list, along with several other competitors, after finding evidence of “benchmark hacking”.
Among those dropped from the rankings was a model from Chinese start-up X Square Robot, which had ranked fourth.
Bold News stores the normalized extraction for evidence and analysis. This public wrapper shows a limited excerpt; use the original link for the publisher's complete presentation.