MUO on MSN

AI benchmark numbers are meaningless — here's what to look for instead

Numbers go up, AI gets better.
SpaceNews

Benchmark wins $4.9 million award for ASCENT propulsion systems

SAN FRANCISCO – The Air Force Research Laboratory awarded Benchmark Space Systems $4.9 million to develop propulsion systems for ASCENT monopropellant. The two-year award announced Sept. 5 covers ...
SpaceRef

Benchmark Space Systems Fires Up Metal Plasma and Bi-Prop Thruster Production, Realigns Senior Executive Team to Deliver on Intensifying Hybrid Propulsion System Demand

Laser focused on delivering mobility without compromise, Benchmark Space Systems today announced it has signed contracts for nearly two dozen new electric metal plasma thrusters (MPTs), with some set ...
Business Wire

New MLPerf Inference v4.1 Benchmark Results Highlight Rapid Hardware and Software Innovations in Generative AI Systems

SAN FRANCISCO--(BUSINESS WIRE)--Today, MLCommons® announced new results for its industry-standard MLPerf® Inference v4.1 benchmark suite, which delivers machine learning (ML) system performance ...
The Next Web

OpenAI’s GPT-5.4 sets new records on professional benchmarks

OpenAI released GPT-5.4 today with native computer use, a 1M-token context window, and new professional benchmarks. Find what ...
SpaceRef

Benchmark Space Systems Announces First “Autopilot” for Satellite Maneuvers

NASA rendering of a satellite propulsion system. Image credit: NASA. Burlington, Vermont-based Benchmark Space Systems made a pair of key announcements on August 9th. The first announcement was that ...
The Next PlatformOpinion

We Need A Proper AI Inference Benchmark Test

Companies are spending enormous sums of money on AI systems, and we are now at a point where there are credible alternatives ...