Digital sunrise is turning into daybreak, and beaming across the rooftops of dawn shining through is NVIDIA — a leader in AI and machine learning (ML). Latest MLPerf 4.0 training results on 48-core CPUs with 40GB of memory show a record-breaking AI performance, extending the benchmark gap and firmly capturing the industry’s leading position in NVIDIA.
You really don’t want to miss MLPerf 4.0, a benchmark series with enormously important recent results that show some staggering increases in performance for training artificial intelligence in computers, with 17 different organisations contributing these results. There are 205 results overall in the list of tests, which are also introducing several new benchmarks, including Stable Diffusion-v2 for image generation, and Large Language Model (LLM) training for generating GPT-3. There’s even a new LoRA benchmark that fine-tunes the Llama 2 70B language model, which shows some of the most efficient document summarisation possible.
The most obvious takeaway from the MLPerf 4.0 results is just how much faster was every benchmark six months ago than it is now. NVIDIA was the fastest vendor on every single test, with Stable Diffusion training 1.8x faster than six months ago and GPT-3 training 1.2x faster. A necessary truth is that the path to AI innovation is not just paved with fancy hardware, but with fancy software and fancy networking too, which is exactly the kind of stuff that NVIDIA is good at.
This approach goes well beyond modernising the hardware: it involves harnessing better algorithms, scaling techniques and software innovations, to drive improvements in performance. This strategy was successfully used in NVIDIA’s H100 Hopper architecture, which, through full stack optimisation and multiple other techniques, continues to deliver exceptional value.
But most impressive is NVIDIA’s record-setting performance in nine different workloads using a single core hardware platform from June 2023. This feat goes beyond innovation in hardware, as it further amplifies the power of NVIDIA’s software stack to consistently tap into both the hardware and algorithms to wring out the most performance from a single core hardware platform.
The rapid advances in performance on these MLPerf 4.0 benchmarks are significant far beyond the numbers. For companies using AI technology, this means that we can get better ROI with the same piece of hardware for longer. NVIDIA’s advantages show the company’s ability to continuously add value over time, investments in technology that measurably pay off years into the future.
In this light, the innovation highlighted in the most recent set of benchmarks, MLPerf 4.0, announced by NVIDIA in March, illustrates the company’s aspirations to point the way forward for both AI and machine learning. An organisation’s aptitude for developing applied machine learning is increasingly a determinant of its competitive edge. Regardless of the application, be it generative AI that’s more lifelike or even larger and more intelligent large language models, the criteria for the adopting organisation are the same: performance and efficiency, which is to say return on investment.
Today, it is a computing giant, never far from the headlines as the company is recognised as a leader in graphics processing units (GPUs) for gaming and professional markets. But what is less widely appreciated is that behind the hype of machine learning lies the relentless march of technology making leaps and bounds with each new generation of GPUs, bringing it closer to generalised artificial intelligence. NVIDIA’s singular focus on improving performance and bringing new standards to the art and craft of ML training has the added benefit of equipping organisations that weren’t even aware of these capabilities to reach entirely new levels of efficiency and innovation.
And, as we move toward a future where the potentials of AI are endless, efforts such as MLPerf 4.0 remain essential – both in stimulating technological progress and in shedding light upon it. Moving forward, the Omniverse should continue to be boosted by NVIDIA’s visionary hardware and software developments, as the AI revolution surges towards a new digital age.
More Info:
© 2024 UC Technology Inc . All Rights Reserved.