NVIDIA has officially launched its RTX 5880 Ada graphics card which is a cut-down variant of the RTX 6000 Ada with lower cores and lower power.
AMD Responds To NVIDIA’s H100 TensorRT-LLM Results, Once Again Shows MI300X GPU Leading With 30% Better Performance Using Optimized AI Software Stack
16.12.2023 - 14:42 / wccftech.com / Ai
AMD has responded to NVIDIA's H100 TensorRT-LLM figures with the MI300X once again leading in the AI benchmarks when running optimized software.
Two days ago, NVIDIA published new benchmarks of its Hopper H100 GPUs to showcase that their chips perform much better than what was showcased by AMD during its "Advancing AI" event. The red team compared its brand new Instinct MI300X GPU against the Hopper H100 chip which is over a year old now but remains the most popular choice in the AI industry. The benchmarks used by AMD were not using the optimized libraries such as TensorRT-LLM which provides a big boost to NVIDIA's AI chips.
Using TensorRT-LLM resulted in the Hopper H100 GPU gaining almost 50% performance uplift over AMD's Instinct MI300X GPU. Now, AMD is firing with all cylinders back at NVIDIA by showcasing how the MI300X still retains faster performance than the H100 even when the Hopper H100 is running its optimized software stack. According to AMD, the numbers published by NVIDIA:
So AMD has decided to go for a more fair comparison and with the latest figures, we see the Instinct MI300X running on vLLM offering 30% faster performance than the Hopper H100 running on TensorRT-LLM.
These results again show MI300X using FP16 is comparable to H100 with its best performance settings recommended by Nvidia even when using FP8 and TensorRT-LLM.
via AMD
Surely, these back-and-forth numbers are something that are kind of unexpected but given just how important AI has become for the likes of AMD, NVIDIA, and Intel, we can expect to see more such examples being shared in the future. Even Intel has recently stated that the whole industry is motivated to end NVIDIA's CUDA dominance in the industry. The fact as of right now is that NVIDIA has years of software expertise in the AI segment and while Instinct MI300X offers some beastly specs, it will soon be competing with an even faster Hopper solution in the form of H200 and the upcoming Blackwell B100 GPUs in 2024.
Intel is also ready to out its Gaudi 3 accelerators in 2024 which would further heat the AI space but in a way, this competition would make for a vibrant and more lively AI industry where each vendor continues to innovate and excel over the other, offering customers better capabilities and even faster performance. NVIDIA, despite having no competition for years, has continued to innovate in this segment, and with AMD and Intel ramping up their AI production and software, we can expect them to respond with even better hardware/software of their own.
The website gametalkz.com is an aggregator of news from open sources. The source is indicated at the beginning and at the end of the announcement. You can send a complaint on the news if you find it unreliable.
Top Authors
Popular Topics
wccftech.com
05.01.2024 / 05:33
AMD Pushing Back Radeon RX 7600 XT 16 GB GPU Launch In China To Avoid Clash With RX 6750 GRE Series
AMD is reportedly going to push back the launch of its upcoming Radeon RX 7600 XT 16 GB GPU in China as it tries to avoid a clash between its lineup.
wccftech.com
04.01.2024 / 07:45
The Galaxy A55 Leaks Once Again, Showcasing Samsung’s Odd Design Choice Called Key Island
Samsung's Galaxy A series has been selling really well for the longest time and for all the right reasons. I still remember the day I got the Galaxy A52s for my wife. It was only a few days after I received my Galaxy S22 Ultra's pre-order, and for a few minutes, I was confused about how similar these devices really are. With 2024 here, Samsung is working on the Galaxy A55, and today, we have some fresh renders showing the odd design choice the company is going for.
wccftech.com
24.12.2023 / 19:17
Leaked Mod Let’s You Enable AMD FSR 3 “Frame Generation” In Any FSR 2 Game, Supports Both AMD & NVIDIA GPUs
AMD FSR 3 "Frame Generation" technology can now be enabled in any FSR 2 game with a leaked mod and is supported across both NVIDIA & AMD GPUs.
pcgamer.com
22.12.2023 / 13:15
It's apparently down to AMD whether Nvidia releases its RTX 50-series GPUs in 2024 or not
A new video released by notorious rumour channel Moore's Law is Dead is digging into the potential RTX 5090 release date and quotes a source, claiming to be from inside Nvidia, stating that whether it launches its next-gen cards in 2024 will be largely down to how competitive AMD's RDNA 4 GPUs will be.
wccftech.com
21.12.2023 / 16:21
AMD Confirms Ryzen 7 5700 AM4 Desktop CPU Without Integrated GPU: Budget Friendly 8 Core, Up To 4.6 GHz
AMD has confirmed its upcoming Ryzen 7 5700 CPU which is based on the Cezanne APU die & lacks an integrated graphics solution.
pcgamer.com
20.12.2023 / 16:23
A new video encoding/decoding API can replace AMD and Nvidia's encoders on all platforms, truly one API to rule them all
The Khronos Group is a collaboration between nearly 200 companies, working together to produce various APIs for computing. Its most famous software, such as OpenGL, WebGL, and Vulkan, are all about graphics but for the past few years the consortium has been working on doing the same for video. It's just announced that Vulkan Video, a low-level API for handling video streams, now fully supports the hardware acceleration of the H.264 and H.265 standards for decoding and encoding.
wccftech.com
18.12.2023 / 11:44
AMD FSR 3 Frame Generation Can Be Enabled In Any Game Supporting NVIDIA DLSS 3 With a New Free Mod
AMD FSR 3 frame generation is setting out to be a game-changer, and from today it is possible to test out the technology in games that support NVIDIA DLSS 3.
gamesradar.com
18.12.2023 / 11:36
Netflix is remaking one of the most popular anime shows of all time with the studio behind Attack on Titan
Netflix has announced plans for a new One Piece anime series after the huge success of its live-action adaptation. Called The One Piece, the new adaptation of Eiichiro Oda’s beloved manga will be produced by WIT Studio, who are behind shows like SPY x FAMILY and Attack on Titan.
gameranx.com
16.12.2023 / 15:02
The Game Awards Saw Record Numbers Once Again
The Game Awards are always going to be something that is hotly debated for various reasons. But one thing that you must give them, even if you don’t want to, is that because of their platform and being streamed all over the place, they have done incredible numbers from when they started in 2014. They got 1.9 million viewers that first year, which isn’t too bad considering the period. But when you fast forward to 2023, you see just how big things have gotten, as the latest show had 118 million viewers worldwide. That’s a 15% increase from the previous year and proof that the show is still growing.
comingsoon.net
14.12.2023 / 21:07
Marvel’s Blade Game Concept Art Shows the Daywalker Staking Out a Vampire Nightclub
Sebastien Mitton. Artist and Co-Creative Director on Arkane Lyon’s video game, has shared some concept art of the daywalker’s jaunt to Paris.
pcgamer.com
14.12.2023 / 15:19
This excellent $1,030 RTX 4070 gaming laptop is what happens when AMD and Nvidia play nice
Acer Nitro 16 | RTX 4070 | AMD Ryzen 7 7735HS | 16-inch | 165Hz | 1600p | 16GB DDR5 | 512TB SSD | $1,299.99$1,029.99 at Best Buy (save $270)This is one of the cheapest RTX 4070 deals around at the moment and there's a lot to like here. The Ryzen CPU has a full eight cores, 16 threads, and that GPU is a high power version, with a 140W limit. The screen is fast and boasts a nice 16:10 ratio. However, the resolution is a bit high for the RTX 4070, so you might need to use upscaling more often than you'd like, and the amount of storage is pretty mean. But if you want to save as much as you can but still get a decent gaming laptop, this one's hard to beat.