[ad_1]
On the “Information Middle and AI Know-how Premiere” on Tuesday, American semiconductor firm Superior Micro Units (AMD) unveiled its CPU and AI accelerator options because it seeks to compete with Nvidia within the chip-making market.
This comes at a time when AI firms are dealing with restricted entry to GPUs amidst the generative AI frenzy. Through the occasion, AMD made a collection of bulletins showcasing its AI Platform technique.
The corporate revealed new particulars of the AMD Intuition™ MI300 Collection accelerator household, together with the introduction of the AMD Intuition MI300X accelerator, which it claims is “the world’s most superior accelerator for generative AI.” The MI300 might probably rival Nvidia’s H100 chipset and even the GH200 Grace Hopper Superchip which is presently in manufacturing.
AMD Intuition MI300X vs Nvidia H100
At present, Nvidia’s dominates the GPU market with over 80% market share. The H100 is the quickest GPU for AI, HPC, and knowledge analytics workload:
The H100 is the primary GPU to function Nvidia’s fourth-generation Tensor Cores, that are designed to speed up AI coaching and inference. The H100’s Tensor Cores are as much as 7x sooner than the earlier technology for GPT-3 fashions.The H100 additionally options Nvidia’s new Hopper Reminiscence, which is a high-bandwidth, low-latency reminiscence system designed to speed up data-intensive workloads. Hopper Reminiscence is as much as 2x sooner than the earlier technology, making it the quickest GPU reminiscence system accessible.The H100 is the primary GPU to assist Nvidia’s new Grace CPU structure, which is designed to speed up exascale computing. The H100 and Grace CPU can work collectively to ship as much as 10x the efficiency of previous-generation techniques.The Nvidia H100 GPU has a reminiscence capability of 188GB, the best reminiscence capability of any GPU presently in the marketplace.
When it comes to pricing, Nvidia’s chipset usually carries a price ticket of roughly $10,000. Nevertheless, the chipset has been listed on eBay for as excessive as $40,000. Then again, AMD has but to place a price ticket on its new chips.
With the upcoming launch of AMD’s Intuition MI300X deliberate for later this 12 months, the brand new reminiscence accelerator might probably topple Nvidia’s H100 chipset’s dominance available in the market. In line with a Reuters report, AWS’ cloud unit is contemplating utilizing AMD’s new chips.
The MI300X boasts promising specs, corresponding to:
192 GB of HBM3 reminiscence to supply the computation and reminiscence effectivity wanted for giant language mannequin coaching and inference for generative AI workloads.The big reminiscence can accommodate massive language fashions corresponding to Falcon-40, a 40B parameter mannequin on a single, MI300X accelerator
“AI is the defining know-how shaping the subsequent technology of computing and the biggest strategic development alternative for AMD. We’re laser targeted on accelerating the deployment of AMD AI platforms at scale within the knowledge heart, led by the launch of our Intuition MI300 accelerators deliberate for later this 12 months and the rising ecosystem of enterprise-ready AI software program optimized for our {hardware},” AMD Chair and CEO Dr. Lisa Su mentioned in an announcement.
AMD’s AI software program platform
Alongside the disclosing of the brand new chipset, AMD additionally offered the ROCm software program ecosystem – a group of software program instruments and assets – designed for knowledge heart accelerators. The corporate highlighted collaborations with business leaders who joined AMD on stage for dialogue.
PyTorch, a well-liked AI framework, partnered with AMD and the PyTorch Basis to combine the ROCm software program stack. This integration ensures that PyTorch 2.0 is straight away supported on all AMD Intuition accelerators, permitting builders to make use of a variety of AI fashions powered by PyTorch on AMD accelerators.
Hugging Face, an open platform for AI builders, additionally introduced plans to optimize hundreds of their fashions particularly for AMD platforms.
In Might, AMD reported income of $5.4 billion for the primary quarter of 2023, down 9% year-over-year. Following its announcement of its AI technique, its inventory is up greater than 2% for the reason that market opened at present, presently buying and selling at $127 as of penning this. Barclays, Jefferies and Wells Fargo have raised AMD’s goal worth to $140-$150.
Learn extra:
[ad_2]
Source link
