Chip

Engine

<img width="1200" height="675" src="https://coingape.com/wp-content/uploads/2024/01/webstory-coingape-ai-e1709813855972.jpg" class="attachment-full size-full wp-post-image" alt="Cognizant Opens Advanced AI Labs After Microsoft Deal" decoding="async" style="float:right; margin:0 0 10px 10px;">
Cerebras Systems has introduced the Wafer Scale Engine 3 (WSE-3), marking a significant milestone in developing chips designed for <a href="https://coingape.com/ai-news-adobe-launches-generative-ai-feature-for-pdfs/?utm_source=cgtelegram">generative artificial intelligence</a> (AI). 
The announcement, made on March 13, 2024, positions the WSE-3 as the world’s largest semiconductor, aimed at advancing the capabilities of large language models with tens of trillions of parameters. This development comes on the heels of the intensifying race in the tech industry to create more powerful and efficient<a href="https://coingape.com/chip-maker-arms-ai-revenue-poses-questions-despite-higher-valuation/?utm_source=cgtelegram"> AI models</a>. 
<h2 id="doubling-down-on-performance">Doubling Down on Performance</h2> 
The WSE-3 chip improves the performance of its predecessor, WSE-2, two times without an increase in power consumption or cost. This accomplishment is celebrated as one of the strides made per Moore’s Law, which states that chip circuitry is expected to become twice as complex approximately every 18 months.&nbsp; 
Consequently, the WSE-3 chip, manufactured by TSMC, shows a decrease in the transistor size from 7 nanometers to 5 nanometers, which increases the transistor count to 4 trillion on a chip the size of almost an entire 12-inch semiconductor wafer. This increase results in a doubling of the computational power from 62.5 petaFLOPs to 125 petaFLOPs, thus improving the chip’s efficiency in training AI models. 
<h2 id="advantages-over-competitors">Advantages Over Competitors</h2> 
Cerebras’ WSE-3 substantially surpasses the industry standard, <a rel="nofollow" href="https://t.me/coingape/30045">Nvidia’s H100 GPU</a>, in size, memory, and computational capabilities. Featuring 52 times more cores, 800 times larger on-chip memory, and significant improvements in memory bandwidth and fabric bandwidth, the WSE-3 delivers the largest performance improvements ever targeted at AI computations.&nbsp; 
These improvements allow the training of substantial neural networks, including a hypothetical 24 trillion parameter model on a single CS-3 computer system, demonstrating the vast potential of WSE-3 in speeding up AI model development. 
<h2 id="innovations-in-ai-training-and-inference">Innovations in AI Training and Inference</h2> 
The release of the WSE-3 is associated with improvements in the training and inference phases of AI model development. Cerebras emphasizes the chip’s capability to simplify the programming process since it requires much fewer lines of code than GPUs for modeling GPT-3. The simplicity with which 2,048 machines could be clustered and trained makes this design able to train large language models 30 times faster than the current leading machines. 
Cerebras has additionally revealed a tie-up with Qualcomm to improve the inference part, which is about predicting based on the AI model trained. Through methods like sparsity and speculative decoding, the partnership seeks to reduce the computational costs and energy usage of generative AI models to the bare minimum. 
As a result, this collaboration signifies a strategic move towards optimizing the efficiency of AI applications, from training to real-world deployment. 
Read Also: <a href="https://coingape.com/charles-hoskinson-eyes-lightweight-consensus-for-cardano/?utm_source=cgtelegram">Charles Hoskinson Eyes Lightweight Consensus for Cardano&nbsp;</a> 
The post <a href="https://coingape.com/cerebras-systems-announces-launch-of-wse-3-ai-chip/">Cerebras Systems Announces Launch of WSE-3 AI Chip</a> appeared first on <a href="https://coingape.com">CoinGape</a>.

Cerebras Systems Announces Launch of WSE-3 AI Chip

목차

Coingape News Media

2024년 3월 13일에 게재된 다른 기사

Introducing PolitiFi: CoinGecko Adds New Category After $TRUMP and $BIDEN Explode, and Traders Ba...

Radiant Capital (RDNT) Hits Nine-Month High: Will Bullish Rally Continue?

Bitcoin Hits New Highs as Wallet Numbers Surge

Pepecoin Emerges as Top Performer Among Meme Coins Amidst a Relaxing Rally for DOGE and SHIB

Shiba Inu Loses Top 10 Crypto Ranking to Avalanche (AVAX)

Bull Run Surge: Chainlink (LINK) & Polkadot (DOT) Investors Rush to Secure Kelexo (KLXO) Presale ...

무료 뉴스레터에 가입하여 매일 최신 암호화폐 소식을 받아보세요!