Grok

Groq, the latest artificial intelligence (AI) tool to come onto the scene, is taking social media by storm with its response speed and new technology that may dispense with the need for GPUs.
Groq became an overnight sensation after its public benchmark tests went viral on the social media platform X, revealing its computation and response speed to outperform&nbsp;<a href="https://cointelegraph.com/news/open-ai-valuation-reportedly-soars-to-80-billion-in-latest-deal">popular AI chatbot ChatGPT</a>. 
<blockquote class="twitter-tweet">
 The first public demo using Groq: a lightning-fast AI Answers Engine. It writes factual, cited answers with hundreds of words in less than a second. More than 3/4 of the time is spent searching, not generating! The LLM runs in a fraction of a second.<a href="https://t.co/dVUPyh3XGV">https://t.co/dVUPyh3XGV</a> <a href="https://t.co/mNV78XkoVB">https://t.co/mNV78XkoVB</a> <a href="https://t.co/QaDXixgSzp">pic.twitter.com/QaDXixgSzp</a>— Matt Shumer (@mattshumer_) <a href="https://twitter.com/mattshumer_/status/1759448999457693816?ref_src=twsrc%5Etfw">February 19, 2024</a>
</blockquote> 
This is due to the team behind Groq developing its own custom application-specific integrated circuit (ASIC) chip for large language models (LLMs), allowing it to generate roughly 500 tokens per second. In comparison, ChatGPT-3.5, the publicly available version of the model, can generate around 40 tokens per second.&nbsp;
Groq Inc, the developer of this model, claims to have created the first language processing unit (LPU) through which it runs its model, rather than the scarce and costly graphics processing units (GPUs) typically used to run AI models.
<blockquote class="twitter-tweet">
 Wow, that's a lot of tweets tonight! FAQs responses. • We're faster because we designed our chip &amp; systems • It's an LPU, Language Processing Unit (not a GPU) • We use open-source models, but we don't train them • We are increasing access capacity weekly, stay tuned <a href="https://t.co/nFlFXETKUP">pic.twitter.com/nFlFXETKUP</a>— Groq Inc (@GroqInc) <a href="https://twitter.com/GroqInc/status/1759483896322781584?ref_src=twsrc%5Etfw">February 19, 2024</a>
</blockquote> 
However, the company behind Groq is not new. It was founded in 2016, when it trademarked the name Groq. Last November, when Elon Musk’s own AI model, also called Grok — but spelled with a “k” — was gaining traction, the developers behind the original Groq published a blog <a href="https://wow.groq.com/hey-elon-its-time-to-cease-de-grok/#:~:text=Your%20chatbot%20is%20called%20Grok,Plus%2C%20we%20own%20the%20trademark." target="_blank" rel="noopener nofollow">post</a> calling out Musk for the choice of name:
<blockquote data-ct-non-breakable="true">
 “We can see why you might want to adopt our name. You like fast things (rockets, hyperloops, one-letter company names) and our product, the Groq LPU Inference Engine, is the fastest way to run large language models (LLMs) and other generative AI applications. However, we must ask you to please choose another name, and fast.” 
</blockquote>
Since Groq went viral on social media, neither Musk nor the Grok page on X has made any comment on the similarity between the names of the two tools.
Related: <a href="https://cointelegraph.com/news/microsoft-invest-3-billion-euros-ai-germany">Microsoft to invest 3 billion euros into AI development in Germany</a>
Nonetheless, many users on the platform have begun to make comparisons between the LPU model and other popular GPU-based models. 
One user who works in AI development called Groq a “game changer” for products that require low latency, which refers to the time it takes to process a request and garner a response. 
<blockquote class="twitter-tweet">
 side by side Groq vs. GPT-3.5, completely different user experience, a game changer for products that require low latency <a href="https://t.co/sADBrMKXqm">pic.twitter.com/sADBrMKXqm</a>— Dina Yerlan (@dina_yrl) <a href="https://twitter.com/dina_yrl/status/1759394933885280707?ref_src=twsrc%5Etfw">February 19, 2024</a>
</blockquote> 
Another user <a href="https://twitter.com/JayScambler/status/1759372542530261154?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1759372542530261154%7Ctwgr%5Ed45acf9aa02a021a80b6564f0a2c3cba2dfd0aca%7Ctwcon%5Es1_&amp;ref_url=https%3A%2F%2Fpublish.twitter.com%2F%3Furl%3Dhttps%3A%2F%2Ftwitter.com%2FJayScambler%2Fstatus%2F1759372542530261154" target="_blank" rel="noopener nofollow">posted</a> that Groq’s LPUs could offer a “massive improvement” to GPUs when it comes to servicing the needs of AI applications in the future and said it might also turn out to be a good alternative to the “high performing hardware” of the <a href="https://cointelegraph.com/news/arm-stock-surges-ai-chip-demand-ignites">in-demand A100 and H100 chips</a> produced by Nvidia.&nbsp;
This comes at a time in the industry when <a href="https://cointelegraph.com/news/meta-artemis-chip-ai-development-2024">major AI developers</a> are seeking to develop in-house chips so as not to rely on Nvidia’s models alone.&nbsp;
OpenAI is reportedly <a href="https://cointelegraph.com/news/openai-seeking-trillions-ai-chip-development">seeking trillions of dollars in funding</a> from governments and investors worldwide to develop its own chip to overcome problems with scaling its products. 
Magazine: <a href="https://cointelegraph.com/magazine/chatgpt-trigger-happy-nukes-sega-ai-tao-ai-eye/">ChatGPT trigger happy with nukes, SEGA’s 80s AI, TAO up 90%: AI Eye</a>

Groq AI model goes viral and rivals ChatGPT, challenges Elon Musk’s Grok

Cointelegraph

在 2024年2月19日發表的其他文章

Worldcoin Price Prediction: Bulls set their eyes on $10

Secure Big Crypto Wins: These 3 Cryptocurrencies Can Grow Your Crypto Portfolio To Millions

Uniswap Confirms v4 Update for Q3-2024

Cryptocurrency Market Analysis For February 19th: ETH, STX, WLD

Top crypto news highlights from Asia last week

Ripple CTO asks for ‘motive of XRP manipulation’ amidst allegations

訂閱免費電子報，每天收取加密貨幣最新動態！