Grok

Elon Musk

<h2 id="key-points">Key Points</h2> 
<ul> 
 <li>Elon Musk shared a message on his X account, saying that the second variant of his AI chatbot, Grok-1.5 become available next week.</li> 
 <li>Grok 2 should exceed current AI on all metrics and is now in training, according to Musk.</li> 
</ul> 
<p><a href="https://crypto.ro/en/news/elon-musk-showcases-abilities-of-first-patient-with-neuralink-brain-chip-implant-telepathy/">Elon Musk</a> has just announced that Grok 2, the second variant of his first AI chatbot called Grok-1.5, is currently in the works and will become available next week.</p> 
<p>He also explained that Grok 2 should exceed current AI on all metrics.</p> 
<p>https://twitter.com/elonmusk/status/1773655245769330757</p> 
<p>According to the <a href="https://x.ai/blog/grok-1.5" rel="nofollow" target="_blank">official announcement,</a> Grok-1.5 comes with improved reasoning capabilities and a context length of 128,000 tokens.</p> 
<h2 id="introducing-grok-1-5-capabilities-and-reasoning">Introducing Grok-1.5 – capabilities and reasoning</h2> 
<p>Grok-1.5 is the latest model capable of advanced reasoning and understanding long context. It will be available on the X platform to early testers and existing Grok users in the coming days.</p> 
<p>The official notes recently shared the model weights and network architecture of Grok-1, which provided a glimpse into the progress made by xAI until November last year.</p> 
<p>However, Musk’s team has since made further improvements in their latest model, Grok-1.5, which now has enhanced reasoning and problem-solving capabilities.</p> 
<p>The official notes reveal that one of the most important enhanced that Grok-1.5 will see involves coding performance and math-related tasks:</p> 
<blockquote>
 <p>“One of the most notable improvements in Grok-1.5 is its performance in coding and math-related tasks. In our tests, Grok-1.5 achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, two math benchmarks covering a wide range of grade school to high school competition problems. Additionally, it scored 74.1% on the HumanEval benchmark, which evaluates code generation and problem-solving abilities.”</p>
</blockquote> 
<h2 id="long-context-understanding">Long-context understanding</h2> 
<p>Another important feature that Grok-1.5 will get is the capability to process long context of up to 128k tokens within the context window.</p> 
<p>The AI-powered language model will have an increased memory capacity of up to 16 times the previous context length. This allows it to utilize information from substantially longer documents.</p> 
<p>As its context window expands, it can handle longer and more complex prompts while still maintaining its instruction-following capability. In the Needle In A Haystack (NIAH) evaluation, Grok-1.5 demonstrated powerful retrieval capabilities for embedded text within contexts of up to 128K tokens in length, achieving perfect retrieval results.</p> 
<h2 id="grok-1-5-infra">Grok-1.5 Infra</h2> 
<p>Grok-1.5 has been developed using a specialized distributed training framework that is based on JAX, Rust, and Kubernetes. With this training stack, the team can easily prototype new ideas and train complex models on a large scale.</p> 
<p>One of the biggest challenges of training large language models (LLMs) on a compute cluster is ensuring maximum reliability and uptime of the training job.</p> 
<p>However, the custom training orchestrator is designed to automatically detect and remove problematic nodes from the training job, thus ensuring the job runs smoothly without any interruptions.</p> 
<p>Official notes also reveal that the team optimized checkpointing, data loading, and training job restarts in order to minimize downtime in case of failure.</p> 
<p>Musk’s company, xAI, has launched an <a href="https://crypto.ro/en/news/grok-musks-new-ai-chatbot-claims-to-outperform-rivals/">AI chatbot named Grok</a> in 2023. <a href="https://crypto.ro/en/news/elon-musk-launches-ai-startup-xai-to-understand-the-true-nature-of-the-universe/">xAI was launched in July</a> 2023 with a mission to advance the collective understanding of the universe through AI.</p>

Elon Musk’s Grok-1.5 AI Becomes Available Next Week

Table of Contents

crypto.ro global

Other articles published on Mar 29, 2024

The Biggest Crypto Predictions for April 2024

Trending Cryptocurrency Tokens on Avalanche Chain Today – Zookeeper, Osaka Protocol, Baklava

BTC, ETH navigate market shifts as KangaMoon enters the spotlight

Bitcoin bulls await $15 billion options expiry: Is $80K inevitable?

Fluctuations Continue in Cryptocurrency Markets as BNB Coin Aims for Gains

BEFE Coin’s Spectacular 45% Surge Sends Shockwaves Across Crypto Market

Join our free newsletter for daily crypto updates!