Grok

Elon Musk

California Attorney General Rob Bonta sent a cease-and-desist letter to Elon Musk’s xAI, demanding that the business immediately stop producing and disseminating offensive deepfake images produced by its Grok chatbot.&nbsp; 
California AG <a href="https://oag.ca.gov/system/files/attachments/press-docs/01-16-26%20Letter%20to%20xAI%20and%20X.pdf" rel="nofollow noopener" target="_blank">released</a> the cease-and-desist letter on Friday in response to allegations that Grok was being used to create unlawful content involving kids and nonconsensual adult photographs, which prompted a California state inquiry. Bonta argued that it is illegal to create, distribute, publish, and display CSAM. 
<h3 id="span-style-font-weight-400-california-ag-targets-xai-over-alleged-misuse-of-grok-span">California AG targets xAI over alleged misuse of Grok</h3> 
Earlier this week, the California attorney general’s office <a href="https://oag.ca.gov/news/press-releases/attorney-general-bonta-launches-investigation-xai-grok-over-undressed-sexual-ai" rel="nofollow noopener" target="_blank">declared</a> that it was looking into xAI due to allegations that the startup’s chatbot, Grok, was being used to produce nonconsensual, inappropriate pictures of women and children. In response, the government sent the corporation a cease-and-desist letter. 
<blockquote>
 “Today, I sent xAI a cease and desist letter, demanding the company immediately stop the creation and distribution of deepfakes, nonconsensual, intimate images, and illegal child abuse material. The creation of this material is illegal. I fully expect xAI to comply immediately. California has zero tolerance for illegal child abuse imagery.” 
 –Rob Bonta, California Attorney General.
</blockquote> 
The AG’s office further asserted that xAI seems to be “facilitating the large-scale production” of nonconsensual, inappropriate photos, which are then “used to harass women and girls across the internet.” According to the AG’s office, one research found that over half of the 20,000 photos produced by xAI between Christmas and New Year’s showed persons wearing very little clothing, some of whom looked like children. 
Rob Bonta claimed in the <a href="https://oag.ca.gov/news/press-releases/attorney-general-bonta-sends-cease-and-desist-letter-xai-demands-it-halt-illegal" rel="nofollow noopener" target="_blank">announcement</a> that the corporate practices violated California civil laws, including California Civil Code section 1708.86, California Penal Code sections 311 et seq. and 647(j)(4), and California Business &amp; Professions Code section 17200.&nbsp; 
The California Department of Justice anticipates xAI will affirm its efforts to address these issues and take immediate action to resolve them over the next five days. 
However, X’s safety account had previously condemned this type of user behavior. It <a href="https://x.com/Safety/status/2007648212421587223?s=20" rel="nofollow">clarified</a> on January 4 that it takes action against illicit content on X, such as CSAM, by deleting it, suspending accounts indefinitely, and collaborating with law authorities and municipal governments as needed. 
Notably, on January 4, Elon Musk warned that anyone using or prompting <a href="https://www.cryptopolitan.com/musks-x-could-be-banned-in-britain/">Grok</a> to create illegal content will face the same consequences as if they uploaded it. 
<h3 id="span-style-font-weight-400-attorneys-general-intensify-pressure-on-ai-firms-over-child-safety-span">Attorneys general intensify pressure on AI firms over child safety</h3> 
An unsettling increase in non-consensual adult content has resulted from the development of free generative AI tools. This issue has been plaguing several platforms, not only X. 
For instance, Attorney General Bonta and Attorney General Jennings of Delaware <a href="https://oag.ca.gov/news/press-releases/attorney-general-bonta-openai-harm-children-will-not-be-tolerated" rel="nofollow noopener" target="_blank">met</a> with OpenAI in September of last year to voice their serious concerns about the growing number of reports about how OpenAI’s products interacted with youth. 
In August of the same year, AG Bonta, along with 44 other Attorney Generals, sent a letter to 12 leading AI companies following reports of inappropriate interactions between AI chatbots and children. The letters were sent to Anthropic, Apple, Chai AI, Google, Luka Inc., <a href="https://www.cryptopolitan.com/meta-slashes-1000-vr-jobs/">Meta</a>, Microsoft, Nomi AI, OpenAI, Perplexity AI, Replika, and xAI. 
AG Bonta and the 44 Attorney Generals informed the companies in the letter that states across the country were closely monitoring how companies develop their AI safety policies. They also emphasized that these businesses have a legal duty to children as consumers since they profit from children using their products.&nbsp; 
In 2023, AG Bonta joined a bipartisan coalition of 54 states and territories in sending a letter to congressional leaders advocating for the establishment of an expert committee to investigate the potential use of AI to exploit children through CSAM.&nbsp; 
The coalition <a href="https://www.justice.gov/d9/2023-06/child_sexual_abuse_material_2.pdf" rel="nofollow noopener" target="_blank">requested</a> that the expert commission suggest laws to shield kids from such mistreatment. “The production of CSAM creates a permanent record of the child’s victimization,” according to the U.S. Department of Justice. 
Sharpen your strategy with mentorship + daily ideas - 30 days free access to our <a href="https://academy.cryptopolitan.com/the-crypto-trading-edge-offer?utm_source=syndication&amp;utm_medium=inlineads&amp;utm_campaign=tradingedge" target="_blank">trading program</a>

California AG orders xAI to halt distribution of deepfake images

Table of Contents

Cryptopolitan_News

Other articles published on Jan 17, 2026

Spot Bitcoin ETFs attract $1.42B in strongest week since early October

Zero Knowledge Proof’s Presale Auction Could Turn $500 Into $500K: Why It’s the Top Crypto to Inv...

Finance Coach: XRP Will Leave a Dent in The Universe. Here’s why

Jim Cramer said chip stocks are rising because companies lack the equipment needed to expand prod...

Trump is weighing an executive action to cap credit card interest rates at 10%

Ethereum Stalls Near $3,300 as Smart Money Waits for the Real Breakout

Join our free newsletter for daily crypto updates!