Search

Block

<p>Recently there’s been a significant shift unfolding. Top websites are starting to guard their content against tech giants like Google and OpenAI. This step changes the longstanding relationship between web publishers and search engines. The shift is prompted by the rise of <a href="https://www.cryptopolitan.com/ai/" rel="noopener noreferrer nofollow">artificial intelligence (AI) technologies</a>.</p>
<h2 class="wp-block-heading" id="websites-protect-their-content">Websites protect their content</h2>
<p>Traditionally, websites have used a simple yet powerful tool known as `robots.txt` to manage how search engines interact with their content. This arrangement allowed websites to benefit from the traffic directed by search engines. However, advanced AI models have introduced new complexities to this relationship. Companies such as OpenAI and Google have been using vast amounts of online content to train their AI systems. These AIs can now directly answer user queries, reducing the need for users to visit the original websites. They disrupt the flow of traffic from search engines to these sites.</p>
<p>In response, Google has introduced a new protocol called Google-Extended. It enables websites to block the use of their content for training AI models. The protocol was rolled out in September last year and it has seen adoption by around 10% of the top 1,000 websites. This includes high-profile names like The New York Times and CNN.</p>
<h2 class="wp-block-heading" id="comparing-adoption-and-looking-ahead">Comparing adoption and looking ahead</h2>
<p>While Google-Extended represents a step toward <a href="https://twitter.com/CPOfficialtx" rel="noopener noreferrer nofollow" target="_blank">giving websites control</a> over their content, its adoption rate trails behind other tools such as OpenAI’s GPTBot. The hesitance may stem from worry over visibility in future AI-driven search results. Websites blocking access to their content risk being overlooked by AI models. They will potentially miss out on being included in answers to relevant queries.</p>
<p>The scenario with The New York Times is particularly telling. The publication has engaged in a copyright dispute with OpenAI. Since then, it has taken a firm stance by using Google-Extended to block AI model training access to its content.&nbsp;&nbsp;</p>
<p>Google’s experimental Search Generative Experience (SGE) hints at a potential shift in how information is curated and presented to users. It highlights AI-generated content over traditional search methods. The decisions made by tech companies and web publishers will shape the digital ecosystem. It will influence how information is accessed and consumed in the AI age.</p>

Websites Block Tech Giants from Using their Data to Train LLMs

Table of Contents

Cryptopolitan_News

Other articles published on Mar 15, 2024

$576 Million Liquidated As Bitcoin (BTC) Price Cracks 7%, More Pain Ahead?

Binance Launchpool Project NFPrompt Hacked, FBI Intervenes

Meme Tokens Defy Market Downturn with Surging Trading Volumes

Shiba Inu Community Burns 25 Mln Coins, What’s Next For SHIB?

US Spot Bitcoin ETF Sees Significant Inflows Drop

Senators Send a Letter to SEC Chair: Coinbase Executive Weighs In

Join our free newsletter for daily crypto updates!