Reddit

Verge

<ul class="list-ic vertical"> 
 <li> 1 <a>OpenAI launched its web crawler named GPTBot.</a> </li> 
 <li> 2 <a>With this web crawler, ChatGPT users will get the option to scrap it using a command.</a> </li> 
</ul> 
OpenAI, an artificial intelligence (AI) company, launched GPTBot which is its web crawler and can be identified by a specific “user agent and string.” The Verge, an American technology news website, also shared the news on August 7, 2023, stating that OpenAI now lets the user block its web crawler from scraping the user’s site to help train GPT models. 
The Verge further mentioned the AI company’s web crawler that the website operators can specifically disallow GPTBot on their site’s Robots.txt file or block its IP address. 
It can be said with this web crawler, the very first step is taken in OpenAI which allows the internet users to opt out of having their data used for training its large language models. 
Notably, it is following the previous attempts at creating a flag that would exclude content from training, such as a “NoAI” tag conceived by DeviantArt in 2022. Although, “it does not retroactively remove content previously scraped from a site from <a href="https://www.thecoinrepublic.com/2023/07/05/openai-temporarily-switches-off-premium-feature-chatgpt-browse/" target="_blank" rel="noopener noreferrer nofollow">ChatGPT’s </a>training data.” 
<h2 class="wp-block-heading" id="strong-openai-s-web-crawler-usage-strong">OpenAI’s Web Crawler Usage</h2> 
About GPTBot’s usage, the AI company mentioned that “web pages crawled with the GPTBot user agent may potentially be used to improve future models and are filtered to remove sources that require paywall access, are known to gather personally identifiable information (PII), or have text that violates our policies.” 
Furthermore, the AI company mentioned that allowing GPTBot to access users’ sites can help AI models become more accurate and improve their general capabilities and security. On the other hand, OpenAI also shared how to disable GPTBot from accessing any user’s site. The AI company also gives customized options with GPTBot access. 
For the large language models such as OpenAI’s GPT models and Google’s Bard, the internet already shared enough training data. Meanwhile, the <a href="https://www.thecoinrepublic.com/2023/07/18/xai-an-ai-startup-of-elon-musk-for-understanding-the-universe/" rel="noopener noreferrer nofollow">AI </a>company won’t confirm the data that it gets whereas sourcing data for AI training has become increasingly contentious. 
Moreover, Reddit and X (formerly known as Twitter), have pushed to crack down on the free use of its users’ posts by leading AI companies. While “authors and other creatives have sued over alleged unauthorized use of their works. Last month, the lawmakers also latched onto data privacy and consent questions in several Senate hearings around AI regulation.” 
A report by the media company, Axios, further states that companies like “Adobe have floated the idea of marking data as not for training through an anti-impersonation law.” Meanwhile, “OpenAI has signed an agreement with the White House to develop a watermarking system to let people know if something was generated by AI but made no promises to stop using internet data for training,” as per the report.

OpenAI Brings Its Web Crawler GPTBot; Find Its Details Here

Table of Contents

Thecoinrepublic.com

Other articles published on Aug 8, 2023

Listing News From Kraken Puts These Two Altcoins On The Rise!

Tether Set to Release New Software to Improve Bitcoin Mining

More Stablecoins Coming: 5 Companies Following Paypal’s Lead?

State of E-CNY in Rural Areas: Challenges and Opportunities

XRP Records 10% Weekly Dip Amidst Gemini Relisting Buzz

CleanSpark Triples Hash Rate Amid Expansion

Join our free newsletter for daily crypto updates!