Polis

Collective

<img width="800" height="533" src="https://cdn.thebittimes.com/images/2023/10/25/92a7993608137cc7f2194ce31479255f.webp" class="webfeedsFeaturedVisual wp-post-image" alt="" decoding="async" style="display: block; margin: auto; margin-bottom: 5px;max-width: 100%;" link_thumbnail="1" srcset="https://cdn.thebittimes.com/images/2023/10/25/92a7993608137cc7f2194ce31479255f.webp 800w, https://cdn.thebittimes.com/images/2023/10/25/92a7993608137cc7f2194ce31479255f.webp 450w, https://cdn.thebittimes.com/images/2023/10/25/92a7993608137cc7f2194ce31479255f.webp 750w, https://cdn.thebittimes.com/images/2023/10/25/92a7993608137cc7f2194ce31479255f.webp 768w" sizes="(max-width: 800px) 100vw, 800px">
In a groundbreaking exploration of AI capabilities, Anthropic, an artificial intelligence (AI) company, has tailored a large language model (LLM) to reflect user-defined values. This unique study involved gathering input from 1,000 participants to fine-tune the LLM’s responses based on their collective judgments.
Unlike conventional LLMs equipped with predefined guardrails to constrain certain outputs, Anthropic’s approach embraces user agency. Models like Claude from Anthropic and ChatGPT from OpenAI often adhere to preset safety responses, especially regarding sensitive topics. However, critics argue that such interventions might compromise user autonomy, as the definition of acceptability varies and is subjective across cultures and time periods.
A potential solution to this complex challenge is empowering users to shape the value alignment of AI models. Anthropic embarked on the “Collective Constitutional AI” experiment in collaboration with Polis and the Collective Intelligence Project. Engaging 1,000 users from diverse backgrounds, they posed a series of questions through polling to gather valuable insights.
The experiment revolves around granting <a rel="noopener noreferrer nofollow" title="users" href="https://thebittimes.com/tag/users.html">users</a> the authority to determine appropriateness without exposing them to undesirable outputs. This process involved eliciting user values and incorporating them into a pre-trained model. Anthropic employs a technique known as “Constitutional AI,” where the model is provided with a set of rules to follow, akin to a constitution guiding governance in nations.
In the Collective Constitutional AI experiment, Anthropic aimed to integrate feedback from user groups into the model’s constitution. According to Anthropic’s blog post, the results suggest a scientific success, shedding light on challenges associated with letting users collectively define the values of an LLM product.
A notable hurdle faced by the team was developing a novel benchmarking process. Given the experiment’s pioneering nature and reliance on Anthropic’s Constitutional AI methodology, there is no established test for comparing base models with those fine-tuned using crowd-sourced values.
In the end, it seems that the model incorporating data derived from user polling feedback exhibited a “slight” improvement over the base model in mitigating biased outputs. Anthropic expresses excitement not just about the resultant model but, more importantly, about the groundbreaking process itself. This experiment signifies one of the initial instances where the public, as a collective, intentionally influenced the behavior of a large language model. The hope is that communities globally will build upon such techniques to develop models that align with their specific cultural and contextual needs.
The post Anthropic <a rel="noopener noreferrer nofollow" title="created" href="https://thebittimes.com/tag/created.html">created</a> a <a rel="noopener noreferrer nofollow" title="democratic" href="https://thebittimes.com/tag/democratic.html">democratic</a> <a rel="noopener noreferrer nofollow" title="AI chatbot by allowing its principles" href="https://thebittimes.com/tag/ai-chatbot-by-allowing-its-principles.html">AI chatbot by allowing its principles</a> to be <a rel="noopener noreferrer nofollow" title="chosen" href="https://thebittimes.com/tag/chosen.html">chosen</a> by <a rel="noopener noreferrer nofollow" title="users" href="https://thebittimes.com/tag/users.html">users</a>. appeared first on BitcoinWorld.
Source: <a rel="noopener noreferrer nofollow" target="_blank" href="https://thebittimes.com/anthropic-created-a-democratic-ai-chatbot-by-allowing-its-principles-to-be-chosen-by-users-tbt67696.html">https://thebittimes.com/anthropic-created-a-democratic-ai-chatbot-by-allowing-its-principles-to-be-chosen-by-users-tbt67696.html</a>

Anthropic created a democratic AI chatbot by allowing its principles to be chosen by users.

TheBitTimes

Other articles published on Oct 25, 2023

Bitcoin’s Bullish Dance: More than Just ETF Euphoria?

China says it wants to fix relationship with U.S.

‘Where Deals Get Done’: Benzinga Kick Off Flagship Conferences Recognizing and Fueling Innovation...

Ethereum dominance against Bitcoin takes sharp dive

Bitcoin Now Aiming to Break $35K; Will it Get Success?

The 2024 US Presidential Election: Where US Presidential Candidates Stand on Cryptocurrency Policies

Join our free newsletter for daily crypto updates!