Fortune

when

Sora

Synthesia, an artificial intelligence (AI) startup supported by Nvidia, has introduced a new upgrade enabling AI avatars to convey human emotions and movements.
On April 25, the company revealed its “Expressive Avatars,” which aim to express emotion based on text instruction for corporate presentations, marketing and training purposes. 
<blockquote class="twitter-tweet">
 &nbsp; This is it. This changes everything. For the first time in history, <a href="https://twitter.com/hashtag/AIavatars?src=hash&amp;ref_src=twsrc%5Etfw">#AIavatars</a> are able to understand what they're saying. Powered by our new AI avatar model, EXPRESS-1, they can detect sentiment of a script and perform all the subtle nuances of human communication. The… <a href="https://t.co/uj3WIjcGlm">pic.twitter.com/uj3WIjcGlm</a>— Synthesia (@synthesiaIO) <a href="https://twitter.com/synthesiaIO/status/1783535861214204368?ref_src=twsrc%5Etfw">April 25, 2024</a>
</blockquote> 
Generative AI is often praised for its ability to create realistic moving images, such is the case with<a href="https://cointelegraph.com/news/sora-openai-video-generation-model-artifical-intelligence-weakness"> OpenAI’s Sora video generator</a>. 
However, AI is not without its flaws, especially when portraying humans, who are often shown with <a href="https://cointelegraph.com/news/voters-spot-ai-deepfakes-presidential-elections">distorted hands or limbs</a>, collaged backgrounds, or lips out of synch with speech.
Synthesia aims to correct this in its latest version, which was developed on actual humans reading scripts in their studio. This was done to help bots capture lip tracking and be more accurate in their emotive expressions. 
Victor Ribarbelli, co-founder and CEO of Synthesia, <a href="https://twitter.com/alexvoica/status/1783540010714566817" target="_blank" rel="noopener nofollow">said</a> in a video&nbsp;that the missing piece has been that, unlike humans, “avatars don’t understand what they’re saying,” which previously led to the lack of facial response to emotions. 
In the studio, they were trained to respond to simple prompts like “I am happy. I am sad. I am frustrated” by conveying the correct facial expressions and tone associated with the given emotion.<iframe width="100%" height="315" src="https://www.youtube.com/embed/7EBHzLFePy0" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen data-ct-non-breakable="true"></iframe>
The new avatars are also available in more than 130 languages and can provide their own closed captions and even clone users’ own voices.&nbsp;
Related: <a href="https://cointelegraph.com/news/sam-altman-chat-gpt-mass-adoption-fortune-500">Sam Altman pushes ChatGPT mass adoption among Fortune 500 companies: Report</a>
However, of the example models of avatars on Synthesia’s website speaking in languages other than English — such as French, German and Spanish — the English language model is the most advanced and humanlike, according to a Cointelegraph test of the model. 
The startup reportedly has at least half of the Fortune 100 companies listed as clients and provides services to over 55,000 enterprises. This includes leaders in various industries such as Zoom, Xerox, Microsoft and Reuters, among others.&nbsp;
Synthesia is a United Kingdom-based company founded in 2017. On the heels of the AI boom over the last year, it has reached a valuation of nearly $1 billion with major backers like Nvidia, which currently dominates AI semiconductor chip development. 
Due to its more narrowed approach — creating humanlike avatars for business use — Synthesia has been sidestepping some of the hype and fierce competition seen between competing chatbot models like OpenAI’s ChatGPT and Google’s Gemini chatbot.&nbsp;
Magazine: <a href="https://cointelegraph.com/magazine/chatgpt-predict-crypto-prices-ai-humane-ai-pin-slammed-knowledge-collapse-ai-eye/">How to get better crypto predictions from ChatGPT, Humane AI pin slammed: AI Eye</a>

Nvidia-backed AI startup releases avatars that express human emotion

Cointelegraph

Other articles published on Apr 26, 2024

Breaking: Senate Candidate Deaton Files Amicus Brief in Coinbase Case

Is the Polygon Ecosystem Distinctly Bullish or Bearish?

China’s former CBDC chief is under government investigation

The Trending Force: BEFE Coin’s Unstoppable Journey to Meme Coin Prominence

BNY Mellon invests in Bitcoin ETFs as institutional interest grows

Bitcoin Price Turns Red And At Risk of More Downsides Below $63K

Join our free newsletter for daily crypto updates!