ChatGPT can now see, listen and speak

[New Sancai Compilation First Release] OpenAI’s ChatGPT is getting a major update that will enable the viral chatbot to have voice conversations with users and interact using images, bringing it closer to popular artificial intelligence (AI) assistants like Apple’s Siri.

OpenAI said in a blog post on Monday that the voice feature "opens the door to many creative and accessible applications."

Similar artificial intelligence services such as Siri, Google Voice Assistant and Amazon's Alexa are integrated with the devices they run on, often for setting alarms and reminders and delivering messages over the Internet.

Since its debut in 2022, ChatGPT has been adopted by companies for tasks ranging from summarizing documents to writing computer code, sparking a race among major tech companies to launch their own generative AI-based products.

ChatGPT's new voice feature can also tell bedtime stories, resolve dinner table debates, and speak user-entered text out loud. OpenAI says the technology behind it is being used by Spotify to let the platform's podcasters translate their content into different languages.

With image support, users can take photos of things around them and ask the chatbot to "troubleshoot why the grill won't start, explore the contents of the refrigerator to plan meals, or analyze complex graphs to obtain work-related data."

Alphabet's Google Lens is currently a popular choice for obtaining image information. The new ChatGPT feature will be released to subscribers of its Plus and Enterprise plans within the next two weeks.

(Compiled by: Wang Jimin)

(Editor: Jiang Qiming)

(Source of the article: First published by Xinsancai)