OpenAI has raised concerns that users might develop an emotional dependency on its new ChatGPT voice feature, which simulates lifelike vocal interactions.
The tech company discussed these findings in a report released on Thursday, highlighting the safety measures undertaken with ChatGPT and its recent vocal adaptation, which mimics human speech patterns.
Last week, OpenAI began offering GPT-4o to its subscribed users, with CNN initially reporting the rollout. The AI model was first showcased in May, displaying capabilities such as translating between two people in real time and recognizing human emotions from a photo.
OpenAI identified several unique risks with the voice technology, including the possibility of recognizing individual voices, generating voices without authorization, and others.
This technology can reply to spoken queries in just 232 milliseconds—comparable to typical human reaction times during conversations.
The report also indicated a risk of anthropomorphization, where users attribute human characteristics to the AI, especially as the voice mode enables more lifelike interactions.
Initial tests revealed that some users began to use emotionally charged language with the AI, suggesting the formation of personal bonds with the technology. “While these interactions seem harmless, they underscore the importance of ongoing research into their long-term implications,” stated OpenAI.
The firm also noted that while the technology could offer companionship to isolated individuals, it might also discourage users from engaging with other people, potentially undermining real human connections.
OpenAI further mentioned that the voice AI’s ability to handle tasks and remember details from conversations could lead to an appealing user experience but also foster an unhealthy dependence on the technology.
The technology has drawn comparisons to the AI featured in the 2013 film “Her.” Scarlett Johansson, who voiced the AI in the movie, expressed concerns over one of OpenAI’s voices, noting its striking resemblance to her own.