OpenAI is pushing the boundaries of AI technology once again with the introduction of new voice and image capabilities. These features are ready to revolutionize the way users interact with AI models, providing a more seamless and immersive experience.
Voice Conversations with ChatGPT:
One extraordinary aspect of this update is the ability to engage in voice conversations with ChatGPT. Users can now have real-time dialogues with their AI assistant, opening up a world of possibilities. Whether you're on a journey, looking for a bedtime story for your family, or settling a dinner table debate, ChatGPT's voice capabilities are here to assist.
To get started with voice, simply navigate to the settings menu in the mobile app, choose "New Features," and opt into Voice Chat. Once enabled, you can tap on the headphone icon in the upper right corner of the home screen to select from a variety of different voices, all carefully crafted by professional voice actors to provide a human-like audio experience. Additionally, Whisper, OpenAI's open-source speech recognition system, transcribes spoken words into text, enhancing the overall quality of the conversation.
Interacting with Images with ChatGPT:
Another game-changing feature is the ability to share images with ChatGPT. Users can now show ChatGPT one or more images to help solve problems, identify objects, or analyze complex data. Whether you're trying to figure out why your grill won't start, planning a meal based on the contents of your fridge, or deciphering data graphs for work, ChatGPT can lend a helping hand.
To use this feature, simply capture or select an image by tapping the photo button. On iOS or Android, you can also use the plus button to add multiple images or use the drawing tool for guidance. These image capabilities are powered by multimodal models like GPT-3.5 and GPT-4, which combine language expertise with an extensive range of visual content, including photos, screenshots, and text-and-image documents.
Gradual Deployment for Safety and Responsiveness:
The rollout of voice and image capabilities is gradually starting over the next two weeks for Plus and Enterprise users. Voice is available on both iOS and Android platforms, with the option to opt in through settings, while image capabilities will be accessible on all platforms. OpenAI acknowledges the potential risks associated with these advanced features.
For voice, the focus is on voice chat, and the technology has been developed in collaboration with voice actors to ensure authenticity and security. Additionally, real-world usage and user feedback will play a vital role in further enhancing these security measures, respecting user privacy while ensuring the utility of the tool for real-world scenarios."
