OpenAI, a renowned research organization known for its cutting-edge artificial intelligence models, has recently unveiled a ChatGPT app designed specifically for Apple Vision Pro. The augmented reality headset that Apple recently unveiled is compatible with this app.
The latest version of OpenAI’s natural language processing system, GPT-4 Turbo, is now available for users to chat with on the Vision Pro app of ChatGPT. Users have the ability to ask questions, receive answers, seek advice, expand their knowledge on various topics, and even create images and text within the app.
Human-AI Interaction’s Future
The introduction of ChatGPT for Vision Pro is a major achievement for OpenAI, as it strives to develop artificial intelligence that can have a positive impact on society. It provides a sneak peek into the potential future of human-AI interaction, showcasing a more natural, intuitive, and immersive experience.
In the near future, our interactions with AI assistants will involve more speaking and visual input. Instead of typing, we will be able to dictate our needs and even provide images by simply looking at the problem we want to solve. For example, we could lay out ingredients on a table, look at them, and ask our AI assistant to help us make a recipe using those ingredients.
One of the Earliest VisionOS Apps for Apple Vision Pro
Today, ChatGPT joins the ranks of over 600 new apps designed for VisionOS, the cutting-edge operating system behind Apple Vision Pro. VisionOS aims to deliver a smooth and captivating experience for individuals seeking to engage with digital content in the physical realm.
Apple states that VisionOS apps can utilize the features of Vision Pro. These include Optic ID, a biometric authentication system that uses eye tracking and iris recognition. Spatial audio is also available, which creates realistic and directional audio effects. Additionally, developers can use VisionKit, a framework that allows apps to have visual, auditory, and speech capabilities. It remains uncertain whether the new ChatGPT app for VisionOS will utilize any of these advanced features.
The new ChatGPT app is part of a larger effort in the industry to develop multimodal AI. This type of artificial intelligence can effectively handle and comprehend various forms of input, including text, speech, images, and videos. This implies that it has the ability to identify and comprehend diverse forms of data, rather than being limited to just one type. As a result, it becomes more flexible and capable of adjusting to various circumstances.
A New Text, Image, and Voice AI Conversation Option
Current iterations of ChatGPT have the capability to engage in conversations using text, images, and voice. Using Vision Pro, users will find it much simpler to showcase images to ChatGPT. This will enable them to engage in complex problem-solving tasks like diagnosing why their car engine won’t start, examining the contents of their fridge to plan a meal, or analyzing a math problem just by looking at it.
Users can continue to generate content by describing their ideas to ChatGPT. This includes inventing new logos, comic strips, and photorealistic scenes, all within the chat. Everything will be accomplished with even greater ease, as you can simply dictate commands through the headset or gaze at a real-world object while wearing the headset and request information about it.
Starting today, VisionOS users can enjoy free access to ChatGPT. For those looking for additional features and faster response times, there is an optional subscription called ChatGPT Plus, which provides access to GPT-4’s capabilities. You can easily download the app from the VisionOS App Store. There, you’ll discover a wide range of other apps tailored to various needs and passions, including creative writing, marathon training, and math tutoring.
