OpenAI has launched its new AI model called GPT-4o, which will be available for all free users of ChatGPT. The ‘o’ in the model name stands for Omni. This new model comes with powerful translation capabilities in real-time. Users can now rely on ChatGPT as a tour guide to explain any item in their surroundings using their phone’s camera. Here are all the details of OpenAI’s GPT-4o
GPT-4o by OpenAI: Features
GPT-4o is a flagship large language model by OpenAI that comes with GPT-4 level intelligence but with faster speeds and improved capabilities for vision recognition. This new model has three main advantages: real-time translation, live explanations, and free access to all users.
The biggest highlight of GPT-4o is its translation feature. The ChatGPT app on Android and iOS can now translate conversations in a user-friendly manner across multiple languages. Users can directly speak into the app and get translated audio output. OpenAI’s CTO Mira Murati demonstrated this feature in a post on X (formerly Twitter).
This translation feature appears to support around 20 languages, including Indian languages such as Gujarati, Hindi, Marathi, Telugu, Urdu, and Tamil.
Live audience request for GPT-4o realtime translation pic.twitter.com/VSj5phFKM6
— OpenAI (@OpenAI) May 13, 2024
ChatGPT can now also analyze images and videos directly using GPT-4o. This feature will be more useful on the ChatGPT app for Android and iOS, where users can ask the chatbot to explain any item using their phone’s camera. The concept is similar to Google Lens but is advanced and has more powerful features.
OpenAI mentions that this feature can be used in various scenarios, such as explaining a menu card at a restaurant. Users can also show ChatGPT any live sports event and ask the chatbot to explain the game’s rules. Some of these features will also be accessible on the desktop version of ChatGPT.
GPT-4o will start rolling out to Plus and Enterprise users today. The company will also provide this new model to a small set of free ChatGPT users. It will soon be made available to all free users. It is important to note that paid users of ChatGPT will have five times more usage limits than paid users. Once these limits are exhausted, ChatGPT will switch to GPT-3.5.
ChatGPT Desktop app for macOS
OpenAI has also launched a desktop app for ChatGPT for macOS. The app can be instantly accessed anywhere in macOS by using the keyboard shortcut Option + Space, which can be used to enter any prompts in ChatGPT.
Users can also take a screenshot and directly ask ChatGPT relevant questions about the contents of that image. The functionality is similar to Google Lens, which is available on both Android and iOS devices.
It also provides a voice communication option, where users can have real-time voice conversations with the chatbot on a desktop. The ChatGPT macOS app is currently available only for Plus users. OpenAI is also working on a desktop app for Windows.
