OpenAI unveiled its most comprehensive artificial intelligence work to date. According to the company, GPT-4o will be able to recognize voices and images in real time in the next few weeks. With the new model, users will be able to chat with AI as if they were on a video call. It will also be possible to transfer images by uploading documents or sharing screens. The new services will be available for free, but the paid version will have five times the usage capacity. OpenAI chief technology officer Mira Murati emphasized the importance of making the tools available for free to the company’s mission: “For the first time, we’re really taking a big step forward when it comes to ease of use. And that’s incredibly important because we’re looking at the future of interaction between ourselves and machines, and we think GPT-4o really shifts that paradigm towards a future of collaboration where that interaction becomes much more natural and much easier.”

OpenAI has also announced a new desktop application for ChatGPT that will run on macOS. With real-time support for image, text and voice, the model can translate during a conversation or solve a math problem displayed in real time. Murati said live on air that GPT-4o’s response time is much faster than previous models, and this speed increase is visible in 50 different languages.