explainx / blog
OpenAI launches GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper in the Realtime API—bringing GPT-5-class reasoning to voice agents, real-time translation across 70+ languages, and streaming transcription for the next generation of voice interfaces.
Jul 7, 2026
On July 7, 2026, @OpenAIDevs launched GPT-Realtime-2.1-mini — reasoning and native tool use in OpenAI's cost-efficient Realtime tier without a price increase. explainx.ai maps the session types, connection methods, reasoning.effort defaults, cost math, and how it compares to Grok Voice and GPT-Realtime-2.1 flagship.
May 31, 2026
On May 30, 2026, Farza Majeed (founder of buildspace and HeyClicky) posted a 104-second demo video showing complete voice control of his Mac using OpenAI's GPT-Realtime 2.0 model. The demo went viral, reaching nearly 3 million views and drawing praise from OpenAI's Greg Brockman who called it 'real magic.' HeyClicky listens continuously via an always-on mode and responds fluidly to commands like opening VS Code, editing a snake game, and playing Spotify—all without touching the keyboard or mouse.
Jul 15, 2026
OpenAI's first branded hardware is a developer macro pad, not the rumored home companion. The Codex Micro pairs six frosted Agent Keys with Codex thread status, command shortcuts, and a reasoning dial — built on Work Louder's Creator Micro chassis. explainx.ai breaks down the $230 launch, RGB states, and the HTTP 410 stock joke.
Update (July 9, 2026 — GPT-Live): OpenAI launched GPT-Live for ChatGPT Voice — full-duplex consumer layer. This post covers the Realtime API developer stack.
On May 7, 2026, OpenAI announced a major leap in voice AI: GPT-Realtime-2, the company's most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Alongside it, OpenAI released GPT-Realtime-Translate (real-time translation across 70+ input and 13 output languages) and GPT-Realtime-Whisper (streaming transcription for live captions and notes).
OpenAI's GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper are now available in the Realtime API.
These three models are now available in the Realtime API, transforming voice interfaces from simple question-answering systems into real-time collaborators that can listen, reason, take action, handle interruptions, and keep conversations flowing naturally.
This article covers what makes GPT-Realtime-2 a breakthrough, how it compares to GPT-Realtime-1.5, the capabilities of all three models, pricing, use cases, and what developers and product teams should know when building production voice agents in 2026.
| Topic | Takeaway |
|---|---|
| GPT-Realtime-2 | OpenAI's flagship voice model with GPT-5-class reasoning; 128K context window (4× larger than 1.5); handles interruptions, tool calls, multi-turn dialogue |
| Performance Gains | 96.6% on Big Bench Audio (vs 81.4%); 48.5% instruction-following (vs 34.7%); 95% adversarial call success (vs 69%) |
| GPT-Realtime-Translate | Live translation from 70+ input languages → 13 output languages; preserves meaning with regional accents and domain vocabulary |
| GPT-Realtime-Whisper | Streaming speech-to-text with low latency; ideal for live captions, meeting notes, and real-time transcription |
| Pricing | RT-2: $32/1M input tokens, $64/1M output; Translate: $0.034/min; Whisper: $0.017/min |
| Use Cases | Customer support, education, tutoring, multilingual commerce, live events, meeting transcription, voice commands |
For the first time, OpenAI brings reasoning capabilities from their most advanced text models directly into a speech-to-speech voice model. This means voice agents can:
Voice agents are no longer just responders—they're real-time collaborators.
GPT-Realtime-2 has a 128K token context window, which is 4× larger than GPT-Realtime-1.5's 32K window. This allows:
For context: 128K tokens is roughly 96,000 words or ~200 pages of text—plenty for extended voice interactions.
OpenAI published benchmark comparisons showing significant gains across key metrics:
| Metric | GPT-Realtime-1.5 | GPT-Realtime-2 (high) | GPT-Realtime-2 (xhigh) | Improvement |
|---|---|---|---|---|
| Big Bench Audio (reasoning) | 81.4% | 96.6% | - | +15.2 points |
| Audio MultiChallenge (instruction-following) | 34.7% | - | 48.5% | +13.8 points |
| Adversarial Call Success | 69% | - | 95% | +26 points |
| Context Window | 32K tokens | 128K tokens | 128K tokens | 4× increase |
Visual comparison showing significant improvements across all key metrics. Source: OpenAI (May 2026)
Key Insight: The +26 point jump in adversarial call success is particularly important for customer support scenarios where users may be frustrated, use unclear language, or intentionally test the system.
GPT-Realtime-2 introduces five configurable reasoning levels, allowing developers to optimize for latency, cost, and quality based on use case:
| Level | When to Use | Trade-off |
|---|---|---|
| Minimal | Simple acknowledgments, greetings | Lowest cost/latency |
| Low | Straightforward Q&A, basic navigation | Very fast responses |
| Medium | Standard conversational turns | Balanced cost/quality |
| High | General conversation (recommended default) | Good reasoning without major latency |
| Xhigh | Complex branching logic, multi-tool flows, adversarial inputs | Higher latency and cost |
OpenAI's recommendation: Use high as the default for most production applications; reserve xhigh for scenarios requiring deep reasoning or handling difficult edge cases.
GPT-Realtime-Translate is a live simultaneous translation model that works while streaming—translating speech as the speaker talks, across 70+ input languages into 13 output languages.
1. Real-Time Translation Translates speech while the person is speaking, not after they finish—critical for natural conversations and live events.
2. Context Preservation Handles:
3. Meaning Over Literal Translation Focuses on preserving intent and meaning rather than word-for-word translation—resulting in more natural output.
$0.034 per minute of translated audio.
GPT-Realtime-Whisper is OpenAI's streaming speech-to-text model optimized for low latency. Unlike the batch Whisper API, which processes complete audio files for maximum accuracy, GPT-Realtime-Whisper transcribes as words are spoken.
| Feature | Batch Whisper API | GPT-Realtime-Whisper |
|---|---|---|
| Mode | Post-recording processing | Streaming transcription |
| Latency | Processes complete files | Real-time output |
| Accuracy | Optimized for accuracy | Optimized for latency |
| Use Case | Podcasts, video transcripts | Live captions, meeting notes |
| Pricing | Per audio minute processed | $0.017/min streaming |
1. Live Captions
2. Meeting Transcription
3. Classroom Transcripts
4. Voice Commands
5. Customer Support Logging
$0.017 per minute of transcribed audio—exactly half the cost of GPT-Realtime-Translate.
| Component | Cost | Notes |
|---|---|---|
| Audio Input | $32 per 1M tokens | Standard audio input processing |
| Cached Input | $0.40 per 1M tokens | 98.75% discount for cached prompts |
| Audio Output | $64 per 1M tokens | Generated speech responses |
Prompt caching is critical for cost optimization—system prompts, context, and reference material can be cached at $0.40 per 1M tokens instead of $32.
Complete pricing structure for GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper. Note the 98.75% discount for cached inputs.
10-minute customer support call:
Hybrid approach (transcribe with Whisper → reason with text models → respond with RT-2) can optimize costs for workflows where streaming voice isn't critical throughout.
Problem: Level 1 support handles simple queries; complex issues require human escalation.
Solution: GPT-Realtime-2 with high reasoning handles nuanced questions, tool calls (checking order status, processing refunds), and multi-step troubleshooting without human handoff.
Benefits:
Problem: Serving global customers requires multilingual support teams or fragmented regional systems.
Solution: Single agent team uses GPT-Realtime-Translate to serve customers in their native language; backend support agents work in their native language.
Benefits:
Problem: International conferences, webinars, and workshops need simultaneous interpretation—expensive and limited by interpreter availability.
Solution: GPT-Realtime-Translate provides real-time translation for live streams, video calls, and in-person events.
Benefits:
Problem: Personalized tutoring is expensive and hard to scale; students need patient, adaptive instruction.
Solution: GPT-Realtime-2 with high reasoning acts as 1:1 tutor—explaining concepts, answering questions, adapting to student's pace.
Benefits:
Problem: Manual note-taking during meetings is distracting; post-meeting transcription delays action items.
Solution: GPT-Realtime-Whisper transcribes meetings in real-time; pair with text models for instant summaries and action items.
Benefits:
All three models run in OpenAI's cloud—not suitable for:
Mitigation: For sensitive use cases, consider OpenAI's enterprise tier with enhanced data controls or self-hosted alternatives (though reasoning quality will differ).
Challenge: Voice interactions are harder to estimate than text:
Mitigation:
Challenge: Switching from GPT-Realtime-1.5 to 2.0 may change:
Mitigation:
Limitation: Only 13 output languages (vs 70+ input languages).
Implication: You can listen in 70+ languages but respond in only 13—fine for customer support (respond in user's language) but limiting for multilingual content creation.
GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper are available now in the Realtime API.
Sign up: OpenAI Platform
Tip: You can combine models—e.g., Whisper for transcription → text model for reasoning → RT-2 for voice output.
Start with high reasoning for general use; test xhigh for complex scenarios.
System prompts, context, and reference material should be cached to get 98.75% cost savings on repeated tokens.
| Feature | GPT-Realtime-2 | Claude Voice (hypothetical) |
|---|---|---|
| Reasoning | GPT-5-class reasoning | Claude Opus 4.7-class reasoning |
| Context Window | 128K tokens | Likely 200K+ (Claude's strength) |
| Pricing | $32/$64 per 1M tokens | TBD (Claude typically competitive) |
| Tool Calling | Native support | Native support (strong in Claude) |
| Latency | Optimized for real-time | TBD |
As of May 8, 2026, Anthropic has not announced a competing voice model—GPT-Realtime-2 is the frontier.
Google Gemini Live (voice mode in Gemini) offers:
GPT-Realtime-2 advantages:
OpenAI's announcement signals a paradigm shift:
Old: Voice assistants as reactive responders—answer questions, set timers, play music.
New: Voice agents as proactive collaborators—solve complex problems, take action, adapt to interruptions, work across languages.
1. Truly Useful Customer Support Not just "I'm sorry you're having trouble"—actual troubleshooting, order management, and resolution.
2. Personalized Education at Scale 1:1 tutoring with reasoning capabilities that adapt to each student's level and pace.
3. Global Business Without Language Barriers Small businesses can serve global customers without hiring multilingual teams.
4. Accessible Meetings and Events Real-time transcription and translation make content accessible to everyone, regardless of language or hearing ability.
Expected Evolution:
OpenAI's GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper represent the most significant leap in voice AI since the original Realtime API launch.
Key Takeaways:
Who Should Care:
OpenAI has stated: "We know you're eager for voice updates in ChatGPT. Stay tuned, we're cooking."
The Realtime API release is the infrastructure layer—expect consumer-facing voice improvements in ChatGPT soon.
For more on AI agents, model capabilities, and production AI systems:
Disclosure: This post is editorial analysis based on OpenAI's May 7, 2026 announcement, community developer forum posts, and third-party technical coverage. Benchmark numbers and pricing are accurate as of May 8, 2026 but may change. For production deployments, consult OpenAI's official documentation and pricing pages.
Update — July 7, 2026: OpenAI shipped GPT-Realtime-2.1-mini — reasoning and tool use in the mini lineup at the same cost as GPT-Realtime-mini, plus ≥25% lower p95 latency across Realtime voice models via improved caching. Flagship GPT-Realtime-2.1 remains the choice for maximum reasoning depth ($32/$64 per 1M audio tokens).
Update — July 2, 2026: xAI launched Voice Agent Builder — a no-code Grok Voice platform with telephony and MCP at $0.05/min, quoting 67.3% on τ-voice Bench vs 35.3% for GPT Realtime 1.5 in xAI's table.
