OpenAI drastically updates Codex desktop app to use all other apps on your computer, generate images, preview webpages
Source: VentureBeat
What’s New?
- Full‑system access – Codex can now interact with any app on your computer, surface relevant information on demand or proactively, and take actions as directed.
- Background operation (Mac only) – While you continue working, Codex agents can run in the background, clicking, launching, and typing in other applications simultaneously.
- Built‑in web browser – Preview front‑end development directly inside Codex.
- Integrated image generation – Direct pipeline to OpenAI’s gpt‑image‑1.5 model for creating assets (websites, presentations, game art, etc.) in‑app.
“Codex can actually click on apps, launch apps, and type into apps. This works with any apps on your machine.” – Andrew Ambrosino, OpenAI technical staff, Codex team (embargoed press briefing)
“It’s not just about the growth. It is putting a very capable agent in the hands of builders, and now we’re seeing that we’re able to expand and do a lot more work entirely across your computer.” – Thibault “Tibo” Sottiaux, Head of Codex, OpenAI
“Codex is our most powerful agent. It already worked on your computer, and so we’re expanding the capabilities there. It felt very natural. We will make it make sense at some point.” – Tibo Sottiaux to VentureBeat
Competitive Landscape
- Anthropic’s Claude – Offers Claude Cowork and Claude Code desktop views (Mac & Windows) but does not support simultaneous background cursor usage across all user apps like Codex does.
“Computer Use” – The Biggest Leap (macOS)
- Background interaction – Codex can “see, click, and type” across applications without taking over the entire desktop.
- Multi‑agent workflows – Example: Codex tests a front‑end change while you continue working in another app.
“It can use apps on your computer in the background, as opposed to taking over your entire computer.” – Caffrey Lynch, OpenAI developer product communications
- Windows – Core Codex desktop app remains fully supported, but the cursor‑level background interaction is macOS‑only at launch.
End‑to‑End Software Development Workspace
OpenAI is expanding Codex into a unified SDLC hub. The new surface area includes:
| Feature | Description |
|---|---|
| Integrated Browser | In‑app browser for iterating on front‑end designs; comment directly on DOM elements and give precise instructions. |
| Visual Primitives | gpt‑image‑1.5 integration for generating/iterating on mockups, game assets, and other visuals. |
| Expanded Sidebar | Rich previews for PDFs, spreadsheets, slide decks, plus a summary pane tracking agent plans and sources. |
| Terminal & SSH | Multiple terminal tabs; alpha support for remote dev‑box connections via SSH. |
| 90+ New Plugins | Connectors (CircleCI, GitLab, Microsoft Suite, etc.) let the agent gather context and act across the entire toolchain. |
“The simplest way to think about this release is teaching Codex and the app to work across a much larger surface area.” – Andrew Ambrosino, lead, Codex app development
Demo Prompt
User: “Can you check Slack, Gmail, Google Calendar, and Notion and tell me what needs my attention?”
Codex scans multiple apps, aggregates the information, and surfaces the most relevant items.
“You can @‑mention them if you want Codex to use a specific app, or if not, Codex can discover which apps to use.” – Ambrosino
Persistent Agency – “Heartbeat Automations”
- Scheduled work – Codex can set future tasks and “wake up” to continue long‑term jobs.
- Proactive monitoring – Agents can watch Slack channels or Notion docs and automatically update documentation or PRs.
Memory (preview)
- Remembers personal preferences, prior corrections, and gathered data.
- Reduces the need for extensive custom instructions each session.
“As you use Codex, Codex also becomes better at being proactive.” – Sottiaux
The “Daily Brief” Feature (in preview)
Codex will soon suggest a concise daily briefing, summarizing:
- Pending tickets or PRs
- Upcoming meetings or calendar events
- Relevant updates from monitored apps
Stay tuned for the full rollout.
# Daily Routine Tip
Start the day by identifying open Google Doc comments or relevant Slack context.
---
## New “Routines” Feature
It’s similar in spirit and practice to the new **“Routines”** feature launched by Anthropic for its Claude Code product earlier this week.Licensing, Pricing, and Availability
OpenAI has recently transitioned toward a more flexible pricing model for teams, including:
- $100 plan
- Pay‑as‑you‑go options to accommodate the increased usage of autonomous agents.
For individual users, these updates are rolling out today to those signed in to the Codex desktop app with ChatGPT.
Platform Availability
- macOS and Windows: Codex desktop app is available on both.
- Feature rollout is tiered:
| Feature | Availability |
|---|---|
| Background Computer Use (macOS only) | Launch only on macOS |
| Personalization (Memory/Suggestions) | Coming soon for Enterprise, Edu, EU, and UK users |
| Core Software Development Life Cycle Updates | Available to all desktop app users starting today |
The Vision: From Developer Tool to Super App for All
When asked if these features represent the foundation of an AI “Super App,” Sottiaux confirmed the strategy:
“We’re building the Super App in the open and evolving it out of the Codex app.”
Why This Matters
- Developers spend a majority of their time on coordination and context‑gathering rather than writing code.
- By bringing Codex closer to the operating system and the broader ecosystem of developer tools, OpenAI is positioning it as the central nervous system for modern software development.
“Our mission is to ensure that AGI benefits all of humanity,” the company stated in its official announcement. “That means narrowing the gap between what people can imagine and what they can actually build.”