Gemini app for Mac gains computer use for multi-step tasks

Google's agent works in an isolated background window. US English users need a paid Google AI plan, and Apple is preparing new limits on disk access.

AIPublished
Image published by Google with “Let Gemini tackle repetitive chores on your Mac”
Image: Google · Source
What happened
Google added computer use to its Gemini app for Mac, letting the AI operate desktop apps, local files and websites on a user's behalf.
What’s new
Gemini can now carry out multi-step chores on a Mac in an isolated background window while the user keeps working.
Why it matters
Google is catching up with OpenAI, Anthropic and Meta on desktop agents just as Apple prepares tighter controls on what such agents can reach.

Google has added computer use to the Gemini app for Mac, so the assistant can now complete tasks that span local files, desktop apps and websites. The company announced the feature on 19 November. Users describe a task, and Gemini handles the clicks, keystrokes, menus and form-filling involved.

According to Google, Gemini does this work in an isolated background window and shows a live preview inside the chat. The user's main screen and cursor stay free for other work. Google says users pick which apps Gemini may access, can watch each step and pause at any point, and must approve key actions before Gemini carries them out.

Google's suggested uses include batch colour-grading photos in design software, pulling figures from local PDFs to fill in shipping-quote forms, and building Google Slides decks from live dashboards. It also suggests staging resale listings from a folder of clothing photos.

The feature is rolling out in English in the US. TechCrunch reports that it requires a Google AI Plus, Pro or Ultra subscription, and that Google did not say when it would reach other markets or platforms. TechCrunch also describes Google as somewhat late here, since OpenAI, Anthropic and Meta already offer agentic features in their desktop apps.

The Verge notes that the launch comes ahead of new Apple restrictions on Mac apps that request full disk access, which Apple is introducing because AI agents able to operate a computer could pose risks. According to The Verge, those settings were previewed in the macOS 27.3 beta.