Apple Visual Intelligence To Add Screen Search With Google, ChatGPT & Third-Party Apps

06/10/25

TL;DR Summary of Apple Intelligence and Visual Intelligence Updates at WWDC 2025

Apple introduced enhancements to Apple Intelligence and Apple Visual Intelligence at WWDC 2025, promising more advanced features in the coming year. The upcoming iOS 26 will support multiple new languages and allow developers to use on-device foundation models for privacy-focused AI. Visual Intelligence now includes screenshot-based image search and AI-powered question answering directly from screen content. These updates emphasize offline capabilities and improved user interaction with AI on Apple devices.

Optimixed’s Overview: Apple WWDC 2025 Unveils Advanced On-Device AI and Visual Search Features

Apple Intelligence Enhancements

At WWDC 2025, Apple revealed ongoing work to perfect Apple Intelligence, focusing on making Siri more personal and powerful. Although some features require additional development time, Apple shared several key updates:

  • Expanded Language Support: iOS 26 will introduce new languages including French, German, Italian, Portuguese (Brazil and Portugal), Spanish, various forms of Chinese, Japanese, Korean, English, Danish, Dutch, Norwegian, Swedish, Turkish, Vietnamese.
  • Developer Access via Foundation Models Framework: App developers can now integrate powerful AI models that run entirely on-device, ensuring privacy, offline functionality, and no extra costs.

Apple Visual Intelligence Features

Craig Federighi also demonstrated new capabilities in Apple Visual Intelligence centered around interaction with screenshots and images:

  • Screenshot to Search: Users can take screenshots and immediately search for matching images via Google or third-party apps using an “Image Search” option.
  • Selective Area Search: Similar to Google’s circle search, users can highlight parts of their screen to perform targeted image searches.
  • Multimodal AI Interaction: The “Ask” feature leverages AI (comparable to ChatGPT) to answer questions about the visual content on screen, enhancing user engagement.

While Apple’s Visual Intelligence advances are promising, Google’s Live Search currently offers more robust capabilities.

Source: Search Engine Roundtable by barry@rustybrick.com (Barry Schwartz). Read original article.