While Apple’s Worldwide Developers Conference (WWDC) keynote focused on the latest innovations and updates, a quieter addition slipped under the radar – minor computer vision upgrades in iOS 17. Among these features is Visual Look Up, which enables users to search for recipes directly from a photo.
Visual Look Up: A New Way to Find Recipes
The new feature allows users to identify food items in their photos and search for similar dishes. For instance, if you take a picture of a bowl of quinoa, the app will suggest other quinoa-based meals and breakfast options. This addition is not only convenient but also another example of Apple’s strategy to have users start their queries directly on the iPhone.
A Subtle Redirection Away from Google Search
The search results provided by Visual Look Up link users to the recipe’s website, bypassing Google. In contrast, Spotlight improvements in years past saw users skipping a Google search to reach Wikipedia pages or look up information on actors, movies, shows, and musicians.
Spotlight: The Top Hits Feature
While Visual Look Up is not the only major update to Spotlight this year, it’s worth noting that the feature’s focus has shifted from web searches. Instead, users can now access ‘Top Hits’ – common app shortcuts – when searching for an app. For example, a search for "Photos" may suggest shortcuts like "Recent" or "Favorites."
Visual Look Up in Action: Pausing Videos and Identifying Subjects
In addition to identifying food items, Visual Look Up will also allow users to pause videos to look up information on the subject by tapping on an info icon. This feature is similar to the one introduced last year with iOS 16, which enabled users to "pick up" objects from a photo.
Cutouts and Stickers: A New Feature in iOS 17
The Visual Look Up improvements will also enable users to turn cutouts into stickers using the new Live Stickers feature. This feature allows users to cut out subjects from their own photos or paused videos, save them as stickers, and access them across iOS 17.
Other Features in Apple Messages: iOS 17
Apple’s latest operating system update brings several features to Apple Messages, including:
- Voicemail Transcription: Users can now have their voicemails transcribed into text.
- Check In: A safety feature that allows users to share their location with friends and family.
- Live Stickers: As mentioned earlier, this feature enables users to turn cutouts into stickers.
Conclusion
While Apple’s WWDC keynote focused on major updates and innovations, the company quietly rolled out minor computer vision upgrades in iOS 17. The Visual Look Up feature is a convenient addition that allows users to search for recipes directly from a photo, while also showcasing Apple’s strategy to have users start their queries directly on the iPhone.
By incorporating AI-powered features like Visual Look Up, Apple continues to push the boundaries of what we can do with our devices and how we interact with them. As we look forward to iOS 17, it’s clear that Apple is committed to delivering innovative updates that improve our daily lives.
References
- Apple (2023). iOS 17. Retrieved from https://www.apple.com/ios/
- Perez, S. (2023, June). Apple’s WWDC 2023: What to Expect. TechCrunch.
- Perez, S. (2022, September). iOS 16 Update Brings Visual Look Up and Other Features. TechCrunch.
Related Posts
