A New Era for Mobile Devices
In a groundbreaking announcement, Google has unveiled the Pixel 8 Pro, a revolutionary device that will be the first to run Google’s generative AI models on-device. According to Rick Osterloh, SVP of devices and services at Google, the custom-built Tensor G3 chip in the Pixel 8 Pro is designed to accelerate AI workloads, enabling "distilled" versions of Google’s text- and image-generating models to power a range of applications.
A Closer Look at the Custom-Built Chip
The Tensor G3 chip is a significant advancement in mobile hardware, allowing for the efficient processing of complex AI tasks on-device. This innovation paves the way for a new generation of mobile devices that can seamlessly integrate generative AI capabilities into their core features.
"We’ve worked closely with our research teams across Google to take advantage of their most advanced foundation models and distill them into a version efficient enough to run on our flagship Pixel," Osterloh explained. This collaborative effort demonstrates the company’s commitment to pushing the boundaries of what is possible in mobile AI processing.
Enhanced Magic Eraser: The Power of On-Device Processing
One of the standout features of the Pixel 8 Pro is its enhanced Magic Eraser, a post-processing tool that has been significantly improved through on-device processing. According to Osterloh, this advanced version can remove larger objects and people smudge-free, resulting in higher-quality finished images.
The new Magic Eraser generates new pixels to fill in the spaces left by anything removed from a shot, taking full advantage of the Pixel 8 Pro’s on-device generative AI capabilities. This innovative feature is now available on the device at launch, marking a significant milestone in the evolution of mobile photography.
Zoom: Sharper and More Detailed Photos
In addition to Magic Eraser, Zoom will also benefit from the on-device model, which can "intelligently" sharpen and enhance the details of photos. This enhancement ensures that users can capture more detailed and higher-quality images with their Pixel 8 Pro device.
Audio Recording: Efficient Summaries and Highlights
The benefits of on-device processing extend to audio recording as well. The Pixel 8 Pro’s recording app will soon deliver summaries of recordings, recapitulating the highlights of meetings. This feature streamlines the process of reviewing and analyzing recorded conversations, making it easier for users to stay organized and focused.
Smart Replies with Gboard
The upgraded Gboard keyboard app on the Pixel 8 Pro will also leverage the power of generative AI, generating "higher-quality" reply suggestions with better overall conversational awareness. This feature is designed to make typing and communication more efficient and effective, allowing users to respond quickly and accurately.
Availability: A Phased Rollout
With the exception of Magic Eraser, which is available on the Pixel 8 Pro at launch, the on-device generative AI features will arrive in December via an update. This phased rollout ensures that users have access to the latest innovations as soon as possible, while also allowing Google to fine-tune and optimize the performance of its on-device models.
Conclusion
The introduction of the Pixel 8 Pro marks a significant milestone in the development of mobile AI processing. By harnessing the power of generative AI models on-device, Google has created a new standard for mobile devices, enabling users to experience enhanced features and capabilities without relying on cloud-based services.
As we move forward into this new era of mobile innovation, it is clear that the possibilities are endless. With the Pixel 8 Pro leading the charge, we can expect to see significant advancements in AI-powered mobile applications, revolutionizing the way we interact with our devices and each other.
Further Reading
