The thing that usually leaks last with Pixel devices are the software features. While every detail of the hardware is usually leaked months in advance, we usually only find out about the new software shortly before its release.

This is no longer the case today, thanks to a massive leak from Google’s gChips division Android Authority has looked at credible documents that hint at some new features we can expect from the Pixel 10 and Pixel 11.

The main focus of Google phones right now is AI features, and that’s no different with the upcoming Pixel phones.

Thanks to its improved TPU, Tensor G5 (expected to debut in the Pixel 10 series and newer versions) will gain “Video Generative ML” capabilities. While that’s a pretty vague name, learning the intended use case explains what makes the feature a little better: “Generative AI-based intuitive post-capture video editing for the Photos app.” We can only guess what that means exactly, but it sounds like Google is making it easier for its users to edit their videos by using AI that actually understands the video. The feature may also be available in the YouTube app, particularly for YouTube Shorts.

Google is also exploring several AI features for photo editing, including “Speak-to-Tweak,” which appears to be an LLM-based editing tool, and “Sketch-to-Image,” which is self-explanatory and similar to a similar feature Samsung’s Galaxy AI offers . Additionally, there are already indications that Google is developing a sketch-to-image feature for its Gemini project.

Google is also working on a “Magic Mirror” feature, but unfortunately no additional context could be gleaned from the leaked documents. Additionally, the Tensor G5 should also be able to run Stable Diffusion-based models locally, which could be used in the Pixel Studio app instead of the current server-based solution.

Google focuses heavily on the cameras on its phones, so it’s no surprise that many of the new features are related to this area. First, Tensor G5 finally supports 4K HDR videos at 60 frames per second, whereas previous models only allowed HDR videos up to 4K and 30 frames per second.

The Pixel 11 may also offer 100x zoom capabilities through machine learning for photos and videos. However, we assume that the algorithms used in each case will be different. Therefore, do not expect the quality to be identical across all formats. Additionally, the documents reference a “next-generation” telephoto camera that will improve this feature, suggesting that significant hardware upgrades could also be on the way.

Cinematic Blur also gets an upgrade on the Pixel 11 with support for 4K 30fps and a new “Video Relight” feature that appears to change the lighting conditions in videos. Both new functions are made possible by a “Cinematic Rendering Engine” in the chip’s image signal processor. The inclusion of the new hardware block also reduces power consumption by almost 40% when shooting video with blur.

The final and perhaps most exciting feature on the Pixel 11 is “Ultra Low Light Video,” also known as “Night Sight Video.” A feature with this name already exists, but it relies on processing in the cloud, while this feature is fully available on the device. Google has specifically mentioned that 5-10 lux is the intended lighting conditions for the feature. This is considered very dim light, similar to the illumination of a dimly lit room or the light of a cloudy sky at dusk; For example, it is comparable to the brightness of a candle standing about one meter away. The new feature will also rely on new camera hardware to achieve the intended results.

New environment features

Thanks to the integration of a new “NanoTPU” into the power-saving part of the Tensor G6, Google plans to add some ML-based always-on features to the Pixel phones. A good portion of these are health-related features, such as detection of “agonal breathing, coughing, snoring, sneezing and sleep apnea, fall detection, gait analysis and sleep stage monitoring.” There is also emergency sound event detection.

Some of the features are also for activity tracking, such as Running ML, a collection of tools for runners such as coachable pace and balance & oscillation analysis.

Pixel 11 may also offer support for more Quick Phrases, but unfortunately a list has not been provided.

What potential new features are you most excited about? Let us know in the comments below!