One of the features of Android 10 was the Live Caption function – converting speech to text from almost any source, even without an Internet connection. Together with the new OS, this chip did NOT debut, but a video has already appeared on the network that clearly demonstrates its useful features.
XDA-Developers have accessed the Device Personalization Services app for Pixel 4 and launched the Live Caption feature on the Pixel 2 XL. The Live Caption icon appeared in the volume control window, but, according to testers, its display can be configured manually. Testing was conducted using the services of YouTube, Amazon Prime Video, Google Podcasts, Netflix and others.
According to the source, the function does not work when making calls, but such an opportunity in the future may appear later. Live Caption is expected to appear in the release version of the Google Pixel 4 firmware.
Thanks to the machine learning function, Live Caption can display subtitles for both online video and local video content on the device itself without an internet connection. The application works both in portrait and landscape screen orientation.
Despite the lower processor power compared to the new flagships, the Pixel 2 XL demonstrated the correct operation of the new function. Although Google has not announced a list of supported devices, it is likely that Live Caption will work even on mid-range models.