Pixel 11 Pro Fold transcribes American Sign Language into text using camera

Google unveiled the Pixel 11 Pro Fold today, featuring a groundbreaking capability that transcribes American Sign Language (ASL) into text. This innovation aims to enhance communication for ASL users by using the phone's camera to recognize gestures and convert them into readable text on the screen. The device also boasts a sleek design and a new 48MP camera, but the sign language feature stands out as a significant development in accessibility technology.

The introduction of this feature comes at a time when the tech industry is increasingly focusing on inclusivity. The Pixel 11 Pro Fold is part of a broader push to make technology more accessible to individuals with disabilities. By enabling real-time transcription of ASL, Google addresses a critical communication barrier, allowing users to interact more easily with those who do not know sign language. This feature is especially pertinent as society becomes more aware of the importance of inclusivity in technology.

To use the ASL transcription feature, users simply open the Translate app and select the sign language option in the Gboard toolbar. The phone's front camera captures the user's signs, displaying the transcribed text on both the main and cover screens to facilitate conversation. Google’s new sign-language-to-text (SL2T) model underpins this functionality, having been trained on over 100,000 hours of sign language data across more than 50 languages, with a significant focus on ASL. This sophisticated model interprets various physical movements, ensuring that the meaning of the signs is accurately conveyed.

Currently, the ASL transcription capability is available on the Pixel 11 series in select countries, with plans for expansion to more devices and additional languages in the future. The Pixel 11 Pro Fold is priced at $1,899 and is available for pre-order now, with general sales starting on August 20. This device not only represents a leap in smartphone technology but also emphasizes Google’s commitment to developing tools that empower all users, regardless of their communication needs.