Meta's Ray-Ban Display Glasses Get Smarter: Neural Handwriting, Developer Access, and New Video Capture
Meta has rolled out a significant update for its Ray-Ban Display glasses, adding powerful new capabilities that make the smart eyewear more useful and customizable. The headline feature is the expansion of neural handwriting support to all users, allowing anyone to input text by writing in the air, which the glasses interpret using onboard machine learning. Additionally, Meta is opening up the device to third-party developers for the first time, enabling a wave of new apps and integrations. A nifty new video capture mode also lets users record a combined view of what appears on the lens display, the real world, and surrounding audio, creating an immersive storytelling tool. These updates mark a major step forward in making smart glasses a practical, everyday companion.
What are the main new features for the Ray-Ban Display glasses?
The update brings three key additions. First, neural handwriting support is now available to all users, not just a select group. This feature lets you write letters or numbers in the air with your finger, and the glasses use AI to recognize and convert them into digital text, which can be used for messages, notes, or commands. Second, Meta has opened the glasses to third-party developers, meaning external apps can now tap into the device's hardware and software capabilities, from the camera and microphone to the built-in display. Finally, a new video capture mode records a hybrid feed that combines the overlay content on the lens with the user's real-world view and ambient audio, giving a full-picture representation of an experience. Learn more about the developer access below.
How does the neural handwriting feature work on the glasses?
Neural handwriting on the Ray-Ban Display glasses uses a combination of on-device machine learning and motion tracking to interpret your finger movements as you write in the air. You simply gesture your index finger to trace characters, and the glasses' sensors capture the trajectory. A neural network processes this data in real time to recognize letters, numbers, and common symbols, then converts them into typed text. This text can populate messages, search queries, or notes that appear on the lens display or are sent to a connected phone. The system is designed to work without a paired smartphone for the recognition step, ensuring low latency. Initially limited to a test group, the feature is now being rolled out to all users globally, making it a convenient hands-free input method ideal for quick replies or jotting down ideas.
What does opening the glasses to third-party developers mean for users?
By granting third-party developers access to the Ray-Ban Display glasses' hardware and software, Meta is effectively transforming the device into a platform for innovation. Developers can now build custom apps that leverage the camera, microphone, speakers, touchpad, and the glasses' optical display. For users, this means a growing library of applications beyond Meta's built-in features: think navigation overlays from map apps, real-time translation using the camera, fitness tracking displays during workouts, or even augmented reality games. The developer toolkit (SDK) includes APIs for accessing sensor data, rendering graphics on the lens, and handling voice commands. While Meta hasn't published a timeline for specific third-party apps, early partners are expected to launch soon. This expansion mirrors the open ecosystem that made smartphones so versatile, and it could accelerate the adoption of smart glasses as everyday wearables. See how this changes the user experience.
What is the new video capture mode and how does it work?
The new video capture mode is designed to capture a complete picture of what the wearer sees and hears, including the digital overlay from the glasses' display. When you activate this mode, the glasses record video from the world-facing camera, the internal display's content, and the surrounding audio simultaneously. The result is a single video file that shows, for example, the real street scene in the background with turn-by-turn navigation arrows or notification icons superimposed on the lens. The audio track picks up both the user's voice and environmental sounds. This feature is particularly useful for content creators, vloggers, or anyone who wants to share their experience exactly as they lived it—including the digital enhancements. It effectively turns the glasses into a first-person recording tool that documents both reality and the augmented information Meta's software adds.
How do these updates change the everyday user experience?
These three updates collectively make the Ray-Ban Display glasses far more practical and engaging. Neural handwriting eliminates the need to fumble for a smartphone when composing a quick message or note—just write in the air and it's done. The opening to third-party developers promises a richer app ecosystem, so you can tailor the glasses for work, travel, or entertainment. And the new video capture makes it easy to share moments that include the useful information the glasses provide, like directions or music controls, adding a whole new dimension to social media posts or personal memories. In short, the glasses are evolving from a niche gadget with limited use-cases to a versatile computing platform that sits on your face. Explore the full list of new features.
When are these features available and for which regions?
According to the announcement from Jay Peters at The Verge referencing Meta, the neural handwriting feature is now being rolled out to all users globally—it was previously only available to a limited test group. The video capture mode is also live for all Ray-Ban Display glasses owners, accessible through a software update. As for third-party developer access, Meta has opened up the SDK and started accepting registrations from developers worldwide, so while the apps aren't here yet, the foundation is laid. Specific regional availability for some features may vary based on local regulations, but the core updates appear to be launching internationally. Owners can check for the latest firmware version in the companion app to ensure they have these capabilities.