Meta applies for a patent that replicates Apple Vision Pro's EyeSight feature

Meta has filed a patent for a method of reproducing Vision Pro's EyeSight feature in its own virtual reality headsets. This feature uses a scan of the user's face to create a virtual image of their eyes on an external display, which, according to the developers, helps to maintain a connection with the real world while using VR.

Here's What We Know

Although Meta is looking to improve its Quest headsets with EyeSight, it is important to note that the option from Vision Pro received mixed reviews upon its release. Many reviewers criticised the feature, claiming that it did not meet expectations and made the headset design cumbersome.

Meta's patent, officially titled "Embedded sensors in an immersive headset for social presence," describes methods for implementing such a feature. It also discusses the possible retrofitting of existing Quest headsets or the development of a new design to support this technology.

Unlike EyeSight, the Meta patent mentions health sensors that could be integrated into the headset interface.

Here's How It Works

The Meta patent describes a method for updating a user's avatar in real time based on their facial expressions. This is achieved by using sensors on the headset's front interface that track facial muscle movements. A machine learning algorithm then uses this data to determine facial expressions and update the avatar accordingly.

Some additional details from the Meta:

• The headset will include various sensors, such as ECG, EEG, and PPG sensors, to assess the user's cardiovascular health.
• A machine learning algorithm will be trained on a huge dataset of face images and their corresponding expressions.
• The user's avatar will be displayed in virtual reality applications hosted on remote servers.

Source: 9to5Mac