Google to allow Android XR users' cameras to be used in VR apps
Google is actively developing its Android XR platform designed for virtual and mixed reality headsets. It was first announced in December last year, and shortly afterwards, Samsung presented a prototype headset called Project Moohan.
Here's What We Know
Android XR is expected to be commercially launched in 2025, along with a headset from Samsung and smart glasses developed by DeepMind.
Recent leaks suggest that Android XR will feature a camera access permission system similar to that used in Android smartphones. Developer Anthony Vittilo (Skarred Ghost) asked Google whether developers would be able to access the cameras of headsets on Android XR. A company representative replied that "just like any Android app, a developer can use existing camera footage with user permission for XR".
This means that applications will be able to access the main camera, which is aimed at the outside world, as well as the front camera, which captures the user's face. By comparison, devices like the Meta Quest 3 and Apple Vision Pro do not yet allow third-party developers to work directly with cameras.
Android XR will also provide the ability to receive a video stream from the environment, which will allow headsets such as Project Moohan to analyse the room space and adjust the mixed reality experience to the environment. Developers will be able to use this data to create a more realistic XR experience.
According to the Android Developers website, developers will be able to request access to "scene understanding" to use the technology, for example, to assess lighting or ray tracing. It will also be possible to receive data on the position of hands in space.
Like other VR/XR headsets, Android XR devices will support basic gesture control: pinch, tap, point, and capture. Google is expected to provide more details about its platform in the coming weeks.
Source: Android Central
