This is an initial prototype for TangibleMoments, a framework we proposed which enables users to embed XR memories onto physical objects. It works on the Meta Quest 3 headset, and the Meta Quest 3s (untested). The prototype scans a QR code sticker which can be placed on any physical object, then displays a preview of an XR memory. Upon pressing the Immerse! button, users are immersed in the memory (in this case, a LiDAR scan of a room).
You can demo this prototype on your own Quest 3 or Quest 3s headset: Download APK.
Install to your Quest using SideQuest or Android's adb.
Upon launching the application and allowing it to access your display, look at the QR code provided below through the headset.
The application will recognize the QR code and display a preview of the XR memory associated with it. Touch the Immerse! button with your controller to enter VR and experience the memory with 6 degrees of freedom.
- Currently, this prototype is limited only to Recalling Moments. We have yet to implement the remaining processes we described as part of the TangibleMoments framework: Creating Moments, Sharing Moments, Copying Moments, and Clearing Moments.
- At the time of developing this, Meta has not yet released camera API access to Quest developers. We are using the Android display API as a workaround. This causes the QR code to be unreadable if there is virtual content covering it. Camera API access should be used once it is available to Quest developers.
- Since this is a proof-of-concept, we are currently using QR codes to link memories to physical objects. In the future, custom computer vision models will be used to recognize objects which are associated with XR memories, without QR codes needing to be involved.
- We have not yet provided a way to exit out of the XR memory once immersed.