Hands Free Spatial Interaction in XR: Combining Eye & Head Movements

Apple Vision Pro cemented eye movements as one of the key user input modalities. Our team has worked in this domain for the past seven years and we are ready to share how far gaze based spatial interaction can take us. During our presentation we will demonstrate on the latest head mounted displays how users can interact with spatial content e.g. pick up, move, rotate 3D content using binocular eye vergence and head movements without using their hands or having to engage with controllers or display elements. In addition we will unveil some of our key findings and technology explaining how we integrated eyes and head movements and share how it is useful in consumer and enterprise environments.