That’s right. We’re collaborating with Starbreeze Studios to optimize our leading eye tracking technology for VR.

This project aims to integrate Tobii’s technology into their StarVR head-mounted display (HMD). In simple benefit terms this means that integrated eye tracking helps to bring you awesome 5k graphics without compromising on performance. “VR is all about experience. When that experience is inhibited by the ability to render realistic and immersive environments, it’s a roadblock to creating world-class content and experiences our customers love and consistently expect us to deliver,” said Emmanuel Marquez, CTO of Starbreeze AB.

“Partnering with Tobii, the undisputed leader in eye tracking, allows us to solve this limitation, benefitting the VR industry as a whole, while also allowing us to deliver the highest-quality and most immersive film and gaming content ever experienced.” -Emmanuel Marquez, CTO of Starbreeze AB

Foveated Rendering

With integrated Tobii eye tracking, StarVR can use foveated rendering (Gaze Prioritized Graphics), also known as computational graphics, to display the highest resolution graphics specifically in the region the user is currently looking, while simultaneously displaying lower resolution graphics to areas on the screen in the user’s peripheral vision.

This functionality requires extremely fast, robust and accurate eye tracking in order to effectively bridge the communication gap between the user’s eye movement and the content’s current display within the HMD. With this optimization, both of StarVR’s 2650×1440 pixel screens can use significantly less bandwidth from the CPU and GPU without sacrificing highly-detailed and realistic environments for the user in crisp, brilliant 5K resolution.


Enhanced VR Experience for Gaming and more

That’s not all though, Tobii and Starbreeze intend to enhance the VR experience in other ways as well. Examples include:

Personalized “Choose Your Own Adventure” Movies and Games – Content that unfolds and ends differently based on where the user pays their attention throughout the storyline, creating entirely unique experiences while building in repeat-use value for consumers and even replicating real world experiences.

Accurate 3D Stereoscopic Rendering – Eye-tracking calibration within the device ensures consistent quality experiences among different users and that every user’s unique eye structure is accommodated for in order to properly deliver high quality graphics.

Gaming Immersion – this functionality harnesses natural eye movement to make environment and characters more realistic and interactive in games:

  • Natural Targeting – To pick up or throw an object, users will now only need to look at the object to interact with it rather than gesture with a head movement or physically motion their forehead towards the object to interact. This interaction is natural, intuitive and seamless because it so closely mimics real life interaction.
  • Eye Contact – This fundamental non-verbal communication is critical to our interaction with others in the real world. Bringing the same principle to character interaction in a VR film or game makes users even more deeply immersed. Characters are able to come to life and interact or ignore users based on eye contact.
  • Immersive Graphics and Sound – To create emotive reactions from users it is critical to know where they are paying attention. For example, to create a scary or surprising environment, sounds and characters may appear from where users are not currently looking. In contrast, users can also be calmed when graphical objects are presented in areas that are expected and feel natural to the user.