Towards perceptually realistic gaze-contingent virtual and augmented reality displays

Placeholder Show Content


Virtual and augmented reality (VR/AR) display systems strive to generate perceptually realistic user experiences, that is, the ability to render digital objects that a human observer cannot distinguish from a real object. Current-generation systems have made significant progress towards this goal, however still struggle to match the spatio-temporal and depth sensing capabilities of human vision, constrained by the limited compute budgets, hardware, and transmission bandwidths of wearable computing systems. Gaze-contingent rendering and display paradigms have emerged as a promising solution. Enabled by recent developments in wearable eye tracking systems, this suite of techniques utilizes real-time eye movement sensing to adjust content to reduce bandwidth requirements or improve visual experience. In this dissertation, we introduce and evaluate several approaches that aim to create more perceptually realistic VR and AR experiences using gaze-contingent display techniques. We model both the spatio-temporal sensitivity of the human visual system and how perception is affected by the distribution of visual attention. In both cases we demonstrate that exploiting these effects could significantly improve potential bandwidth savings of existing approaches. Next, we demonstrate how these bandwidth savings are directly dependent on the latency of the gaze-contingent display system, showing that reducing the latency of current generation systems could enable up to double the bandwidth savings. Finally, we describe how gaze-contingent stereoscopic rendering can improve the accuracy of disparity and depth rendering, including improving shape distortion in VR and alignment of physical and digitally rendering objects in AR.


Type of resource text
Form electronic resource; remote; computer; online resource
Extent 1 online resource.
Place California
Place [Stanford, California]
Publisher [Stanford University]
Copyright date 2023; ©2023
Publication date 2023; 2023
Issuance monographic
Language English


Author Krajancich, Brooke Lee
Degree supervisor Wetzstein, Gordon
Thesis advisor Wetzstein, Gordon
Thesis advisor Horowitz, Mark (Mark Alan)
Thesis advisor Kellnhofer, Petr
Degree committee member Horowitz, Mark (Mark Alan)
Degree committee member Kellnhofer, Petr
Associated with Stanford University, School of Engineering
Associated with Stanford University, Department of Electrical Engineering


Genre Theses
Genre Text

Bibliographic information

Statement of responsibility Brooke Krajancich.
Note Submitted to the Department of Electrical Engineering.
Thesis Thesis Ph.D. Stanford University 2023.

Access conditions

© 2023 by Brooke Lee Krajancich
This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).

Also listed in

Loading usage metrics...