Towards perceptually realistic gaze-contingent virtual and augmented reality displays
Abstract/Contents
- Abstract
- Virtual and augmented reality (VR/AR) display systems strive to generate perceptually realistic user experiences, that is, the ability to render digital objects that a human observer cannot distinguish from a real object. Current-generation systems have made significant progress towards this goal, however still struggle to match the spatio-temporal and depth sensing capabilities of human vision, constrained by the limited compute budgets, hardware, and transmission bandwidths of wearable computing systems. Gaze-contingent rendering and display paradigms have emerged as a promising solution. Enabled by recent developments in wearable eye tracking systems, this suite of techniques utilizes real-time eye movement sensing to adjust content to reduce bandwidth requirements or improve visual experience. In this dissertation, we introduce and evaluate several approaches that aim to create more perceptually realistic VR and AR experiences using gaze-contingent display techniques. We model both the spatio-temporal sensitivity of the human visual system and how perception is affected by the distribution of visual attention. In both cases we demonstrate that exploiting these effects could significantly improve potential bandwidth savings of existing approaches. Next, we demonstrate how these bandwidth savings are directly dependent on the latency of the gaze-contingent display system, showing that reducing the latency of current generation systems could enable up to double the bandwidth savings. Finally, we describe how gaze-contingent stereoscopic rendering can improve the accuracy of disparity and depth rendering, including improving shape distortion in VR and alignment of physical and digitally rendering objects in AR.
Description
| Type of resource | text |
|---|---|
| Form | electronic resource; remote; computer; online resource |
| Extent | 1 online resource. |
| Place | California |
| Place | [Stanford, California] |
| Publisher | [Stanford University] |
| Copyright date | 2023; ©2023 |
| Publication date | 2023; 2023 |
| Issuance | monographic |
| Language | English |
Creators/Contributors
| Author | Krajancich, Brooke Lee |
|---|---|
| Degree supervisor | Wetzstein, Gordon |
| Thesis advisor | Wetzstein, Gordon |
| Thesis advisor | Horowitz, Mark (Mark Alan) |
| Thesis advisor | Kellnhofer, Petr |
| Degree committee member | Horowitz, Mark (Mark Alan) |
| Degree committee member | Kellnhofer, Petr |
| Associated with | Stanford University, School of Engineering |
| Associated with | Stanford University, Department of Electrical Engineering |
Subjects
| Genre | Theses |
|---|---|
| Genre | Text |
Bibliographic information
| Statement of responsibility | Brooke Krajancich. |
|---|---|
| Note | Submitted to the Department of Electrical Engineering. |
| Thesis | Thesis Ph.D. Stanford University 2023. |
| Location | https://purl.stanford.edu/rz967qs1167 |
Access conditions
- Copyright
- © 2023 by Brooke Lee Krajancich
- License
- This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).
Also listed in
Loading usage metrics...