Building and evaluating computational models of the mammalian visual system

Placeholder Show Content

Abstract/Contents

Abstract
Animals continuously and dynamically process sensory information in service of both flexible and inflexible behaviours. To understand the brain's complex information-processing pipeline by which such behaviours arise, we must first understand how the brain transforms sensory information from its raw form. This will then allow us determine what information is accessible downstream in the process. In this dissertation, we try to understand how the brain processes visual information, which entails building and evaluating computational models that can predict how the animal will respond to novel visual inputs. We focus on a class of models known as convolutional neural networks (CNNs) and demonstrate ways in which they can be evaluated against and be built for primates and for rodents to better understand how the mammalian visual system supports behaviour. We first demonstrate a time-resolved correspondence between a feedforward CNN and whole-brain neural responses during human object processing and develop a data-driven optimization approach to improve upon correlations achieved between the model and the neural data. Motivated by extensive empirical work in rodents on navigational and on decision-making behaviours and by the desire to integrate models of cortical and of subcortical areas that support these behaviours, we build quantitatively accurate CNN models of the mouse visual system. Although CNNs are state-of-the-art models of primate and of rodent visual processing, they are extremely brittle. We therefore examine the nature of their brittleness and show the existence of representational differences between primary visual cortex of non-human primates and the models. Finally, we suggest that building less-brittle models will require us to incorporate the temporally-continuous nature of the visual inputs that animals receive. Looking forward, we hope that models of sensory cortex can be integrated with computational models of downstream cortical and subcortical areas, so that we can better understand how flexible and inflexible behaviours arise.

Description

Type of resource text
Form electronic resource; remote; computer; online resource
Extent 1 online resource.
Place California
Place [Stanford, California]
Publisher [Stanford University]
Copyright date 2023; ©2023
Publication date 2023; 2023
Issuance monographic
Language English

Creators/Contributors

Author Kong, Nathan Cheuck Lam
Degree supervisor Norcia, Anthony Matthew
Thesis advisor Norcia, Anthony Matthew
Thesis advisor Gardner, Justin, 1971-
Thesis advisor Grill-Spector, Kalanit
Thesis advisor Yamins, Daniel
Degree committee member Gardner, Justin, 1971-
Degree committee member Grill-Spector, Kalanit
Degree committee member Yamins, Daniel
Associated with Stanford University, School of Humanities and Sciences
Associated with Stanford University, Department of Psychology

Subjects

Genre Theses
Genre Text

Bibliographic information

Statement of responsibility Nathan C. L. Kong.
Note Submitted to the Department of Psychology.
Thesis Thesis Ph.D. Stanford University 2023.
Location https://purl.stanford.edu/qk198bh1136

Access conditions

Copyright
© 2023 by Nathan Cheuck Lam Kong
License
This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).

Also listed in

Loading usage metrics...