Data for "Prevalence of Neural Collapse during the terminal phase of deep learning training" (PNAS 2020) and "Neural Collapse under MSE loss: proximity to and dynamics on the central path" (ICLR 2022)

Placeholder Show Content

Abstract/Contents

Abstract

Contains the data used to generate plots in "Prevalence of Neural Collapse during the terminal phase of deep learning training" by Papyan, Han, and Donoho in PNAS 2020; and "Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path" by Han, Papyan, and Donoho in ICLR 2022.

Using Tableau Desktop (free for academics), one can open the plots by simply opening the pre-packaged Tableau file (.tbx). The raw data is in the corresponding CSVs. Also, contains the .gif used to generate Figure 1 of the paper.

Description

Type of resource Dataset
Date created [ca. 2020 - 2022]
Date modified February 7, 2022; December 5, 2022
Publication date September 29, 2020

Creators/Contributors

Author Han, X.Y.
Author Papyan, Vardan
Author Donoho, David L.

Subjects

Subject Statistics Department
Subject Stanford School of Arts and Sciences
Subject Machine learning
Subject Deep learning
Subject Adversarial robustness
Subject Simplex Equiangular Tight Frame
Subject Nearest Class Center
Subject Inductive bias
Subject MSE Loss
Subject Cross-entropy Loss
Subject Central Path
Genre Data
Genre Data sets
Genre Dataset

Bibliographic information

Related item
Location https://purl.stanford.edu/ng812mz4543

Access conditions

Use and reproduction
User agrees that, where applicable, content will not be used to identify or to otherwise infringe the privacy or confidentiality rights of individuals. Content distributed via the Stanford Digital Repository may be subject to additional license and use restrictions applied by the depositor.
License
This work is licensed under a Creative Commons Attribution Non Commercial No Derivatives 4.0 International license (CC BY-NC-ND).

Preferred citation

Preferred citation
Han, X. Y. and Papyan, Vardan and Donoho, David L. (2020). Data for "Prevalence of Neural Collapse during the terminal phase of deep learning training" and "Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path". Stanford Digital Repository. Available at: https://purl.stanford.edu/ng812mz4543

Collection

Contact information

Also listed in

Loading usage metrics...