Code and Data Supplement for "Near-optimal matrix recovery from random linear measurements"

Placeholder Show Content

Abstract/Contents

Abstract

In matrix recovery from random linear measurements, one is interested in
recovering an unknown $M$-by-$N$ matrix $X_0$ from $n<MN$ measurements
$y_i=Tr(A_i^\T X_0)$ where each $A_i$ is an $M$-by-$N$ measurement matrix with
i.i.d random entries, $i=1,\ldots,n$. We present a novel matrix recovery
algorithm, based on approximate message passing, which iteratively applies an
optimal singular value shrinker -- a nonconvex nonlinearity tailored
specifically for matrix estimation. Our algorithm often converges exponentially
fast, offering a significant speedup over previously suggested matrix recovery
algorithms, such as iterative solvers for Nuclear Norm Minimization (NNM). It
is well known that there is recovery tradeoff between the information content of
the object $X_0$ to be recovered (specifically, its matrix rank $r$) and the
number of linear measurements $n$ from which recovery is to be attempted. The
precise tradeoff between $r$ and $n$, beyond which recovery by a given algorithm
becomes possible, traces the so-called phase transition curve of that algorithm
in the $(r,n)$ plane. The phase transition curve of our algorithm is noticeably
better than that of NNM. Interestingly, it is close to the information-theoretic
lower bound for the minimal number of measurements needed for matrix recovery,
making it not only the fastest algorithm known, but also near-optimal in terms
of the matrices it successfully recovers.

Description

Type of resource software, multimedia
Date created April 1, 2017

Creators/Contributors

Author Romanov, Elad

Subjects

Subject Matrix completion
Subject approximate message passing
Subject compressed sensing
Subject singular value shrinkage
Subject nuclear norm minimization
Genre Dataset

Bibliographic information

Related Publication Romanov, Elad and Gavish, Matan. (2018). Near-optimal matrix recovery from random linear measurements. PNAS. 115(28):7200-7205. https://doi.org/10.1073/pnas.1705490115
Location https://purl.stanford.edu/rt605yk2478

Access conditions

Use and reproduction
User agrees that, where applicable, content will not be used to identify or to otherwise infringe the privacy or confidentiality rights of individuals. Content distributed via the Stanford Digital Repository may be subject to additional license and use restrictions applied by the depositor.
License
This work is licensed under a Creative Commons Attribution 3.0 Unported license (CC BY).

Preferred citation

Preferred Citation
Romanov, Elad. (2017). Code and Data Supplement for "Near-optimal matrix recovery from random linear measurements." Stanford Digital Repository. Available at: http://purl.stanford.edu/rt605yk2478

Collection

Contact information

Also listed in

Loading usage metrics...