Sparsity and shrinkage in predictive density estimation

Placeholder Show Content

Abstract/Contents

Abstract
We develop new perspectives on the roles of sparsity and shrinkage in predictive density estimation under Kullback-Leibler loss. Our results explain and extend some recently observed information theoretic connections between predictive density estimation and the well-studied normal mean estimation problem. We find new phenomena in sparse minimax prediction which contrast with point estimation theory results and are explained by the new notion of risk diversification. We generalize these new uncertainty sharing ideas to address the nature of optimal shrinkage over unconstrained parameter spaces. Our density estimates can be used to construct competitively optimal probability forecasts and our results give some theoretical support to log-optimality based forecasting techniques used in the fields of weather forecasting, financial investments and sports betting. Motivational stories and examples from the world of sports, stock markets and wind speed profiles are used to suggest the scope of the theory developed in this thesis.

Description

Type of resource text
Form electronic; electronic resource; remote
Extent 1 online resource.
Publication date 2013
Issuance monographic
Language English

Creators/Contributors

Associated with Mukherjee, Gourab
Associated with Stanford University, Department of Statistics.
Primary advisor Johnstone, Iain
Thesis advisor Johnstone, Iain
Thesis advisor Diaconis, Persi
Thesis advisor Donoho, David Leigh
Advisor Diaconis, Persi
Advisor Donoho, David Leigh

Subjects

Genre Theses

Bibliographic information

Statement of responsibility Gourab Mukherjee.
Note Submitted to the Department of Statistics.
Thesis Thesis (Ph.D.)--Stanford University, 2013.
Location electronic resource

Access conditions

Copyright
© 2013 by Gourab Mukherjee
License
This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).

Also listed in

Loading usage metrics...