On asymptotically optimal source coding and simulation of stationary sources

Placeholder Show Content

Abstract/Contents

Abstract
Source coding or lossy data compression has been extensively studied ever since Shan- non formally described the problem more than half of a century ago. Yet source coding schemes approaching the theoretical Shannon limit even on simple stationary sources such as IID Gaussian or IID uniform sources remain elusive. In this dissertation, both source coding and the related rate-constrained simulation problem are studied. Four necessary conditions for asymptotically optimal sliding-block or stationary codes for source coding and rate-constrained simulation are derived. The first two necessary conditions are proved for stationary ergodic sources while the remaining two necessary conditions are proved for IID sources. A new code design algorithm which attempts to satisfy all four necessary conditions is presented. The code structure has intuitive similarities to classic random coding arguments as well as to "fake process" methods and alphabet-constrained methods. Experimental results show that the new coding design algorithm provides comparable or superior performance with respect to previously published methods on common IID and autoregressive examples, often by significant margins. In many cases, such as IID Gaussian, IID uniform and discrete IID binary sources, the performance approaches the theoretical Shannon limit.

Description

Type of resource text
Form electronic; electronic resource; remote
Extent 1 online resource.
Publication date 2011
Issuance monographic
Language English

Creators/Contributors

Associated with Mao, Zhenyu
Associated with Stanford University, Department of Electrical Engineering
Primary advisor Gray, Robert M, 1943-
Thesis advisor Gray, Robert M, 1943-
Thesis advisor Gill, John
Thesis advisor Weissman, Tsachy
Advisor Gill, John
Advisor Weissman, Tsachy

Subjects

Genre Theses

Bibliographic information

Statement of responsibility Mark Zhenyu Mao.
Note Submitted to the Department of Electrical Engineering.
Thesis Thesis (Ph.D.)--Stanford University, 2011.
Location electronic resource

Access conditions

Copyright
© 2011 by Zhenyu Mao

Also listed in

Loading usage metrics...