Elements of Information Theory by Thomas M. Cover

Description

The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and show more hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications. show less

Recommendations

The Mathematical Theory of Communication by Claude E Shannon

The Mathematical Theory of Communication

Claude E Shannon

Information Theory, Inference and Learning Algorithms by David J. C. MacKay

Information Theory, Inference and Learning Algorithms

David J. C. MacKay

The Information: A History, a Theory, a Flood by James Gleick

The Information: A History, a Theory, a Flood

James Gleick

Pattern Recognition and Machine Learning by Christopher M. Bishop

Pattern Recognition and Machine Learning

Christopher M. Bishop

An Introduction to Information Theory: Symbols, Signals, and Noise by John R. Pierce

An Introduction to Information Theory: Symbols, Signals, and Noise

John R. Pierce

Information Theory by Robert B. Ash

Information Theory

Robert B. Ash

Introduction to Algorithms by Thomas H. Cormen

Introduction to Algorithms

Thomas H. Cormen

Pattern Classification (2nd Edition) by Richard O. Duda

Pattern Classification (2nd Edition)

Richard O. Duda

The Elements of Statistical Learning: Data Mining, Inference, and Prediction by Trevor Hastie

The Elements of Statistical Learning: Data Mining, Inference, and Prediction

Trevor Hastie

Mathematical Foundations of Information Theory by A. Ya. Khinchin

Mathematical Foundations of Information Theory

A. Ya. Khinchin

Cybernetics, or, Control and Communication in the Animal and the Machine by Norbert Wiener

Cybernetics, or, Control and Communication in the Animal and the Machine

Norbert Wiener

An Introduction to Information Theory by Fazlollah M. Reza

An Introduction to Information Theory

Fazlollah M. Reza

Artificial Intelligence: A Modern Approach by Stuart J. Russell

Artificial Intelligence: A Modern Approach

Stuart J. Russell

Concrete Mathematics: A Foundation for Computer Science by Ronald L. Graham

Concrete Mathematics: A Foundation for Computer Science

Ronald L. Graham

Probability Theory: The Logic of Science by E. T. Jaynes

Probability Theory: The Logic of Science

E. T. Jaynes

Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets by Nassim Nicholas Taleb

Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets

Nassim Nicholas Taleb

The Black Swan: The Impact of the Highly Improbable by Nassim Nicholas Taleb

The Black Swan: The Impact of the Highly Improbable

Nassim Nicholas Taleb

Convex Optimization by Stephen Boyd

Convex Optimization

Stephen Boyd

Probability, Random Variables and Stochastic Processes by Athanasios Papoulis

Probability, Random Variables and Stochastic Processes

Athanasios Papoulis

Visual Explanations: Images and Quantities, Evidence and Narrative by Edward R. Tufte

Visual Explanations: Images and Quantities, Evidence and Narrative

Edward R. Tufte

Causality: Models, Reasoning, and Inference by Judea Pearl

Causality: Models, Reasoning, and Inference

Judea Pearl

Feynman Lectures on Computation by Richard Feynman

Feynman Lectures on Computation

Richard Feynman

Quantum Computation and Quantum Information by Michael A. Nielsen

Quantum Computation and Quantum Information

Michael A. Nielsen

The Visual Display of Quantitative Information by Edward R. Tufte

The Visual Display of Quantitative Information

Edward R. Tufte

Introduction to the Theory of Computation by Michael Sipser

Introduction to the Theory of Computation

Michael Sipser

Matrix Computations by Gene H. Golub

Matrix Computations

Gene H. Golub

The Social Life of Information by John Seely Brown

The Social Life of Information

John Seely Brown

Signals and Systems by Alan V. Oppenheim

Signals and Systems

Alan V. Oppenheim

Discrete-Time Signal Processing by Alan V. Oppenheim

Discrete-Time Signal Processing

Alan V. Oppenheim

An Introduction to Kolmogorov Complexity and Its Applications by Ming Li

An Introduction to Kolmogorov Complexity and Its Applications

Ming Li

Structure and Interpretation of Computer Programs by Harold Abelson

Structure and Interpretation of Computer Programs

Harold Abelson

Complexity : A Guided Tour by Melanie Mitchell

Complexity : A Guided Tour

Melanie Mitchell

Dynamics of Complex Systems by Yaneer Bar-Yam

Dynamics of Complex Systems

Yaneer Bar-Yam

Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering by Steven H. Strogatz

Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering

Steven H. Strogatz

An Introduction to Support Vector Machines and Other Kernel-based Learning Methods by Nello Cristianini

An Introduction to Support Vector Machines and Other Kernel-based Learning Methods

Nello Cristianini

Information Theory: A Tutorial Introduction by James V. Stone

Information Theory: A Tutorial Introduction

James V. Stone

Probability and Measure by Patrick Billingsley

Probability and Measure

Patrick Billingsley

Error Control Coding (2nd Edition) by Shu Lin

Error Control Coding (2nd Edition)

Shu Lin

Foundations of Statistical Natural Language Processing by Christopher D. Manning

Foundations of Statistical Natural Language Processing

Christopher D. Manning

Numerical Recipes in C by William H. Press

Numerical Recipes in C

William H. Press

Neural Networks: A Comprehensive Foundation by Simon Haykin

Neural Networks: A Comprehensive Foundation

Simon Haykin

Digital Signal Processing: Principles, Algorithms, and Applications by John G. Proakis

Digital Signal Processing: Principles, Algorithms, and Applications

John G. Proakis

Programming the Universe: A Quantum Computer Scientist Takes on the Cosmos by Seth Lloyd

Programming the Universe: A Quantum Computer Scientist Takes on the Cosmos

Seth Lloyd

Combinatorial Optimization: Algorithms and Complexity by Christos H. Papadimitriou

Combinatorial Optimization: Algorithms and Complexity

Christos H. Papadimitriou

Information Theory and Statistics by Solomon Kullback

Information Theory and Statistics

Solomon Kullback

Introduction to Automata Theory, Languages, and Computation by John E. Hopcroft

Introduction to Automata Theory, Languages, and Computation

John E. Hopcroft

Fundamentals of Statistical Signal Processing, Volume 1: Estimation Theory by Steven M. Kay

Fundamentals of Statistical Signal Processing, Volume 1: Estimation Theory

Steven M. Kay

Digital Communications by John G. Proakis

Digital Communications

John G. Proakis

Emergence: From Chaos To Order by John H. Holland

Emergence: From Chaos To Order

John H. Holland

Information Theory and Reliable Communication by Robert G. Gallager

Information Theory and Reliable Communication

Robert G. Gallager

Complete Recommendations

Member Reviews

Featured Recent Thumbs

All Ratings
11
9
½3
1

1 review

billmcn 183 reviews

I do research in statistical natural language processing and use this as my primary reference about information theory. Well-written, thorough, and accessible to anyone with a foundation in probability. The first three chapters alone are worth the price of the book.

May 16, 2007