information theory

Table of Contents

Introduction
Historical background
Classical information theory
- Shannon’s communication model
- Four types of communication
  - Discrete, noiseless communication and the concept of entropy
    - From message alphabet to signal alphabet
    - Some practical encoding/decoding questions
    - Entropy
  - Discrete, noisy communication and the problem of error
  - Continuous communication and the problem of bandwidth
Applications of information theory
- Data compression
- Error-correcting and error-detecting codes
- Cryptology
- Linguistics
- Algorithmic information theory
- Physiology
- Physics

References & Edit History Quick Facts & Related Topics

Images

Shannon's communication model

binary symmetric channel

Fourier analysis

communication: noise

For Students

information theory summary

Discover

Data analysis of the Super Bowl's "winningest" teams, game locations, MVP winners by position, teams with the most game losses. football, sports, infographic

From Sport to Spectacle: The History of the Super Bowl

Ice Sledge Hockey, Hockey Canada Cup, USA (left) vs Canada, 2009. UBC Thunderbird Arena, Vancouver, BC, competition site for Olympic ice hockey and Paralympic ice sledge hockey. Vancouver 2010 Olympic and Paralympic Winter Games, Vancouver Olympics

10 Best Hockey Players of All Time

African Americans demonstrating for voting rights in front of the White House as police and others watch, March 12, 1965. One sign reads, "We demand the right to vote everywhere." Voting Rights Act, civil rights.

Timeline of the American Civil Rights Movement

January 21, 2019: Superbowl LIII will be played at Atlanta's Mercedes-Benz Stadium on Sunday, February 3, 2019 against the New England Patriots and the Los Angeles Rams.

What Was the Super Bowl’s First Blockbuster Commercial?

Shah Jahan. Taj Mahal. Mughal architecture. Emperor Shah Jahan fifth Mughal Emperor (reigned 1628-1658) India, Himachal Pradesh, Basohli or Jammu and Kashmir, Mankot, circa 1690 Drawings; Opaque watercolor, gold, and ink on paper (see notes)

6 Important Mughal Emperors

Sailboat against a beautiful landscape

Which Waters Do You Pass Through When You “Sail the Seven Seas”?

Young boys working in a thread spinning mill in Macon, Georgia, 1909. Boys are so small they have to climb onto the spinning frame to reach and fix broken threads and put back empty bobbins. Child labor. Industrial revolution

The Rise of the Machines: Pros and Cons of the Industrial Revolution

information theory: Facts & Related Content

Written and fact-checked by The Information Architects of Encyclopaedia Britannica

Facts

Also Known As	communication theory

Photos

Shannon's communication model

binary symmetric channel

Fourier analysis

communication: noise

See All Images →

Topics

negative entropy redundancy information processor entropy Shannon-Weaver information theory cryptology information processing communication cybernetics information analysis probability theory computer science combinatorics algebra statistics geometry automata theory set theory trigonometry

Dig Deeper: More Articles That Discuss This Topic

Key People

Claude Shannon

American engineer

Harry Nyquist

American physicist

Blackwell, David

David Blackwell

American statistician and mathematician

Quiz

Equations written on blackboard

Numbers and Mathematics