Information theory is the mathematical study of the quantification, storage, and communication of information. The field was established and formalized...

In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential...

Integrated information theory (IIT) proposes a mathematical model for the consciousness of a system. It comprises a framework ultimately intended to explain...

in information theory are mutual information, channel capacity, error exponents, and relative entropy. Important sub-fields of information theory include...

The receiver in information theory is the receiving end of a communication channel. It receives decoded messages/information from the sender, who first...

Structural information theory (SIT) is a theory about human perception and in particular about visual perceptual organization, which is a neuro-cognitive...

Quantum information is the information of the state of a quantum system. It is the basic entity of study in quantum information theory, and can be manipulated...

discusses how information theory (a branch of mathematics studying the transmission, processing and storage of information) is related to measure theory (a branch...

information theory (AIT) is a branch of theoretical computer science that concerns itself with the relationship between computation and information of...

subsequent leaks. Beyond applications to programming language, information flow control theories have been applied to operating systems, distributed systems...

In information theory, redundancy measures the fractional difference between the entropy H(X) of an ensemble X, and its maximum possible value log ⁡ (...

inventor, known as the "father of information theory" and credited with laying the foundations of the Information Age. Shannon was the first to describe...

Organizational Information Theory (OIT) is a communication theory, developed by Karl Weick, offering systemic insight into the processing and exchange...

might be thought of as gambling theory applied to the world around us. The myriad applications for logarithmic information measures tell us precisely how...

This is a list of information theory topics. A Mathematical Theory of Communication algorithmic information theory arithmetic coding channel capacity Communication...

Because the mathematical expressions for information theory developed by Claude Shannon and Ralph Hartley in the 1940s are similar to the mathematics of...

The pragmatic theory of information is derived from Charles Sanders Peirce's general theory of signs and inquiry. Peirce explored a number of ideas about...

In probability theory and information theory, the mutual information (MI) of two random variables is a measure of the mutual dependence between the two...

laws to be expressed, such as the constructor theory of information. The fundamental elements of the theory are tasks: the abstract specifications of transformations...

In information theory, the conditional entropy quantifies the amount of information needed to describe the outcome of a random variable Y {\displaystyle...

Information processing theory is the approach to the study of cognitive development evolved out of the American experimental tradition in psychology....

Information Manipulation Theory (abbreviated IMT) is a theory of deceptive discourse production, rooted in H. Paul Grice's theory of conversational implicature...

on Information Theory is a monthly peer-reviewed scientific journal published by the IEEE Information Theory Society. It covers information theory and...

Information field theory (IFT) is a Bayesian statistical field theory relating to signal reconstruction, cosmography, and other related areas. IFT summarizes...

information theory, and brought it to immediate worldwide attention, was the publication of Claude E. Shannon's classic paper "A Mathematical Theory of...

interrelate the theory of the organism, thermodynamics, and evolutionary theory. This concept was expanded upon with the advent of information theory and subsequently...

In coding theory and information theory, a Z-channel or binary asymmetric channel is a communications channel used to model the behaviour of some data...

quantum computation, automata theory, information theory, cryptography, program semantics and verification, algorithmic game theory, machine learning, computational...

or the expected value of the observed information. The role of the Fisher information in the asymptotic theory of maximum-likelihood estimation was emphasized...

distance away can interpret the flags and reproduce the words sent. In information theory and computer science, a code is usually considered as an algorithm...