Novelty, Information and Surprise

The book offers a new approach to information theory that is more general then the classical approach by Shannon. The classical definition of information is given for an alphabet of symbols or for a set of mutually exclusive propositions (a partition of the probability space Ω) with corresponding pr...

Full description

Bibliographic Details
Main Author: Palm, Günther
Format: eBook
Language:English
Published: Berlin, Heidelberg Springer Berlin Heidelberg 2012, 2012
Edition:1st ed. 2012
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 03391nmm a2200385 u 4500
001 EB000389026
003 EBX01000000000000000242079
005 00000000000000.0
007 cr|||||||||||||||||||||
008 130626 ||| eng
020 |a 9783642290756 
100 1 |a Palm, Günther 
245 0 0 |a Novelty, Information and Surprise  |h Elektronische Ressource  |c by Günther Palm 
250 |a 1st ed. 2012 
260 |a Berlin, Heidelberg  |b Springer Berlin Heidelberg  |c 2012, 2012 
300 |a XXIV, 248 p  |b online resource 
505 0 |a Part I Surprise and Information of Descriptions: Prerequisites -- Improbability and Novelty of Descriptions -- Conditional Novelty and Information -- Part II Coding and Information Transmission: On Guessing and Coding -- Information Transmission -- Part III Information Rate and Channel Capacity: Stationary Processes and Information Rate -- Channel Capacity -- Shannon's Theorem -- Part IV Repertoires and Covers: Repertoires and Descriptions -- Novelty, Information and Surprise of Repertoires -- Conditioning, Mutual Information and Information Gain -- Part V Information, Novelty and Surprise in Science: Information, Novelty and Surprise in Brain Theory -- Surprise from Repetitions and Combination of Surprises -- Entropy in Physics --  Part VI Generalized Information Theory: Order- and Lattice-Structures --  Three Orderings on Repertoires -- Information Theory on Lattices of Covers --  Appendices:  A. Fuzzy Repertoires and Descriptions -- A.1 Basic Definitions --  A.2 Definition and Properties of Fuzzy Repertoires -- Glossary -- Bibliography -- Index 
653 |a Neuroscience 
653 |a Neurosciences 
653 |a Computer science / Mathematics 
653 |a Mathematical and Computational Biology 
653 |a Artificial Intelligence 
653 |a Mathematical Applications in Computer Science 
653 |a Biomathematics 
653 |a Algebra 
653 |a Artificial intelligence 
653 |a Order, Lattices, Ordered Algebraic Structures 
653 |a Automated Pattern Recognition 
653 |a Pattern recognition systems 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
028 5 0 |a 10.1007/978-3-642-29075-6 
856 4 0 |u https://doi.org/10.1007/978-3-642-29075-6?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 004.0151 
520 |a The book offers a new approach to information theory that is more general then the classical approach by Shannon. The classical definition of information is given for an alphabet of symbols or for a set of mutually exclusive propositions (a partition of the probability space Ω) with corresponding probabilities adding up to 1. The new definition is given for an arbitrary cover of Ω, i.e. for a set of possibly overlapping propositions. The generalized information concept is called novelty and it is accompanied by two new concepts derived from it, designated as information and surprise, which describe "opposite" versions of novelty, information being related more to classical information theory and surprise being related more to the classical concept of statistical significance. In the discussion of these three concepts and their interrelations several properties or classes of covers are defined, which turn out to be lattices. The book also presents applications of these new concepts, mostly in statistics and in neuroscience