An Information-Theoretic Approach to Neural Computing

Neural networks provide a powerful new technology to model and control nonlinear and complex systems. In this book, the authors present a detailed formulation of neural networks from the information-theoretic viewpoint. They show how this perspective provides new insights into the design theory of n...

Full description

Bibliographic Details
Main Authors: Deco, Gustavo, Obradovic, Dragan (Author)
Format: eBook
Language:English
Published: New York, NY Springer New York 1996, 1996
Edition:1st ed. 1996
Series:Perspectives in Neural Computing
Subjects:
Online Access:
Collection: Springer Book Archives -2004 - Collection details see MPG.ReNa
LEADER 02574nmm a2200289 u 4500
001 EB000619815
003 EBX01000000000000000472897
005 00000000000000.0
007 cr|||||||||||||||||||||
008 140122 ||| eng
020 |a 9781461240167 
100 1 |a Deco, Gustavo 
245 0 0 |a An Information-Theoretic Approach to Neural Computing  |h Elektronische Ressource  |c by Gustavo Deco, Dragan Obradovic 
250 |a 1st ed. 1996 
260 |a New York, NY  |b Springer New York  |c 1996, 1996 
300 |a XIV, 262 p  |b online resource 
505 0 |a 1 Introduction -- 2 Preliminaries of Information Theory and Neural Networks -- 2.1 Elements of Information Theory -- 2.2 Elements of the Theory of Neural Networks -- I: Unsupervised Learning -- 3 Linear Feature Extraction: Infomax Principle -- 4 Independent Component Analysis: General Formulation and Linear Case -- 5 Nonlinear Feature Extraction: Boolean Stochastic Networks -- 6 Nonlinear Feature Extraction: Deterministic Neural Networks -- II: Supervised Learning -- 7 Supervised Learning and Statistical Estimation -- 8 Statistical Physics Theory of Supervised Learning and Generalization -- 9 Composite Networks -- 10 Information Theory Based Regularizing Methods -- References 
653 |a Artificial Intelligence 
653 |a Artificial intelligence 
700 1 |a Obradovic, Dragan  |e [author] 
041 0 7 |a eng  |2 ISO 639-2 
989 |b SBA  |a Springer Book Archives -2004 
490 0 |a Perspectives in Neural Computing 
028 5 0 |a 10.1007/978-1-4612-4016-7 
856 4 0 |u https://doi.org/10.1007/978-1-4612-4016-7?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 006.3 
520 |a Neural networks provide a powerful new technology to model and control nonlinear and complex systems. In this book, the authors present a detailed formulation of neural networks from the information-theoretic viewpoint. They show how this perspective provides new insights into the design theory of neural networks. In particular they show how these methods may be applied to the topics of supervised and unsupervised learning including feature extraction, linear and non-linear independent component analysis, and Boltzmann machines. Readers are assumed to have a basic understanding of neural networks, but all the relevant concepts from information theory are carefully introduced and explained. Consequently, readers from several different scientific disciplines, notably cognitive scientists, engineers, physicists, statisticians, and computer scientists, will find this to be a very valuable introduction to this topic