Correlative Learning: A Basis for Brain and Adaptive Systems / Edition 1

Hardcover (Print)
Buy New
Buy New from BN.com
$140.34
Used and New from Other Sellers
Used and New from Other Sellers
from $87.95
Usually ships in 1-2 business days
(Save 47%)
Other sellers (Hardcover)
  • All (7) from $87.95   
  • New (5) from $133.58   
  • Used (2) from $87.95   

Overview

Correlative Learning: A Basis for Brain and Adaptive Systems provides a bridge between three disciplines: computational neuroscience, neural networks, and signal processing. First, the authors lay down the preliminary neuroscience background for engineers. The book also presents an overview of the role of correlation in the human brain as well as in the adaptive signal processing world; unifies many well-established synaptic adaptations (learning) rules within the correlation-based learning framework, focusing on a particular correlative learning paradigm, ALOPEX; and presents case studies that illustrate how to use different computational tools and ALOPEX to help readers understand certain brain functions or fit specific engineering applications.

Read More Show Less

Product Details

Meet the Author

Zhe Chen, PhD, is currently a Research Fellow in the Neuroscience Statistics Research Laboratory at Harvard Medical School.

Simon Haykin, PhD, DSc, is a Distinguished University Professor in the Department of Electrical and Computer Engineering at McMaster University, Ontario, Canada.

Jos J. Eggermont, PhD, is a Professor in the Departments of Physiology & Biophysics and Psychology at the University of Calgary, Alberta, Canada.

Suzanna Becker, PhD, is a Professor in the Department of Psychology, Neuroscience, and Behavior at McMaster University, Ontario, Canada.

Read More Show Less

Table of Contents

Foreword.

Preface.

Acknowledgments.

Acronyms.

Introduction.

1. The Correlative Brain.

1.1 Background.

1.1.1 Spiking Neurons.

1.1.2 Neocortex.

1.1.3 Receptive fields.

1.1.4 Thalamus.

1.1.5 Hippocampus.

1.2 Correlation Detection in Single Neurons.

1.3 Correlation in Ensembles of Neurons: Synchrony and Population Coding.

1.4 Correlation is the Basis of Novelty Detection and Learning.

1.5 Correlation in Sensory Systems: Coding, Perception, and Development.

1.6 Correlation in Memory Systems.

1.7 Correlation in Sensory-Motor Learning.

1.8 Correlation, Feature Binding, and Attention.

1.9 Correlation and Cortical Map Changes after Peripheral Lesions and Brain Stimulation.

1.10 Discussion.

2. Correlation in Signal Processing.

2.1 Correlation and Spectrum Analysis.

2.1.1 Stationary Process.

2.1.2 Non-stationary Process.

2.1.3 Locally Stationary Process.

2.1.4 Cyclostationary Process.

2.1.5 Hilbert Spectrum Analysis.

2.1.6 Higher Order Correlation-based Bispectra Analysis.

2.1.7 Higher Order Functions of Time, Frequency, Lag, and Doppler.

2.1.8 Spectrum Analysis of Random Point Process.

2.2 Wiener Filter.

2.3 Least-Mean-Square Filter.

2.4 Recursive Least-Squares Filter.

2.5 Matched Filter.

2.6 Higher Order Correlation-Based Filtering.

2.7 Correlation Detector.

2.7.1 Coherent Detection.

2.7.2 Correlation Filter for Spatial Target Detection.

2.8 Correlation Method for Time-Delay Estimation.

2.9 Correlation-Based Statistical Analysis.

2.9.1 Principal Component Analysis.

2.9.2 Factor Analysis.

2.9.3 Canonical Correlation Analysis.

2.9.4 Fisher Linear Discriminant Analysis.

2.9.5 Common Spatial Pattern Analysis.

2.10 Discussion.

Appendix: Eigenanalysis of Autocorrelation Function of Nonstationary Process.

Appendix: Estimation of the Intensity and Correlation Functions of Stationary Random Point Process.

Appendix: Derivation of Learning Rules with Quasi-Newton Method.

3. Correlation-Based Neural Learning and Machine Learning.

3.1 Correlation as a Mathematical Basis for Learning.

3.1.1 Hebbian and Anti-Hebbian Rules (Revisited).

3.1.2 Covariance Rule.

3.1.3 Grossberg’s Gated Steepest Descent.

3.1.4 Competitive Learning Rule.

3.1.5 BCM Learning Rule.

3.1.6 Local PCA Learning Rule.

3.1.7 Generalizations of PCA Learning.

3.1.8 CCA Learning Rule.

3.1.9 Wake-Sleep Learning Rule for Factor Analysis.

3.1.10 Boltzmann Learning Rule.

3.1.11 Perceptron Rule and Error-Correcting Learning Rule.

3.1.12 Differential Hebbian Rule and Temporal Hebbian Learning.

3.1.13 Temporal Difference and Reinforcement Learning.

3.1.14 General Correlative Learning and Potential Function.

3.2 Information-Theoretic Learning.

3.2.1 Mutual Information vs. Correlation.

3.2.2 Barlow’s Postulate.

3.2.3 Hebbian Learning and Maximum Entropy.

3.2.4 Imax Algorithm.

3.2.5 Local Decorrelative Learning.

3.2.6 Blind Source Separation.

3.2.7 Independent Component Analysis.

3.2.8 Slow Feature Analysis.

3.2.9 Energy-Efficient Hebbian Learning.

3.2.10 Discussion.

3.3 Correlation-Based Computational Neural Models.

3.3.1 Correlation Matrix Memory.

3.3.2 Hopfield Network.

3.3.3 Brain-State-in-a-Box Model.

3.3.4 Autoencoder Network.

3.3.5 Novelty Filter.

3.3.6 Neuronal Synchrony and Binding.

3.3.7 Oscillatory Correlation.

3.3.8 Modeling Auditory Functions.

3.3.9 Correlations in the Olfactory System.

3.3.10 Correlations in the Visual System.

3.3.11 Elastic Net.

3.3.12 CMAC and Motor Learning.

3.3.13 Summarizing Remarks.

Appendix: Mathematical Analysis of Hebbian Learning.

Appendix: Necessity and Convergence of Anti-Hebbian Learning.

Appendix: Link Between the Hebbian Rule and Gradient Descent.

Appendix: Reconstruction Error in Linear and Quadratic PCA.

4. Correlation-Based Kernel Learning.

4.1 Background.

4.2 Kernel PCA and Kernelized GHA.

4.3 Kernel CCA and Kernel ICA.

4.4 Kernel Principal Angles.

4.5 Kernel Discriminant Analysis.

4.6 KernelWiener Filter.

4.7 Kernel-Based Correlation Analysis: Generalized Correlation Function and Correntropy.

4.8 Kernel Matched Filter.

4.9 Discussion.

5. Correlative Learning in a Complex-Valued Domain.

5.1 Preliminaries.

5.2 Complex-Valued Extensions of Correlation-Based Learning.

5.2.1 Complex-Valued Associative Memory.

5.2.2 Complex-Valued Boltzmann Machine.

5.2.3 Complex-Valued LMS Rule.

5.2.4 Complex-Valued PCA Learning.

5.2.5 Complex-Valued ICA Learning.

5.2.6 Constant Modulus Algorithm.

5.3 Kernel Methods for Complex-Valued Data.

5.3.1 Reproducing Kernels in the Complex Domain.

5.3.2 Complex-Valued Kernel PCA.

5.4 Discussion.

6. ALOPEX: A Correlation-Based Learning Paradigm.

6.1 Background.

6.2 The Basic ALOPEX Rule.

6.3 Variants of the ALOPEX Algorithm.

6.3.1 Unnikrishnan and Venugopal’s ALOPEX.

6.3.2 Bia’s ALOPEX-B.

6.3.3 An Improved Version of the ALOPEX-B.

6.3.4 Two-Timescale ALOPEX.

6.3.5 Other Types of Correlation Mechanisms.

6.4 Discussion.

6.5 Monte Carlo Sampling-Based ALOPEX Algorithms.

6.5.1 Sequential Monte Carlo Estimation.

6.5.2 Sampling-Based ALOPEX Algorithms.

6.5.3 Remarks.

Appendix: Asymptotical Analysis of the ALOPEX Process.

Appendix: Asymptotic Convergence Analysis of the 2t-ALOPEX Algorithm.

7. Case Studies.

7.1 Hebbian Competition as the Basis for Cortical Map Reorganization?

7.2 Learning Neurocompensator: A Model-Based Hearing Compensation Strategy.

7.2.1 Background.

7.2.2 Model-Based Hearing Compensation Strategy.

7.2.3 Optimization.

7.2.4 Experimental Results.

7.2.5 Summary.

7.3 Online Training of Artificial Neural Networks.

7.3.1 Background.

7.3.2 Parameters Setup.

7.3.3 Online Option Prices Prediction.

7.3.4 Online System Identification.

7.3.5 Summary.

7.4 Kalman Filtering in Computational Neural Modeling.

7.4.1 Background.

7.4.2 Overview of Kalman Filter in Modeling Brain Functions.

7.4.3 Kalman Filter for Learning Shape and Motion from Image Sequences.

7.4.4 General Remarks and Implications.

8. Discussion.

8.1 Summary: Why Correlation?

8.1.1 Hebbian Plasticity and the Correlative Brain.

8.1.2 Correlation-Based Signal Processing.

8.1.3 Correlation-Based Machine Learning.

8.2 Epilogue: What Next?

8.2.1 Generalizing the Correlation Measure.

8.2.2 Deciphering the Correlative Brain.

Appendix A: Autocorrelation and Cross-correlation Functions.

Appendix B: Stochastic Approximation.

Appendix C: A Primer on Linear Algebra.

Appendix D: Probability Density and Entropy Estimators.

Appendix E: EM Algorithm.

Topic Index.

Read More Show Less

Customer Reviews

Be the first to write a review
( 0 )
Rating Distribution

5 Star

(0)

4 Star

(0)

3 Star

(0)

2 Star

(0)

1 Star

(0)

Your Rating:

Your Name: Create a Pen Name or

Barnes & Noble.com Review Rules

Our reader reviews allow you to share your comments on titles you liked, or didn't, with others. By submitting an online review, you are representing to Barnes & Noble.com that all information contained in your review is original and accurate in all respects, and that the submission of such content by you and the posting of such content by Barnes & Noble.com does not and will not violate the rights of any third party. Please follow the rules below to help ensure that your review can be posted.

Reviews by Our Customers Under the Age of 13

We highly value and respect everyone's opinion concerning the titles we offer. However, we cannot allow persons under the age of 13 to have accounts at BN.com or to post customer reviews. Please see our Terms of Use for more details.

What to exclude from your review:

Please do not write about reviews, commentary, or information posted on the product page. If you see any errors in the information on the product page, please send us an email.

Reviews should not contain any of the following:

  • - HTML tags, profanity, obscenities, vulgarities, or comments that defame anyone
  • - Time-sensitive information such as tour dates, signings, lectures, etc.
  • - Single-word reviews. Other people will read your review to discover why you liked or didn't like the title. Be descriptive.
  • - Comments focusing on the author or that may ruin the ending for others
  • - Phone numbers, addresses, URLs
  • - Pricing and availability information or alternative ordering information
  • - Advertisements or commercial solicitation

Reminder:

  • - By submitting a review, you grant to Barnes & Noble.com and its sublicensees the royalty-free, perpetual, irrevocable right and license to use the review in accordance with the Barnes & Noble.com Terms of Use.
  • - Barnes & Noble.com reserves the right not to post any review -- particularly those that do not follow the terms and conditions of these Rules. Barnes & Noble.com also reserves the right to remove any review at any time without notice.
  • - See Terms of Use for other conditions and disclaimers.
Search for Products You'd Like to Recommend

Recommend other products that relate to your review. Just search for them below and share!

Create a Pen Name

Your Pen Name is your unique identity on BN.com. It will appear on the reviews you write and other website activities. Your Pen Name cannot be edited, changed or deleted once submitted.

 
Your Pen Name can be any combination of alphanumeric characters (plus - and _), and must be at least two characters long.

Continue Anonymously

    If you find inappropriate content, please report it to Barnes & Noble
    Why is this product inappropriate?
    Comments (optional)