Modeling and Reasoning with Bayesian Networks

by Adnan Darwiche

Overview

This book is a thorough introduction to the formal foundations and practical applications of Bayesian networks. It provides an extensive discussion of techniques for building Bayesian networks that model real-world situations, including techniques for synthesizing models from design, learning models from data, and debugging models using sensitivity analysis. It also treats exact and approximate inference algorithms at both theoretical and practical levels. The treatment of exact algorithms covers the main inference paradigms based on elimination and conditioning and includes advanced methods for compiling Bayesian networks, time-space tradeoffs, and exploiting local structure of massively connected networks. The treatment of approximate algorithms covers the main inference paradigms based on sampling and optimization and includes influential algorithms such as importance sampling, MCMC, and belief propagation. The author assumes very little background on the covered subjects, supplying in-depth discussions for theoretically inclined readers and enough practical details to provide an algorithmic cookbook for the system developer.

Product Details

ISBN-13:	9781139637701
Publisher:	Cambridge University Press
Publication date:	04/06/2009
Sold by:	Barnes & Noble
Format:	eBook
File size:	50 MB
Note:	This product may take a few minutes to download.

About the Author

Adnan Darwiche is a Professor in the Department of Computer Science at the University of California, Los Angeles.

Table of Contents

1. Introduction; 2. Propositional logic; 3. Probability calculus; 4. Bayesian networks; 5. Building Bayesian networks; 6. Inference by variable elimination; 7. Inference by factor elimination; 8. Inference by conditioning; 9. Models for graph decomposition; 10. Most likely instantiations; 11. The complexity of probabilistic inference; 12. Compiling Bayesian networks; 13. Inference with local structure; 14. Approximate inference by belief propagation; 15. Approximate inference by stochastic sampling; 16. Sensitivity analysis; 17. Learning: the maximum likelihood approach; 18. Learning: the Bayesian approach; Appendix A: notation; Appendix B: concepts from information theory; Appendix C: fixed point iterative methods; Appendix D: constrained optimization.

What People are Saying About This

From the Publisher

"Bayesian networks are as important to AI and machine learning as Boolean circuits are to computer science. Adnan Darwiche is a leading expert in this area and this book provides a superb introduction to both theory and practice, with much useful material not found elsewhere."
Stuart Russell, University of California, Berkeley

"Bayesian networks have revolutionized AI. This book gives a clear and insightful overview of what we have learnt in 25 years of research, by one of the leading researchers. It is both accessible and deep, making it essential reading for both beginning students and advanced researchers."
David Poole, Professor of Computer Science University of British Columbia

"Bayesian Networks are models for representing and using probabilistic knowledge, introduced in the field of Artificial Intelligence by Judea Pearl back in the 1980's. Since then many inference methods, learning algorithms, and applications of Bayesian Networks have been developed, tested, and deployed, making Bayesian Networks into a solid and established framework for reasoning with uncertain information. Adnan Darwiche, a leading researcher in the field, has produced a book that provides a clear, coherent, and advanced introduction to Bayesian Networks that will appeal to students, practitioners, and scientists alike. A wonderful exposition that starts with propositional logic and probability calculus, and ends with state-of-the-art inference methods and learning algorithms. In my view, the best book on Bayesian Networks since Pearl's seminal book."
Hector Geffner, ICREA and Universitat Pompeu Fabra

"The book is both practical and advanced... The book should definitely be in the bookshelf of everyone who teaches Bayesian networks and builds probabilistic reasoning agents."
Yang Xiang, Artificial Intelligence

"... a comprehensive presentation..."
Dorota Kurowicka, Mathematical Reviews

"The book is clearly written. In all, the clarity, continuity, and depth of the presentation mean that this would make a first class course text, as well as serving as a very useful reference work. I shall certainly recommend it for teaching purposes, and doubtless refer to it to remind myself about particular aspects of such models."
David J. Hand, International Statistical Review

"This is an elegant and well-written book. The book provides an accessible walkthrough and formal treatment of BNs grounded in propositional logic. The book will make an excellent textbook; it covers topics suitable for both undergraduate and graduate courses. It will also help practitioners get a firm grasp of the fundamentals of modeling and inference with BNs, as well as some recent advances."
Yousri ElFattah, Computing Reviews

Editorial Reviews

"Bayesian networks are as important to AI and machine learning as Boolean circuits are to computer science. Adnan Darwiche is a leading expert in this area and this book provides a superb introduction to both theory and practice, with much useful material not found elsewhere."
Stuart Russell, University of California, Berkeley

"Bayesian networks have revolutionized AI. This book gives a clear and insightful overview of what we have learnt in 25 years of research, by one of the leading researchers. It is both accessible and deep, making it essential reading for both beginning students and advanced researchers."
David Poole, Professor of Computer Science University of British Columbia

"Bayesian Networks are models for representing and using probabilistic knowledge, introduced in the field of Artificial Intelligence by Judea Pearl back in the 1980's. Since then many inference methods, learning algorithms, and applications of Bayesian Networks have been developed, tested, and deployed, making Bayesian Networks into a solid and established framework for reasoning with uncertain information. Adnan Darwiche, a leading researcher in the field, has produced a book that provides a clear, coherent, and advanced introduction to Bayesian Networks that will appeal to students, practitioners, and scientists alike. A wonderful exposition that starts with propositional logic and probability calculus, and ends with state-of-the-art inference methods and learning algorithms. In my view, the best book on Bayesian Networks since Pearl's seminal book."
Hector Geffner, ICREA and Universitat Pompeu Fabra

"The book is both practical and advanced... The book should definitely be in the bookshelf of everyone who teaches Bayesian networks and builds probabilistic reasoning agents."
Yang Xiang, Artificial Intelligence

"... a comprehensive presentation..."
Dorota Kurowicka, Mathematical Reviews

"The book is clearly written. In all, the clarity, continuity, and depth of the presentation mean that this would make a first class course text, as well as serving as a very useful reference work. I shall certainly recommend it for teaching purposes, and doubtless refer to it to remind myself about particular aspects of such models."
David J. Hand, International Statistical Review

"This is an elegant and well-written book. The book provides an accessible walkthrough and formal treatment of BNs grounded in propositional logic. The book will make an excellent textbook; it covers topics suitable for both undergraduate and graduate courses. It will also help practitioners get a firm grasp of the fundamentals of modeling and inference with BNs, as well as some recent advances."
Yousri ElFattah, Computing Reviews

From the Publisher