Probabilistic Machine Learning: Advanced Topics

by Kevin P. Murphy

Overview

An advanced book for researchers and graduate students working in machine learning and statistics who want to learn about deep learning, Bayesian inference, generative models, and decision making under uncertainty.

An advanced counterpart to Probabilistic Machine Learning: An Introduction, this high-level textbook provides researchers and graduate students detailed coverage of cutting-edge topics in machine learning, including deep generative modeling, graphical models, Bayesian inference, reinforcement learning, and causality. This volume puts deep learning into a larger statistical context and unifies approaches based on deep learning with ones based on probabilistic modeling and inference. With contributions from top scientists and domain experts from places such as Google, DeepMind, Amazon, Purdue University, NYU, and the University of Washington, this rigorous book is essential to understanding the vital issues in machine learning.

• Covers generation of high dimensional outputs, such as images, text, and graphs
• Discusses methods for discovering insights about data, based on latent variable models
• Considers training and testing under different distributions
• Explores how to use probabilistic models and inference for causal inference and decision making
• Features online Python code accompaniment

Product Details

ISBN-13:	9780262048439
Publisher:	MIT Press
Publication date:	08/15/2023
Series:	Adaptive Computation and Machine Learning series
Pages:	1360
Sales rank:	518,160
Product dimensions:	8.38(w) x 9.31(h) x 2.18(d)

About the Author

Kevin P. Murphy is a Research Scientist at Google in Mountain View, California, where he works on artificial intelligence, machine learning, and Bayesian modeling.

Table of Contents

1 Introduction 1
I Fundamentals 3
2 Probability 5
3 Statistics 63
4 Graphical models 143
5 Information theory 217
6 Optimization 255
II Inference 337
7 Inference algorithms: an overview 339
8 Gaussian filtering and smoothing 353
9 Message passing algorithms 395
10 Variational inference 433
11 Monte Carlo methods 477
12 Markov chain Monte Carlo 493
13 Sequential Monte Carlo 537
III Prediction 567
14 Predictive models: an overview 569
15 Generalized linear models 583
16 Deep neural networks 623
17 Bayesian neural networks 639
18 Gaussian processes 673
19 Beyond the iid assumption 727
IV Generation 763
20 Generative models: an overview 765
21 Variational autoencoders 781
22 Autoregressive models 811
23 Normalizing flows 819
24 Energy-based models 839
25 Diffusion models 857
26 Generative adversarial networks 883
V Discovery 915
27 Discovery methods: an overview 917
28 Latent factor models 919
29 State-space models 969
30 Graph learning 1031
31 Nonparametric Bayesian models 1035
32 Representation learning 1037
33 Interpretability 1061
VI Action 1091
34 Decision making under uncertainty 1093
35 Reinforcement learning 1133
36 Causality 1171

What People are Saying About This

From the Publisher

“The deep learning revolution has transformed the field of machine learning over the last decade. It was inspired by attempts to mimic the way the brain learns but it is grounded in basic principles of statistics, information theory, decision theory, and optimization. This book does an excellent job of explaining these principles and describes many of the ‘classical’ machine learning methods that make use of them. It also shows how the same principles can be applied in deep learning systems that contain many layers of features. This provides a coherent framework in which one can understand the relationships and tradeoffs between many different ML approaches, both old and new.”
—Geoffrey Hinton, Emeritus Professor of Computer Science, University of Toronto; Engineering Fellow, Google