Why Machines Learn: The Elegant Math Behind Modern AI

by Anil Ananthaswamy Narrated by Rene Ruiz

Overview

A rich, narrative explanation of the mathematics that has brought us machine learning and the ongoing explosion of artificial intelligence

Machine learning systems are making life-altering decisions for us: approving mortgage loans, determining whether a tumour is cancerous, or deciding whether someone gets bail. They now influence developments and discoveries in chemistry, biology, and physics-the study of genomes, extra-solar planets, even the intricacies of quantum systems. And all this before large language models such as ChatGPT came on the scene.

We are living through a revolution in machine learning-powered AI that shows no signs of slowing down. This technology is based on relatively simple mathematical ideas, some of which go back centuries, including linear algebra and calculus, the stuff of seventeenth- and eighteenth-century mathematics. It took the birth and advancement of computer science and the kindling of 1990s computer chips designed for video games to ignite the explosion of AI that we see today. In this enlightening book, Anil Ananthaswamy explains the fundamental math behind machine learning, while suggesting intriguing links between artifical and natural intelligence. Might the same math underpin them both?

As Ananthaswamy resonantly concludes, to make safe and effective use of artificial intelligence, we need to understand its profound capabilities and limitations, the clues to which lie in the math that makes machine learning possible.

*This audiobook contains a PDF of equations, graphs, and illustrations.

Editorial Reviews

Publishers Weekly

05/06/2024

This impenetrable primer from science writer Ananthaswamy (Through Two Doors at Once) unsuccessfully attempts to elucidate how AI works. He explains that it learns by scanning data for patterns and then makes predictions about what kinds of data are likely to appear in sequence. Unfortunately, the excruciatingly detailed breakdown of the roles played by probability, principal component analysis (“projecting high-dimensional data onto a much smaller number of axes to find the dimensions along which the data vary the most”), and eigenvectors (which are never satisfactorily defined) will sail over the heads of anyone without an advanced math degree. Biographical background on physicist John Hopfield, electrical engineer Bernhard Boser, and other pioneering contributors to machine learning does little to alleviate the labyrinthine discussions of their advances. There are some bright spots—as when Ananthaswamy discusses how statisticians deduced the authorship of the contested Federalist Papers by analyzing whether the writing more closely reflected the vocabulary of James Madison or Alexander Hamilton—but these highlights are few and far between, surrounded by bewildering equations and dense proofs for mathematical theorems. General readers will struggle to follow this. Agent: Peter Tallack, Curious Minds Agency. (July)

From the Publisher

A Next Big Idea Club Must-Read Title for July
One of The Information's 5 Best AI Books of 2024
A Winner of the Artificiality Book Awards 2024

"A deep look at the mathematical innovations that made the AI revolution possible. One of the most useful books on AI that I've ever read!"
—Cal Newport, New York Times bestselling author of Slow Productivity and Deep Work, and Professor of Computer Science at Georgetown University

“Why Machines Learn, by the award-winning science writer Anil Ananthaswamy, takes the reader on an entertaining journey into the mind of a machine… [The book] demystifies the underlying mechanisms behind machine learning, which may possibly lead to a better understanding of the learning process itself and the development of improved AI.”
—Physics World

“A skillful primer makes sense of the mathematics beneath AI's hood.”
—New Scientist

“Whether Ananthaswamy is talking of ML algorithms or manipulation of matrices, he maintains a lightness of language and invokes historical accounts to advance a compelling narrative… A must-read for anyone who is curious to understand 'the elegant math behind modern AI' [and] an inspirational guide for teachers of math and mathematical sciences who can adopt these techniques and methods to make classrooms lively.”
—Shaastra, IIT-Madras

“Some books about the development of neural networks describe the underlying mathematics while others describe the social history. This book presents the mathematics in the context of the social history. It is a masterpiece. The author is very good at explaining the mathematics in a way that makes it available to people with only a rudimentary knowledge of the field, but he is also a very good writer who brings the social history to life.”
—Geoffrey Hinton, Nobel Laureate, deep learning pioneer, Turing Award winner, former VP at Google, and Professor Emeritus at University of Toronto

“After just a few minutes of reading Why Machines Learn, you’ll feel your own synaptic weights getting updated. By the end you will have achieved your own version of deep learning—with deep pleasure and insight along the way.”
—Steven Strogatz, New York Times bestselling author of Infinite Powers and professor of mathematics at Cornell University

“If you were looking for a way to make sense of the AI revolution that is well underway, look no further. With this comprehensive yet engaging book, Anil Ananthaswamy puts it all into context, from the origin of the idea and its governing equations to its potential to transform medicine, quantum physics—and virtually every aspect of our life. An essential read for understanding both the possibilities and limitations of artificial intelligence.”
—Sabine Hossenfelder, physicist and New York Times bestselling author of Existential Physics: A Scientist's Guide to Life's Biggest Questions

“Why Machines Learn is a masterful work that explains—in clear, accessible, and entertaining fashion—the mathematics underlying modern machine learning, along with the colorful history of the field and its pioneering researchers. As AI has increasingly profound impacts in our world, this book will be an invaluable companion for anyone who wants a deep understanding of what’s under the hood of these often inscrutable machines.”
—Melanie Mitchell, author of Artificial Intelligence and Professor at the Santa Fe Institute

“Generative AI, with its foundations in machine learning, is as fundamental an advance as the creation of the microprocessor, the Internet, and the mobile phone. But almost no one, outside of a handful of specialists, understands how it works. Anil Ananthaswamy has removed the mystery by giving us a gentle, intuitive, and human-oriented introduction to the math that underpins this revolutionary development.”
—Peter E. Hart, AI pioneer, entrepreneur, and co-author of Pattern Classification

“Anil Ananthaswamy’s Why Machines Learn embarks on an exhilarating journey through the origins of contemporary machine learning. With a captivating narrative, the book delves into the lives of influential figures driving the AI revolution while simultaneously exploring the intricate mathematical formalism that underpins it. As Anil traces the roots and unravels the mysteries of modern AI, he gently introduces the underlying mathematics, rendering the complex subject matter accessible and exciting for readers of all backgrounds.”
—Björn Ommer, Professor at the Ludwig Maximilian University of Munich and leader of the original team behind Stable Diffusion

“An inspiring introduction to the mathematics of AI.”
—Arthur I. Miller, author of The Artist in the Machine: The World of AI-Powered Creativity

"Will there be math? Oh, yes, there will be math. But Ananthaswamy is the best guide you could ask for on such a perilous journey."
—The Information

"This book is the ultimate explainer... What I love most is how [Ananthaswamy] threads history into the equations. You get why these methods matter, how they were discovered, and why they’ve stuck around. I felt like I was part of the journey, not just staring at some abstract formula. If you’re curious about how machines learn but feel like math is a wall you can’t climb, this book is your ladder. Highly recommended."
—Helen Edwards, The Artificiality Institute

“[An] illuminating overview of how machine learning works.”
—Kirkus Reviews

Kirkus Reviews

2024-05-11
A study of the concepts that power AI.

In this demanding but rewarding book, Ananthaswamy, author of The Man Who Wasn’t There, “explains the elegant mathematics and algorithms [behind]…machine learning, a type of AI that involves building machines that can learn to discern patterns in data without being explicitly programmed to do so.” With astute reference to principles from the disciplines of math, computer science, physics, and neuroscience, the author guides readers through the conceptual frameworks involved in the creation of AI. While it would be helpful to come to the book with a strong background in math (especially statistics and calculus), clear and detailed illustrations help make it accessible to anyone willing to immerse themselves in the material. Ananthaswamy makes the power of AI obvious, and his engaging case studies explore its emerging abilities in the generation of new media—text, images, video, and music—and contributions to discoveries in areas such as drug development and the dynamics of gene expression. The author also provides a vivid picture of how AI will continue to transform everyday activities and, very soon, revolutionize our social and economic lives. Ananthaswamy demonstrates how a profound merging of human activities with machine processes is already far along and will soon accelerate strikingly. The author could have offered a little more insight about these coming changes, though the introduction and epilogue do touch on pressing questions about the various risks of emerging technologies and how they might be mitigated. Familiarizing ourselves with what is at stake, the author rightly notes, is now an urgent personal and public responsibility: “It is only when we understand the inevitability of learning machines that we will be prepared to tackle a future in which AI is ubiquitous, for good and for bad.”

A challenging and illuminating overview of how machine learning works.

Product Details

BN ID:	2940159609571
Publisher:	Penguin Random House
Publication date:	07/16/2024
Edition description:	Unabridged

Read an Excerpt

Chapter 1
 
Desperately Seeking Patterns
 
When he was a child, the Austrian scientist Konrad Lorenz, enamored by tales from a book called The Wonderful Adventures of Nils-the story of a boy's adventures with wild geese written by the Swedish novelist and winner of the Nobel Prize for Literature, Selma Lagerlöf-"yearned to become a wild goose." Unable to indulge his fantasy, the young Lorenz settled for taking care of a day-old duckling his neighbor gave him. To the boy's delight, the duckling began following him around: It had imprinted on him. "Imprinting" refers to the ability of many animals, including baby ducks and geese (goslings), to form bonds with the first moving thing they see upon hatching. Lorenz would go on to become an ethologist and would pioneer studies in the field of animal behavior, particularly imprinting. (He got ducklings to imprint on him; they followed him around as he walked, ran, swam, and even paddled away in a canoe.) He won the Nobel Prize for Physiology or Medicine in 1973, jointly with fellow ethologists Karl von Frisch and Nikolaas Tinbergen. The three were celebrated "for their discoveries concerning organization and elicitation of individual and social behavior patterns."
 
Patterns. While the ethologists were discerning them in the behavior of animals, the animals were detecting patterns of their own. Newly hatched ducklings must have the ability to make out or tell apart the properties of things they see moving around them. It turns out that ducklings can imprint not just on the first living creature they see moving, but on inanimate things as well. Mallard ducklings, for example, can imprint on a pair of moving objects that are similar in shape or color. Specifically, they imprint on the relational concept embodied by the objects. So, if upon birth the ducklings see two moving red objects, they will later follow two objects of the same color (even if those latter objects are blue, not red), but not two objects of different colors. In this case, the ducklings imprint on the idea of similarity. They also show the ability to discern dissimilarity. If the first moving objects the ducklings see are, for example, a cube and a rectangular prism, they will recognize that the objects have different shapes and will later follow two objects that are different in shape (a pyramid and a cone, for example), but they will ignore two objects that have the same shape.
 
Ponder this for a moment. Newborn ducklings, with the briefest of exposure to sensory stimuli, detect patterns in what they see, form abstract notions of similarity/dissimilarity, and then will recognize those abstractions in stimuli they see later and act upon them. Artificial intelligence researchers would offer an arm and a leg to know just how the ducklings pull this off.
 
While today's AI is far from being able to perform such tasks with the ease and efficiency of ducklings, it does have something in common with the ducklings, and that's the ability to pick out and learn about patterns in data. When Frank Rosenblatt invented the perceptron in the late 1950s, one reason it made such a splash was because it was the first formidable "brain-inspired" algorithm that could learn about patterns in data simply by examining the data. Most important, given certain assumptions about the data, researchers proved that Rosenblatt's perceptron will always find the pattern hidden in the data in a finite amount of time; or, put differently, the perceptron will converge upon a solution without fail. Such certainties in computing are like gold dust. No wonder the perceptron learning algorithm created such a fuss.
 
But what do these terms mean? What are “patterns” in data? What does “learning about these patterns” imply?

Videos