The Alignment Problem: Machine Learning and Human Values
-
-
5.0 • 3 Ratings
-
-
- $16.99
-
- $16.99
Publisher Description
A jaw-dropping exploration of everything that goes wrong when we build AI systems and the movement to fix them.
Today’s “machine-learning” systems, trained by data, are so effective that we’ve invited them to see and hear for us—and to make decisions on our behalf. But alarm bells are ringing. Recent years have seen an eruption of concern as the field of machine learning advances. When the systems we attempt to teach will not, in the end, do what we want or what we expect, ethical and potentially existential risks emerge. Researchers call this the alignment problem.
Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole—and appear to assess Black and White defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And as autonomous vehicles share our streets, we are increasingly putting our lives in their hands.
The mathematical and computational models driving these changes range in complexity from something that can fit on a spreadsheet to a complex system that might credibly be called “artificial intelligence.” They are steadily replacing both human judgment and explicitly programmed software.
In best-selling author Brian Christian’s riveting account, we meet the alignment problem’s “first-responders,” and learn their ambitious plan to solve it before our hands are completely off the wheel. In a masterful blend of history and on-the ground reporting, Christian traces the explosive growth in the field of machine learning and surveys its current, sprawling frontier. Readers encounter a discipline finding its legs amid exhilarating and sometimes terrifying progress. Whether they—and we—succeed or fail in solving the alignment problem will be a defining human story.
The Alignment Problem offers an unflinching reckoning with humanity’s biases and blind spots, our own unstated assumptions and often contradictory goals. A dazzlingly interdisciplinary work, it takes a hard look not only at our technology but at our culture—and finds a story by turns harrowing and hopeful.
PUBLISHERS WEEKLY
Christian (The Most Human Human), a writer and lecturer on technology-related issues, delivers a riveting and deeply complex look at artificial intelligence and the significant challenge in creating computer models that "capture our norms and values." Machines that use mathematical and computational systems to learn are everywhere in modern life, Christian writes, and are "steadily replacing both human judgment and explicitly programmed software" in decision-making. Some of those decisions, however, are unreliable, as Christian shows through scrupulous research. Facial recognition systems can be "wildly inaccurate for people of one race or gender but not another" and perform particularly poorly on identifying Black women correctly. Meanwhile, risk assessment software, which helps decide bail, parole, and even sentencing for criminal defendants, has been widely adopted nationwide without being extensively audited. Though it's tempting to assume a doom-and-gloom outlook while reading of these problems, Christian refreshingly insists that "our ultimate conclusions need not be grim," as a new subset of computer scientists "focused explicitly on the ethics and safety of machine-learning" is working to bridge the gap between human values and AI learning styles. Lay readers will find Christian's revealing study to be a helpful guide to an urgent problem in tech.
