Human Compatible

Human Compatible: Artificial Intelligence and the Problem of Control is a 2019 non-fiction book by computer scientist Stuart J. Russell. It asserts that risk to humanity from advanced artificial intelligence (AI) is a serious concern despite the uncertainty surrounding future progress in AI. It also proposes an approach to the AI control problem.

Human Compatible
Hardcover edition
AuthorStuart J. Russell
CountryUnited States
LanguageEnglish
SubjectAI control problem
GenreNon-fiction
PublisherViking
Publication date
October 8, 2019
Pages352
ISBN978-0-525-55861-3
OCLC1083694322

Summary

Russell begins by asserting that the standard model of AI research, in which the primary definition of success is getting better and better at achieving rigid human-specified goals, is dangerously misguided. Such goals may not actually reflect what human designers intend, such as by failing to take into account any human values not included in the goals. If an AI developed according to the standard model were to become superintelligent, it would likely not fully reflect human values and could be catastrophic to humanity. Russell asserts that precisely because the timeline for developing human-level or superintelligent AI is highly uncertain, safety research should be begun as soon as possible, as it is also highly uncertain how long it would take to complete such research.

Russell argues that continuing progress in AI capability is inevitable because of economic pressures. Such pressures can already be seen in the development of existing AI technologies such as self-driving cars and personal assistant software. Moreover, human-level AI could be worth many trillions of dollars. Russell then examines the current debate surrounding AI risk. He offers refutations to a number of common arguments dismissing AI risk and attributes much of their persistence to tribalism—AI researchers may see AI risk concerns as an "attack" on their field. However, Russell reiterates that there are legitimate reasons to take AI risk concerns seriously and that economic pressures make continued innovation in AI inevitable.

Russell then proposes an approach to developing provably beneficial machines that focuses on deference to humans. Unlike in the standard model of AI, where the objective is rigid and certain, this approach would have the AI's true objective remain uncertain, with the AI only approaching certainty about it as it gains more information about humans and the world. This uncertainty would, ideally, prevent catastrophic misunderstandings of human preferences and encourage cooperation and communication with humans. Russell concludes by calling for tighter governance of AI research and development as well as cultural introspection about the appropriate amount of autonomy to retain in an AI-dominated world.

Russell's three principles

Russell lists three principles to guide the development of beneficial machines. He emphasizes that these principles are not meant to be explicitly coded into the machines; rather, they are intended for the human developers. The principles are as follows:[1]:173

1. The machine's only objective is to maximize the realization of human preferences.

2. The machine is initially uncertain about what those preferences are.

3. The ultimate source of information about human preferences is human behavior.

The "preferences" Russell refers to "are all-encompassing; they cover everything you might care about, arbitrarily far into the future."[1]:173 Similarly, "behavior" includes any choice between options,[1]:177 and the uncertainty is such that some probability, which may be quite small, must be assigned to every logically possible human preference.[1]:201

Russell explores inverse reinforcement learning, in which a machine infers a reward function from observed behavior, as a possible basis for a mechanism for learning human preferences.[1]:191–193

Reception

Several reviewers agreed with the book's arguments. Ian Sample in The Guardian called it "convincing" and "the most important book on AI this year".[2] Richard Waters of the Financial Times praised the book's "bracing intellectual rigour".[3] Kirkus endorsed it as "a strong case for planning for the day when machines can outsmart us".[4]

The same reviewers characterized the book as "wry and witty",[2] or "accessible"[4] due to its "laconic style and dry humour".[3] Matthew Hutson of the Wall Street Journal said "Mr. Russell's exciting book goes deep, while sparkling with dry witticisms".[5] A Library Journal reviewer called it "The right guide at the right time".[6]

James McConnachie of The Times wrote "This is not quite the popular book that AI urgently needs. Its technical parts are too difficult, its philosophical ones too easy. But it is fascinating, and significant."[7]

By contrast, Human Compatible was criticized in its Nature review by David Leslie, an Ethics Fellow at the Alan Turing Institute; and similarly in a New York Times opinion essay by Melanie Mitchell. One point of contention was whether superintelligence is possible. Leslie states Russell "fails to convince that we will ever see the arrival of a 'second intelligent species'", and Mitchell doubts a machine could ever "surpass the generality and flexibility of human intelligence" without losing "the speed, precision and programmability of a computer". A second disagreement was whether intelligent machines would naturally tend to adopt so-called "common sense" moral values. On Russell's thought experiment about a geoengineering robot that "asphyxiates humanity to deacidify the oceans", Leslie "struggles to identify any intelligence". Similarly, Mitchell believes an intelligent robot would naturally tend to be "tempered by the common sense, values and social judgment without which general intelligence cannot exist".[8][9]

The book was longlisted for the 2019 Financial Times/McKinsey award.[10]

gollark: UBIFS too.
gollark: The great part of 5G is that I could, under ideal conditions, probably go through my entire monthly data plan in a matter of *minutes*!
gollark: Them mentioning 5G when talking about that phone has reminded me of how annoying the 5G overhype is... it's a somewhat faster mobile networking standard, it's not going to revolutionize all communications or something.
gollark: I think that might be SoC-specific.
gollark: Their custom ones were bad, so they're axing the team and using ARM's designs.

See also

References
  1. Russell, Stuart (October 8, 2019). Human Compatible: Artificial Intelligence and the Problem of Control. United States: Viking. ISBN 978-0-525-55861-3. OCLC 1083694322.
  2. Sample, Ian (October 24, 2019). "Human Compatible by Stuart Russell review – AI and our future". The Guardian.
  3. Waters, Richard (18 October 2019). "Human Compatible — can we keep control over a superintelligence?". www.ft.com. Retrieved 23 February 2020.
  4. "HUMAN COMPATIBLE | Kirkus Reviews". Kirkus Reviews. 2019. Retrieved 23 February 2020.
  5. Hutson, Matthew (November 19, 2019). "'Human Compatible' and 'Artificial Intelligence' Review: Learn Like a Machine". The Wall Street Journal.
  6. Hahn, Jim (2019). "Human Compatible: Artificial Intelligence and the Problem of Control". Library Journal. Retrieved 23 February 2020.
  7. McConnachie, James (October 6, 2019). "Human Compatible by Stuart Russell review — an AI expert's chilling warning". The Times.
  8. Leslie, David (2 October 2019). "Raging robots, hapless humans: the AI dystopia". Nature. 574 (7776): 32–33. doi:10.1038/d41586-019-02939-0.
  9. Mitchell, Melanie (October 31, 2019). "We Shouldn't be Scared by 'Superintelligent A.I.'". The New York Times.
  10. Hill, Andrew (11 August 2019). "Business Book of the Year Award 2019 — the longlist". www.ft.com. Retrieved 23 February 2020.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.