Computer ScienceScience & MathematicsEconomics & FinanceBusiness & ManagementPolitics & GovernmentHistoryPhilosophy

Reinforcement Learning

An Introduction

by Richard S. Sutton, Andrew G. Barto

Reinforcement Learning

Subscribe to new books via dBooks.org telegram channel

Join
DescriptionTable of ContentsDetailsHashtagsReport an issue

Book Description

Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives while interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the field's key ideas and algorithms. This second edition has been significantly expanded and updated, presenting new topics and updating coverage of other topics.

Like the first edition, this second edition focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes. Part I covers as much of reinforcement learning as possible without going beyond the tabular case for which exact solutions can be found. Many algorithms presented in this part are new to the second edition, including UCB, Expected Sarsa, and Double Learning. Part II extends these ideas to function approximation, with new sections on such topics as artificial neural networks and the Fourier basis, and offers expanded treatment of off-policy learning and policy-gradient methods. Part III has new chapters on reinforcement learning's relationships to psychology and neuroscience, as well as an updated case-studies chapter including AlphaGo and AlphaGo Zero, Atari game playing, and IBM Watson's wagering strategy. The final chapter discusses the future societal impacts of reinforcement learning.

This open book is licensed under a Creative Commons License (CC BY-NC-ND). You can download Reinforcement Learning ebook for free in PDF format (71.9 MB).

Table of Contents

Chapter 1
Introduction
Part I
Tabular Solution Methods
Chapter 2
Multi-armed Bandits
Chapter 3
Finite Markov Decision Processes
Chapter 4
Dynamic Programming
Chapter 5
Monte Carlo Methods
Chapter 6
Temporal-Difference Learning
Chapter 7
n-step Bootstrapping
Chapter 8
Planning and Learning with Tabular Methods
Part II
Approximate Solution Methods
Chapter 9
On-policy Prediction with Approximation
Chapter 10
On-policy Control with Approximation
Chapter 11
*Off-policy Methods with Approximation
Chapter 12
Eligibility Traces
Chapter 13
Policy Gradient Methods
Part III
Looking Deeper
Chapter 14
Psychology
Chapter 15
Neuroscience
Chapter 16
Applications and Case Studies
Chapter 17
Frontiers

Book Details

Title
Reinforcement Learning
Publisher
MIT Press
Published
2018
Pages
548
Edition
2
Language
English
ISBN13 Digital
9780262039246
ISBN10 Digital
0262039249
PDF Size
71.9 MB
License
CC BY-NC-ND

Related Books

Neural Networks and Deep Learning
This book covers both classical and modern models in deep learning. The chapters of this book span three categories: The basics of neural networks: Many traditional machine learning models can be understood as special cases of neural networks. An emphasis is placed in the first two chapters on understanding the relationship between traditional mac...
Python Machine Learning Projects
As machine learning is increasingly leveraged to find patterns, conduct analysis, and make decisions - sometimes without final input from humans who may be impacted by these findings - it is crucial to invest in bringing more stakeholders into the fold. This book of Python projects in machine learning tries to do just that: to equip the developers ...
Foundations of Machine Learning
A new edition of a graduate-level machine learning textbook that focuses on the analysis and theory of algorithms. This book is a general introduction to machine learning that can serve as a textbook for graduate students and a reference for researchers. It covers fundamental modern topics in machine learning while providing the theoretical basi...
AI based Robot Safe Learning and Control
This open book mainly focuses on the safe control of robot manipulators. The control schemes are mainly developed based on dynamic neural network, which is an important theoretical branch of deep reinforcement learning. In order to enhance the safety performance of robot systems, the control strategies include adaptive tracking control for robots w...
Deep Learning with JavaScript
Deep learning has transformed the fields of computer vision, image processing, and natural language applications. Thanks to TensorFlow.js, now JavaScript developers can build deep learning apps without relying on Python or R. Deep Learning with JavaScript shows developers how they can bring DL technology to the web. Written by the main authors of t...
Machine Learning Yearning
AI is transforming numerous industries. Machine Learning Yearning, a free ebook from Andrew Ng, teaches you how to structure Machine Learning projects. This book is focused not on teaching you ML algorithms, but on how to make ML algorithms work. After reading Machine Learning Yearning, you will be able to: - Prioritize the most promising direc...