Hands-On Q-Learning with Python

Habib, Nazia

ISBN 10: 1789345804 / ISBN 13: 9781789345803

Published by Packt Publishing, 2019

About this Item

Q-learning is the reinforcement learning approach behind Deep-Q-Learning and is a values-based learning algorithm in RL. This book will help you get comfortable with developing the effective agents for Q learning and also make you learn to effectively devel. Seller Inventory # 285682974

Bibliographic Details

Title: Hands-On Q-Learning with Python

Publisher: Packt Publishing

Publication Date: 2019

Binding: Soft cover

Condition: New

About this title

Synopsis:

Leverage the power of reward-based training for your deep learning models with Python

Key Features

• Understand Q-learning algorithms to train neural networks using Markov Decision Process (MDP)
• Study practical deep reinforcement learning using Q-Networks
• Explore state-based unsupervised learning for machine learning models

Book Description

Q-learning is a machine learning algorithm used to solve optimization problems in artificial intelligence (AI). It is one of the most popular fields of study among AI researchers.

This book starts off by introducing you to reinforcement learning and Q-learning, in addition to helping you get familiar with OpenAI Gym as well as libraries such as Keras and TensorFlow. A few chapters into the book, you will gain insights into modelfree Q-learning and use deep Q-networks and double deep Q-networks to solve complex problems. This book will guide you in exploring use cases such as self-driving vehicles and OpenAI Gym's CartPole problem. You will also learn how to tune and optimize Q-networks and their hyperparameters. As you progress, you will understand the reinforcement learning approach to solving real-world problems. You will also explore how to use Q-learning and related algorithms in real-world applications such as scientific research. Toward the end, you'll gain a sense of what's in store for reinforcement learning.

By the end of this book, you will be equipped with the skills you need to solve reinforcement learning problems using Q-learning algorithms with OpenAI Gym, Keras, and TensorFlow.

What you will learn

• Explore the fundamentals of reinforcement learning and the state-action-reward process
• Understand Markov decision processes
• Get well versed with libraries such as Keras, and TensorFlow
• Create and deploy model-free learning and deep Q-learning agents with TensorFlow, Keras, and OpenAI Gym
• Choose and optimize a Q-Network's learning parameters and fine-tune its performance
• Discover real-world applications and use cases of Q-learning

Who this book is for

If you are a machine learning developer, engineer, or professional who wants to delve into the deep learning approach for a complex environment, then this is the book for you. Proficiency in Python programming and basic understanding of decision-making in reinforcement learning is assumed.

Table of Contents

1. Brushing Up on Reinforcement Learning Concepts
2. Getting Started with the Q-Learning Algorithm
3. Setting Up Your First Environment with OpenAI Gym
4. Teaching a Smartcab to Drive Using Q-Learning
5. Building Q-Networks with TensorFlow
6. Digging Deeper into Deep Q-Networks with Keras and TensorFlow
7. Decoupling Exploration and Exploitation in Multi-Armed Bandits
8. Further Q-Learning Research and Future Projects
9. Assessments

About the Author:

Nazia Habib is a data scientist who has worked in a variety of industries to generate predictive analytics solutions for diverse groups of stakeholders. She is an expert in building solutions to optimization problems under conditions of uncertainty. Her projects range from predicting user behavior and engagement with social media apps to designing adaptive testing software. Her ongoing specialization is in designing custom reinforcement learning algorithms for modeling control problems with limited inputs that converge to optimal solutions.