In 2012 I received my PhD in experimental condensed matter physics from West Virginia University. Following that I was a dry etch process engineer for Intel Corporation, where I leveraged big data to make essential process improvements for mission critical products. After leaving Intel in 2015, I have worked as a contract and freelance deep learning and artificial intelligence engineer.

The Road to Agent57

Ready?

The Road to Agent57

Distributed Prioritized Experience Replay (APE-X)

Course Introduction

An Introduction to ProtoRL

What to Look for in the Paper

Key Ideas from the Paper

Reviewing our Code Structure

Multiprocessing Fundamentals

Coding our Memory Client Class

Coding our Memory Server Class

Coding the NStepBuffer Class

Coding the Config Classes

Coding the Apex DQN Actor / Learner Classes

Coding the Apex Actor Runner Function

Coding the Apex Learner Runner Function and Testing ApexDQN

Coding the Apex DDPG Actor and Learner and Testing ApexDDPG

About the teacher

phil