» Download Article
Actor-Critic Control with Reference Model Learning
World Congress, Volume # 18 | Part# 1
Authors
Grondman, Ivo; Vaandrager, Maarten; Busoniu, Lucian; Babuska, Robert; Schuitema, Erik
Digital Object Identifier (DOI)
10.3182/20110828-6-IT-1002.00759
Page Numbers:
14723-14728
Index Terms
Reinforcement learning control; Knowledge-based control
Abstract
We propose a new actor-critic algorithm for reinforcement learning. The algorithm does not use an explicit actor, but learns a reference model which represents a desired behaviour, along which the process is to be controlled by using the inverse of a learned process model. The algorithm uses Local Linear Regression (LLR) to learn approximations of all the functions involved. The online learning of a process and reference model, in combination with LLR, provides an efficient policy update for faster learning. In addition, the algorithm facilitates the incorporation of prior knowledge. The novel method and a standard actor-critic algorithm are applied to the pendulum swingup problem, in which the novel method achieves faster learning than the standard algorithm.
References
No references available