I’m very excited to announce that my new book, Control Systems and Reinforcement Learning, is to be published by Cambridge University Press.

A pre-publication draft is freely available here

Chapter 5 contains more on the “Q-function manifesto” discussed in this April twitter storm

Sean (@spmeyn) and I wrote a "Q-function manifesto" for the Simons Institute to share our passion for Q-functions and the linear program formulation of optimal control in Markov decision processes. Check it out and join our adventure to derive better RL algorithms! https://t.co/83jU6IX5aV

— Gergely Neu (@neu_rips) April 2, 2022