_requests_for_research/difference-of-value-functions.html (9 lines of code) (raw):
---
title: Difference of value functions
summary: ''
difficulty: 2 # out of 3
---
<p>Bertsekas wrote <a href="http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.67.2646&rep=rep1&type=pdf">an interesting paper</a> arguing why it might be better to learn functions that measure the difference in value between states, rather than the value of states. Implement this algorithm with neural networks and apply it to challenging Gym environments.</p>
<hr>
<h3>Notes</h3>
<p>This idea may turn out to not be fruitful, and getting a good result may prove to be impossible.</p>