Affordable Access

Learning approximate representations of partially observable systems

Authors
Publisher
McGill University
Publication Date
Keywords
  • Applied Sciences - Computer Science
Disciplines
  • Computer Science

Abstract

In this thesis we are primarily concerned with ways of representing the agent's state that allows it to predict the conditional probability of a restricted set of future events, given the agent's past experience. Because of memory limitations, the agent's experience must be summarized in such a way as to make these restricted predictions possible. We introduce the novel idea of history representations, which allow us to condition the predictions on ``interesting'' behaviour, and present a simple algorithmic implementation of this framework. The learned model abstracts away the unnecessary details of the agent's experience and focuses only on making certain predictions of interest. We illustrate our approach empirically in small computational examples, demonstrating the data efficiency of the algorithm.

There are no comments yet on this publication. Be the first to share your thoughts.