Affordable Access

Credit assignment in multiple goal embodied visuomotor behavior

Authors
Publication Date
Keywords
  • Ddc:150
Disciplines
  • Biology
  • Communication
  • Computer Science

Abstract

The intrinsic complexity of the brain can lead one to set aside issues related to its relationships with the body, but the field of embodied cognition emphasizes that understanding brain function at the system level requires one to address the role of the brain-body interface. It has only recently been appreciated that this interface performs huge amounts of computation that does not have to be repeated by the brain, and thus affords the brain great simplifications in its representations. In effect the brain’s abstract states can refer to coded representations of the world created by the body. But even if the brain can communicate with the world through abstractions, the severe speed limitations in its neural circuitry mean that vast amounts of indexing must be performed during development so that appropriate behavioral responses can be rapidly accessed. One way this could happen would be if the brain used a decomposition whereby behavioral primitives could be quickly accessed and combined. This realization motivates our study of independent sensorimotor task solvers, which we call modules, in directing behavior. The issue we focus on herein is how an embodied agent can learn to calibrate such individual visuomotor modules while pursuing multiple goals. The biologically plausible standard for module programming is that of reinforcement given during exploration of the environment. However this formulation contains a substantial issue when sensorimotor modules are used in combination: The credit for their overall performance must be divided amongst them. We show that this problem can be solved and that diverse task combinations are beneficial in learning and not a complication, as usually assumed. Our simulations show that fast algorithms are available that allot credit correctly and are insensitive to measurement noise.

There are no comments yet on this publication. Be the first to share your thoughts.

Statistics

Seen <100 times
0 Comments

More articles like this

Credit Assignment in Multiple Goal Embodied Visuom...

on Frontiers in Psychology Jan 01, 2010

Shaping Embodied Neural Networks for Adaptive Goal...

on PLoS Computational Biology Mar 01, 2008

Spatio-temporal electrical stimuli shape behavior...

on Journal of Neural Engineering September 2008

Neurons in the rostral cingulate motor area monito...

on Journal of Neurophysiology July 2005
More articles like this..