An intrinsic value system for developing multiple invariant representations with incremental slowness learning

Matthew Luciw, Varun Kompella, Sohrob Kazerounian, Juergen Schmidhuber

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

Curiosity Driven Modular Incremental Slow Feature Analysis (CD-MISFA;) is a recently introduced model of intrinsically-motivated invariance learning. Artificial curiosity enables the orderly formation of multiple stable sensory representations to simplify the agent's complex sensory input. We discuss computational properties of the CD-MISFA model itself as well as neurophysiological analogs fulfilling similar functional roles. CD-MISFA combines 1. unsupervised representation learning through the slowness principle, 2. generation of an intrinsic reward signal through learning progress of the developing features, and 3. balancing of exploration and exploitation to maximize learning progress and quickly learn multiple feature sets for perceptual simplification. Experimental results on synthetic observations and on the iCub robot show that the intrinsic value system is essential for representation learning. Representations are typically explored and learned in order from least to most costly, as predicted by the theory of curiosity. © 2013 Luciw, Kompella, Kazerounian and Schmidhuber.
Original languageEnglish (US)
JournalFrontiers in Neurorobotics
Volume7
Issue numberMAY
DOIs
StatePublished - Jan 1 2013
Externally publishedYes

ASJC Scopus subject areas

  • Biomedical Engineering
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'An intrinsic value system for developing multiple invariant representations with incremental slowness learning'. Together they form a unique fingerprint.

Cite this