Stacked convolutional auto-encoders for hierarchical feature extraction

Jonathan Masci, Ueli Meier, Dan Cireşan, Jürgen Schmidhuber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1183 Scopus citations

Abstract

We present a novel convolutional auto-encoder (CAE) for unsupervised feature learning. A stack of CAEs forms a convolutional neural network (CNN). Each CAE is trained using conventional on-line gradient descent without additional regularization terms. A max-pooling layer is essential to learn biologically plausible features consistent with those found by previous approaches. Initializing a CNN with filters of a trained CAE stack yields superior performance on a digit (MNIST) and an object recognition (CIFAR10) benchmark. © 2011 Springer-Verlag.
Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages52-59
Number of pages8
DOIs
StatePublished - Jun 24 2011
Externally publishedYes

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Stacked convolutional auto-encoders for hierarchical feature extraction'. Together they form a unique fingerprint.

Cite this