Hierarchical Relational Inference

Aleksandar Stanić, Sjoerd van Steenkiste, Jürgen Schmidhuber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Common-sense physical reasoning in the real world requires learning about the interactions of objects and their dynamics. The notion of an abstract object, however, encompasses a wide variety of physical objects that differ greatly in terms of the complex behaviors they support. To address this, we propose a novel approach to physical reasoning that models objects as hierarchies of parts that may locally behave separately, but also act more globally as a single whole. Unlike prior approaches, our method learns in an unsupervised fashion directly from raw visual images to discover objects, parts, and their relations. It explicitly distinguishes multiple levels of abstraction and improves over a strong baseline at modeling synthetic and real-world videos.
Original languageEnglish (US)
Title of host publication35th AAAI Conference on Artificial Intelligence, AAAI 2021
PublisherAssociation for the Advancement of Artificial Intelligence
Pages9730-9738
Number of pages9
ISBN (Print)9781713835974
StatePublished - Jan 1 2021
Externally publishedYes

Cite this