RLSS: A Deep Reinforcement Learning Algorithm for Sequential Scene Generation

Azimkhon Ostonov, Peter Wonka, Dominik L. Michels

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present RLSS: a reinforcement learning algorithm for sequential scene generation. This is based on employing the proximal policy optimization (PPO) algorithm for generative problems. In particular, we consider how to effectively reduce the action space by including a greedy search algorithm in the learning process. Our experiments demonstrate that our method converges for a relatively large number of actions and learns to generate scenes with predefined design objectives. This approach is placing objects iteratively in the virtual scene. In each step, the network chooses which objects to place and selects positions which result in maximal reward. A high reward is assigned if the last action resulted in desired properties whereas the violation of constraints is penalized. We demonstrate the capability of our method to generate plausible and diverse scenes efficiently by solving indoor planning problems and generating Angry Birds levels.
Original languageEnglish (US)
Title of host publication2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
PublisherIEEE
ISBN (Print)978-1-6654-0916-2
DOIs
StatePublished - 2022

Fingerprint

Dive into the research topics of 'RLSS: A Deep Reinforcement Learning Algorithm for Sequential Scene Generation'. Together they form a unique fingerprint.

Cite this