Augmented visualization with natural feature tracking

Gábor Sörös*, Hartmut Seichter, Peter Rautek, Eduard Gröller

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations


Visualization systems often require large monitors or projection screens to display complex information. Even very sophisticated systems that exhibit complex user interfaces do usually not exploit advanced input and output devices. One of the reasons for that is the high cost of special hardware. This paper introduces Augmented Visualization, an interaction method for projection walls as well as monitors using affordable and widely available hardware such as mobile phones or tablets. The main technical challenge is the tracking of the users' devices without any special equipment or fiducial markers in the working area. We propose to track natural features of the display content with the built-in camera of mobile devices. Tracking the visualized scene allows pose estimation of the mobile devices with six degrees of freedom. The position and orientation information is then used for advanced interaction metaphors like magic lenses. For a group of experts who are analyzing the data in front of the same screen, a personal augmented view of the visualized scene is presented, for each user on his/her personal device. The prototype Augmented Visualization System achieves interactive frame rates and may lead to a greatly enhanced user experience. The paper discusses the design and implementation questions and illustrates potential application scenarios.

Original languageEnglish (US)
Title of host publicationProceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia, MUM'11
Number of pages9
StatePublished - 2011
Event10th International Conference on Mobile and Ubiquitous Multimedia, MUM'11 - Beijing, China
Duration: Dec 7 2011Dec 9 2011

Publication series

NameProceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia, MUM'11


Other10th International Conference on Mobile and Ubiquitous Multimedia, MUM'11


  • handheld augmented reality
  • human computer interaction
  • interactive visualization systems
  • natural feature tracking

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software


Dive into the research topics of 'Augmented visualization with natural feature tracking'. Together they form a unique fingerprint.

Cite this