2D-3D Lifting for Shape Reconstruction

Liangliang Nan, Andrei Sharf, Baoquan Chen

    Research output: Contribution to journalArticlepeer-review

    4 Scopus citations

    Abstract

    We present an algorithm for shape reconstruction from incomplete 3D scans by fusing together two acquisition modes: 2D photographs and 3D scans. The two modes exhibit complementary characteristics: scans have depth information, but are often sparse and incomplete; photographs, on the other hand, are dense and have high resolution, but lack important depth information. In this work we fuse the two modes, taking advantage of their complementary information, to enhance 3D shape reconstruction from an incomplete scan with a 2D photograph. We compute geometrical and topological shape properties in 2D photographs and use them to reconstruct a shape from an incomplete 3D scan in a principled manner. Our key observation is that shape properties such as boundaries, smooth patches and local connectivity, can be inferred with high confidence from 2D photographs. Thus, we register the 3D scan with the 2D photograph and use scanned points as 3D depth cues for lifting 2D shape structures into 3D. Our contribution is an algorithm which significantly regularizes and enhances the problem of 3D reconstruction from partial scans by lifting 2D shape structures into 3D. We evaluate our algorithm on various shapes which are loosely scanned and photographed from different views, and compare them with state-of-the-art reconstruction methods.

    Original languageEnglish (US)
    Pages (from-to)249-258
    Number of pages10
    JournalComputer Graphics Forum
    Volume33
    Issue number7
    DOIs
    StatePublished - Oct 1 2014

    Bibliographical note

    Publisher Copyright:
    © 2014 The Author(s) Computer Graphics Forum © 2014 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd.

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design

    Fingerprint

    Dive into the research topics of '2D-3D Lifting for Shape Reconstruction'. Together they form a unique fingerprint.

    Cite this