Real-time three-dimensional (also known as 4D) ultrasound imaging using matrix array probes has the potential to create large-volume information of entire organs such as the liver without external tracking hardware. This information can in turn be placed into the context of a CT or MRI scan of the same patient. However for such an approach many image processing challenges need to be overcome and sources of error addressed, including reconstruction drift, anatomical deformations, varying appearance of anatomy, and imaging artifacts. In this work, we present a fully automatic system including robust image-based ultrasound tracking, a novel learning-based global initialization of the anatomical context, and joint mono- and multi-modal registration. In an evaluation on 4D US sequences and MRI scans of eight volunteers we achieve automatic reconstruction and registration without any user interaction, assess the registration errors based on physician-defined landmarks, and demonstrate real-time tracking of free-breathing sequences.
|Original language||English (US)|
|Title of host publication||Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2014|
|Editors||Ivan Viola, Katja Buhler, Timo Ropinski|
|Number of pages||8|
|State||Published - 2014|
|Event||2014 Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2014 - Vienna, Austria|
Duration: Sep 4 2014 → Sep 5 2014
|Name||Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2014|
|Conference||2014 Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2014|
|Period||09/4/14 → 09/5/14|
Bibliographical noteFunding Information:
We would like to express our appreciation to the Med-Viz Network Bergen (medviz.uib.no) and GE Vingmed Ultrasound (www.gehealthcare.com) for providing the MRI and US datasets from the study on volunteering participants. The involvement of Ivan Viola was supported by the Vienna Science and Technology Fund (WWTF) through project VRG11-010 and by EC Marie Curie Career Integration Grant through project PCIG13-GA-2013-618680.
© Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2014. All rights reserved.
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition
- Biomedical Engineering