Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification

Jim Jing-Yan Wang, Halima Bensmail, Xin Gao

Research output: Contribution to journalArticlepeer-review

43 Scopus citations


Automated classification of tissue types of Region of Interest (ROI) in medical images has been an important application in Computer-Aided Diagnosis (CAD). Recently, bag-of-feature methods which treat each ROI as a set of local features have shown their power in this field. Two important issues of bag-of-feature strategy for tissue classification are investigated in this paper: the visual vocabulary learning and weighting, which are always considered independently in traditional methods by neglecting the inner relationship between the visual words and their weights. To overcome this problem, we develop a novel algorithm, Joint-ViVo, which learns the vocabulary and visual word weights jointly. A unified objective function based on large margin is defined for learning of both visual vocabulary and visual word weights, and optimized alternately in the iterative algorithm. We test our algorithm on three tissue classification tasks: classifying breast tissue density in mammograms, classifying lung tissue in High-Resolution Computed Tomography (HRCT) images, and identifying brain tissue type in Magnetic Resonance Imaging (MRI). The results show that Joint-ViVo outperforms the state-of-art methods on tissue classification problems. © 2013 Elsevier Ltd.
Original languageEnglish (US)
Pages (from-to)3249-3255
Number of pages7
JournalPattern Recognition
Issue number12
StatePublished - Dec 2013

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01
Acknowledgements: The study was supported by grants from National Key Laboratory for Novel Software Technology, China (Grant no. KFKT2012B17), 2011 Qatar Annual Research Forum Award (Grant no. ARF2011), and King Abdullah University of Science and Technology (KAUST), Saudi Arabia.

ASJC Scopus subject areas

  • Artificial Intelligence
  • Signal Processing
  • Software
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification'. Together they form a unique fingerprint.

Cite this