ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph

Baoyuan Wu, Siwei Lyu, Bernard Ghanem

Research output: Chapter in Book/Report/Conference proceedingConference contribution

89 Scopus citations


This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these labels (i.e. some of their labels are missing). To handle missing labels, we propose a unified model of label dependencies by constructing a mixed graph, which jointly incorporates (i) instance-level similarity and class co-occurrence as undirected edges and (ii) semantic label hierarchy as directed edges. Unlike most MLML methods, We formulate this learning problem transductively as a convex quadratic matrix optimization problem that encourages training label consistency and encodes both types of label dependencies (i.e. undirected and directed edges) using quadratic terms and hard linear constraints. The alternating direction method of multipliers (ADMM) can be used to exactly and efficiently solve this problem. To evaluate our proposed method, we consider two popular applications (image and video annotation), where the label hierarchy can be derived from Wordnet. Experimental results show that our method achieves a significant improvement over state-of-the-art methods in performance and robustness to missing labels.
Original languageEnglish (US)
Title of host publication2015 IEEE International Conference on Computer Vision (ICCV)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages9
ISBN (Print)9781467383912
StatePublished - Feb 19 2016

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01
Acknowledgements: This work is supported supported by
competitive research funding from King Abdullah University
of Science and Technology (KAUST). The participation
of Siwei Lyu in this work is partly supported by US National
Science Foundation Research Grant (CCF-1319800)
and National Science Foundation Early Faculty Career Development
(CAREER) Award (IIS-0953373). We thank
Fabian Caba Heilbron for his help on figure plotting, and
Rafal Protasiuk for his help on data collection. We thank
the reviewers for their constructive comments.


Dive into the research topics of 'ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph'. Together they form a unique fingerprint.

Cite this