CrowdAidRepair: A Crowd-Aided Interactive Data Repairing Method

Jian Zhou, Zhixu Li, Binbin Gu, Qing Xie, Jia Zhu, Xiangliang Zhang, Guoliang Li

Research output: Chapter in Book/Report/Conference proceedingChapter

4 Scopus citations

Abstract

Data repairing aims at discovering and correcting erroneous data in databases. Traditional methods relying on predefined quality rules to detect the conflict between data may fail to choose the right way to fix the detected conflict. Recent efforts turn to use the power of crowd in data repairing, but the crowd power has its own drawbacks such as high human intervention cost and inevitable low efficiency. In this paper, we propose a crowd-aided interactive data repairing method which takes the advantages of both rule-based method and crowd-based method. Particularly, we investigate the interaction between crowd-based repairing and rule-based repairing, and show that by doing crowd-based repairing to a small portion of values, we can greatly improve the repairing quality of the rule-based repairing method. Although we prove that the optimal interaction scheme using the least number of values for crowd-based repairing to maximize the imputation recall is not feasible to be achieved, still, our proposed solution identifies an efficient scheme through investigating the inconsistencies and the dependencies between values in the repairing process. Our empirical study on three data collections demonstrates the high repairing quality of CrowdAidRepair, as well as the efficiency of the generated interaction scheme over baselines.
Original languageEnglish (US)
Title of host publicationDatabase Systems for Advanced Applications
PublisherSpringer Nature
Pages51-66
Number of pages16
ISBN (Print)978-3-319-32024-3
DOIs
StatePublished - Mar 25 2016

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01
Acknowledgements: This research is partially supported by Natural Science
Foundation of China (Grant No. 61303019, 61402313, 61472263, 61572336), Postdoctoral
scientific research funding of Jiangsu Province (No. 1501090B) National
58 batch of postdoctoral funding (No. 2015M581859) and Collaborative Innovation
Center of Novel Software Technology and Industrialization, Jiangsu, China.

Fingerprint

Dive into the research topics of 'CrowdAidRepair: A Crowd-Aided Interactive Data Repairing Method'. Together they form a unique fingerprint.

Cite this