KDE-Track: An Efficient Dynamic Density Estimator for Data Streams

Abdulhakim Ali Ali Qahtan, Suojin Wang, Xiangliang Zhang

Research output: Contribution to journalArticlepeer-review

32 Scopus citations

Abstract

Recent developments in sensors, global positioning system devices and smart phones have increased the availability of spatiotemporal data streams. Developing models for mining such streams is challenged by the huge amount of data that cannot be stored in the memory, the high arrival speed and the dynamic changes in the data distribution. Density estimation is an important technique in stream mining for a wide variety of applications. The construction of kernel density estimators is well studied and documented. However, existing techniques are either expensive or inaccurate and unable to capture the changes in the data distribution. In this paper, we present a method called KDE-Track to estimate the density of spatiotemporal data streams. KDE-Track can efficiently estimate the density function with linear time complexity using interpolation on a kernel model, which is incrementally updated upon the arrival of new samples from the stream. We also propose an accurate and efficient method for selecting the bandwidth value for the kernel density estimator, which increases its accuracy significantly. Both theoretical analysis and experimental validation show that KDE-Track outperforms a set of baseline methods on the estimation accuracy and computing time of complex density structures in data streams.
Original languageEnglish (US)
Pages (from-to)642-655
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume29
Issue number3
DOIs
StatePublished - Nov 8 2016

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01

Fingerprint

Dive into the research topics of 'KDE-Track: An Efficient Dynamic Density Estimator for Data Streams'. Together they form a unique fingerprint.

Cite this