Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM)

Losing V, Hammer B, Wersing H (2018)
KNOWLEDGE AND INFORMATION SYSTEMS 54(1): 171-201.

Download
No fulltext has been uploaded. References only!
Journal Article | Original Article | Published | English

No fulltext has been uploaded

Author
Abstract
Data mining in non-stationary data streams is particularly relevant in the context of Internet of Things and Big Data. Its challenges arise from fundamentally different drift types violating assumptions of data independence or stationarity. Available methods often struggle with certain forms of drift or require unavailable a priori task knowledge. We propose the Self-Adjusting Memory (SAM) model for the k-nearest-neighbor (kNN) algorithm. SAM-kNN can deal with heterogeneous concept drift, i.e., different drift types and rates, using biologically inspired memory models and their coordination. Its basic idea is to have dedicated models for current and former concepts used according to the demands of the given situation. It can be easily applied in practice without meta parameter optimization. We conduct an extensive evaluation on various benchmarks, consisting of artificial streams with known drift characteristics and real-world datasets. We explicitly add new benchmarks enabling a precise performance analysis on multiple types of drift. Highly competitive results throughout all experiments underline the robustness of SAM-kNN as well as its capability to handle heterogeneous concept drift. Knowledge about drift characteristics in streaming data is not only crucial for a precise algorithm evaluation, but it also facilitates the choice of an appropriate algorithm on real-world applications. Therefore, we additionally propose two tests, able to determine the type and strength of drift. We extract the drift characteristics of all utilized datasets and use it for our analysis of the SAM in relation to other methods.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Losing V, Hammer B, Wersing H. Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM). KNOWLEDGE AND INFORMATION SYSTEMS. 2018;54(1):171-201.
Losing, V., Hammer, B., & Wersing, H. (2018). Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM). KNOWLEDGE AND INFORMATION SYSTEMS, 54(1), 171-201. doi:10.1007/s10115-017-1137-y
Losing, V., Hammer, B., and Wersing, H. (2018). Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM). KNOWLEDGE AND INFORMATION SYSTEMS 54, 171-201.
Losing, V., Hammer, B., & Wersing, H., 2018. Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM). KNOWLEDGE AND INFORMATION SYSTEMS, 54(1), p 171-201.
V. Losing, B. Hammer, and H. Wersing, “Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM)”, KNOWLEDGE AND INFORMATION SYSTEMS, vol. 54, 2018, pp. 171-201.
Losing, V., Hammer, B., Wersing, H.: Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM). KNOWLEDGE AND INFORMATION SYSTEMS. 54, 171-201 (2018).
Losing, Viktor, Hammer, Barbara, and Wersing, Heiko. “Tackling heterogeneous concept drift with the Self-Adjusting Memory (SAM)”. KNOWLEDGE AND INFORMATION SYSTEMS 54.1 (2018): 171-201.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar