Clustering data with the presence of attribute noise: A study of noise completely at random and ensemble of multiple k-means clusterings

Research output: Contribution to journalArticlepeer-review

Abstract

In general practice, the perception of noise has been inevitably negative. Specific to data analytic, most of the existing techniques developed thus far comply with a noise-free assumption. Without an assistance of data pre-processing, it is hard for those models to discover reliable patterns. This is also true for k-means, one of the most well known algorithms for cluster analysis. Based on several works in the literature, they suggest that the ensemble approach can deliver accurate results from multiple clusterings of data with noise completely at random. Provided this motivation, the paper presents the study of using different consensus clustering techniques to analyze noisy data, with k-means being exploited as base clusterings. The empirical investigation reveals that the ensemble approach can be robust to low level of noise, while some exhibit improvement over the noise-free cases. This finding is in line with the recent published work that underlines the benefit of small noise to centroid-based clustering methods. In addition, the outcome of this research provides a guideline to analyzing a new data collection of uncertain quality level.

Original languageEnglish
Pages (from-to)491-509
Number of pages19
JournalInternational Journal of Machine Learning and Cybernetics
Volume11
Issue number3
Early online date29 Jul 2019
DOIs
Publication statusPublished - 01 Mar 2020
Externally publishedYes

Keywords

  • Attribute noise
  • Cluster ensemble
  • Data clustering
  • NCAR
  • Robustness

Fingerprint

Dive into the research topics of 'Clustering data with the presence of attribute noise: A study of noise completely at random and ensemble of multiple k-means clusterings'. Together they form a unique fingerprint.

Cite this