Clustering data with the presence of missing values by ensemble approach

Mullika Pattanodom, Natthakan Iam-On, Tossapon Boongoen

Research output: Chapter in Book/Report/Conference proceedingConference Proceeding (Non-Journal item)

30 Citations (SciVal)

Abstract

The problem of missing values arise as one of the major difficulties in data mining and the downstreaming applications. In fact, most of the analytical techniques established in this field have been developed to handle a complete data set. Imputing or filling in missing values is generally regarded as a data preprocessing task, for which several methods has been introduced. These include a collection of statistical alternatives such as average and zero imputes, as well as learning-led models like nearest neighbors and regression. As for cluster analysis, various clustering algorithms, even k-means the most well-known, are hardly design to handle such a problem. This is also the case with cluster ensembles, where an improved decision is generated upon multiple results of clustering complete data. The paper presents a new framework that allows clustering incomplete data without the usual preprocessing step. Intuitively, different versions of the original data can be created by filling in those unknown values with arbitrary ones. This random selection is simple and efficient, while promotes the diversity within an ensemble, hence its quality. In particular, Binary cluster-association matrix (BA) has been adopted to summarize ensemble information, from which k-means is exploited to derive the final clustering. The proposed model is evaluated against a number of benchmark imputation methods, over different datasets obtained from UCI repository. Based on the evaluation metric of cluster accuracy (CA), the findings suggest more accurate outcome is usually observed with the new framework. This motivates an application of the proposed approach to problems specific to Thai armed forces, such as identification of attacks that is presently in the spotlight for cyber security.

Original languageEnglish
Title of host publication2016 2nd Asian Conference on Defence Technology, ACDT 2016
PublisherIEEE Press
Pages151-156
Number of pages6
ISBN (Electronic)9781509022571
DOIs
Publication statusPublished - 21 Mar 2016
Event2nd Asian Conference on Defence Technology, ACDT 2016 - Chiang Mai, Thailand
Duration: 21 Jan 201626 Jan 2016

Publication series

Name2016 2nd Asian Conference on Defence Technology, ACDT 2016

Conference

Conference2nd Asian Conference on Defence Technology, ACDT 2016
Country/TerritoryThailand
CityChiang Mai
Period21 Jan 201626 Jan 2016

Keywords

  • Cluster ensemble
  • Data clustering
  • Missing value
  • Random imputation

Fingerprint

Dive into the research topics of 'Clustering data with the presence of missing values by ensemble approach'. Together they form a unique fingerprint.

Cite this