Feature selection for high dimensional imbalanced class data using harmony search

Alireza Moayedikia, Kok-Leong Ong, Yee Ling Boo, William G. S. Yeoh, Richard Jensen

Research output: Contribution to journalArticlepeer-review

123 Citations (SciVal)
490 Downloads (Pure)

Abstract

Misclassification costs of minority class data in real-world applications can be very high. This is a challenging problem especially when the data is also high in dimensionality because of the increase in overfitting and lower model interpretability. Feature selection is recently a popular way to address this problem by identifying features that best predict a minority class. This paper introduces a novel feature selection method call SYMON which uses symmetrical uncertainty and harmony search. Unlike existing methods, SYMON uses symmetrical uncertainty to weigh features with respect to their dependency to class labels. This helps to identify powerful features in retrieving the least frequent class labels. SYMON also uses harmony search to formulate the feature selection phase as an optimisation problem to select the best possible combination of features. The proposed algorithm is able to deal with situations where a set of features have the same weight, by incorporating two vector tuning operations embedded in the harmony search process. In this paper, SYMON is compared against various benchmark feature selection algorithms that were developed to address the same issue. Our empirical evaluation on different micro-array data sets using G-Mean and AUC measures confirm that SYMON is a comparable or a better solution to current benchmarks.
Original languageEnglish
Pages (from-to)38-49
Number of pages12
JournalEngineering Applications of Artificial Intelligence
Volume57
Early online date28 Oct 2016
DOIs
Publication statusPublished - 31 Jan 2017

Keywords

  • Feature selection
  • harmony search
  • High-dimensionality
  • Imbalanced class
  • Symmetrical uncertainty

Fingerprint

Dive into the research topics of 'Feature selection for high dimensional imbalanced class data using harmony search'. Together they form a unique fingerprint.

Cite this