Nearest-Neighbor Guided Evaluation of Data Reliability and Its Applications

Research output: Contribution to journalArticlepeer-review

62 Citations (Scopus)
207 Downloads (Pure)

Abstract

The intuition of data reliability has recently been incorporated into the main stream of research on ordered weighted averaging (OWA) operators. Instead of relying on human-guided variables, the aggregation behavior is determined in accordance with the underlying characteristics of the data being aggregated. Data-oriented operators such as the dependent OWA (DOWA) utilize centralized data structures to generate reliable weights, however. Despite their simplicity, the approach taken by these operators neglects entirely any local data structure that represents a strong agreement or consensus. To address this issue, the cluster-based OWA (Clus-DOWA) operator has been proposed. It employs a cluster-based reliability measure that is effective to differentiate the accountability of different input arguments. Yet, its actual application is constrained by the high computational requirement. This paper presents a more efficient nearest-neighbor-based reliability assessment for which an expensive clustering process is not required. The proposed measure can be perceived as a stress function, from which the OWA weights and associated decision-support explanations can be generated. To illustrate the potential of this measure, it is applied to both the problem of information aggregation for alias detection and the problem of unsupervised feature selection (in which unreliable features are excluded from an actual learning process). Experimental results demonstrate that these techniques usually outperform their conventional state-of-the-art counterparts.
Original languageEnglish
Article number5454303
Pages (from-to)1622-1633
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
Volume40
Issue number6
DOIs
Publication statusPublished - Dec 2010

Keywords

  • Alias detection
  • data reliability
  • nearest neighbor
  • ordered weighted averaging (OWA) aggregation
  • unsupervised feature selection
  • weight determination

Fingerprint

Dive into the research topics of 'Nearest-Neighbor Guided Evaluation of Data Reliability and Its Applications'. Together they form a unique fingerprint.

Cite this