Self-organised direction aware data partitioning algorithm

Xiaowei Gu, Plamen Parvanov Angelov, Dmitry Kangin, Jose Principe

Research output: Contribution to journalArticlepeer-review

24 Citations (SciVal)
98 Downloads (Pure)

Abstract

In this paper, a novel fully data-driven algorithm, named Self-Organised Direction Aware (SODA) data partitioning and forming data clouds is proposed. The proposed SODA algorithm employs an extra cosine similarity-based directional component to work together with a traditional distance metric, thus, takes the advantages of both the spatial and angular divergences. Using the nonparametric Empirical Data Analytics (EDA) operators, the proposed algorithm automatically identifies the main modes of the data pattern from the empirically observed data samples and uses them as focal points to form data clouds. A streaming data processing extension of the SODA algorithm is also proposed. This extension of the SODA algorithm is able to self-adjust the data clouds structure and parameters to follow the possibly changing data patterns and processes. Numerical examples provided as a proof of the concept illustrate the proposed algorithm as an autonomous algorithm and demonstrate its high clustering performance and computational efficiency.

Original languageEnglish
Pages (from-to)80-95
Number of pages16
JournalInformation Sciences
Volume423
Early online date19 Sept 2017
DOIs
Publication statusPublished - 01 Jan 2018
Externally publishedYes

Keywords

  • Autonomous learning
  • Clustering
  • Cosine similarity
  • Empirical Data Analytics (EDA)
  • Nonparametric
  • Traditional distance metric

Fingerprint

Dive into the research topics of 'Self-organised direction aware data partitioning algorithm'. Together they form a unique fingerprint.

Cite this