Parallel computing TEDA for high frequency streaming data clustering

Xiaowei Gu, Plamen Parvanov Angelov, German Gutierrez, Jose Antonio Iglesias, Araceli Sanchi

Research output: Chapter in Book/Report/Conference proceedingConference Proceeding (Non-Journal item)

Abstract

In this paper, a novel online clustering approach called Parallel_TEDA is introduced for processing high frequency streaming data. This newly proposed approach is developed within the recently introduced TEDA theory and inherits all advantages from it. In the proposed approach, a number of data stream processors are involved, which collaborate with each other efficiently to achieve parallel computation as well as a much higher processing speed. A fusion center is involved to gather the key information from the processors which work on chunks of the whole data stream and generate the overall output. The quality of the generated clusters is being monitored within the data processors all the time and stale clusters are being removed to ensure the correctness and timeliness of the overall clustering results. This, in turn, gives the proposed approach a stronger ability of handling shifts/drifts that may take place in live data streams. The numerical experiments performed with the proposed new approach Parallel_TEDA on benchmark datasets present higher performance and faster processing speed when compared with the alternative well-known approaches. The processing speed has been demonstrated to fall exponentially with more data processors involved. This new online clustering approach is very suitable and promising for real-time high frequency streaming processing and data analytics.
Original languageEnglish
Title of host publicationAdvances in Big Data
Subtitle of host publicationProceedings of the 2nd INNS Conference on Big Data, 2016
EditorsAsim Roy, Marley Vellasco, Yannis Manolopoulos, Lazaros Iliadis, Plamen Angelov
Pages238-253
Number of pages16
DOIs
Publication statusPublished - 23 Oct 2016
Externally publishedYes

Publication series

NameAdvances in Intelligent Systems and Computing
Volume529
ISSN (Print)2194-5357

Keywords

  • Clustering
  • High frequency streaming data
  • Parallel computation
  • Real time
  • TEDA

Fingerprint

Dive into the research topics of 'Parallel computing TEDA for high frequency streaming data clustering'. Together they form a unique fingerprint.

Cite this