MICE: Multi-layer multi-model images classifier ensemble

Plamen Parvanov Angelov, Xiaowei Gu

Research output: Chapter in Book/Report/Conference proceedingConference Proceeding (Non-Journal item)

24 Citations (Scopus)


In this paper, a new type of fast deep learning (DL) network for handwriting recognition is proposed. In contrast to the existing DL networks, the proposed approach has a clearly interpretable structure that is entirely data- driven and free from user- or problem-specific assumptions. Firstly, the fundamental image transformation techniques (rotation and scaling) used by other existing DL methods are used to improve the generalization. The commonly used descriptors are then used to extract the global features from the training set and based on them a bank/ensemble of zero order AnYa type fuzzy rule-based (FRB) models is built in parallel through the recently introduced Autonomous Learning Multiple Model (ALMMo) method. The final decision about the winning class label is made by a committee on the basis of the fuzzy mixture of the trained zero order ALMMo models. The training of the proposed MICE system is very efficient and highly parallelizable. It significantly outperforms the best-known methods in terms of time and is on par in terms of precision/accuracy. Critically, it offers a high level of interpretability, transparency of the classification model, full repeatability (unlike the methods that use probabilistic elements) of the results. Moreover, it allows an evolving scenario whereby the data is provided in an incremental, online manner and the system structure evolves in parallel with the classification which opens opportunities for online and real-time applications (on a sample by sample basis). Numerical examples from the well-known handwritten digits recognition problem (MNIST) were used and the results demonstrated the very high repeatable performance after a very short training process exhibiting high level of interpretability, transparency.
Original languageEnglish
Title of host publicationThe 3rd IEEE International Conference on Cybernetics
Subtitle of host publicationCYBCONF 2017 - Proceedings
PublisherIEEE Press
ISBN (Print)9781538622018
Publication statusE-pub ahead of print - 20 Jul 2017
Externally publishedYes

Publication series

Name2017 3rd IEEE International Conference on Cybernetics, CYBCONF 2017 - Proceedings


Dive into the research topics of 'MICE: Multi-layer multi-model images classifier ensemble'. Together they form a unique fingerprint.

Cite this