On Aggregation of Unsupervised Deep Binary Descriptor with Weak Bits

Gengshen Wu, Zijia Lin, Guiguang Ding, Qiang Ni, Jungong Han

Research output: Contribution to journalArticlepeer-review

13 Citations (SciVal)
162 Downloads (Pure)

Abstract

Despite the thrilling success achieved by existing binary descriptors, most of them are still in the mire of three limitations: 1) vulnerable to the geometric transformations; 2) incapable of preserving the manifold structure when learning binary codes; 3) NO guarantee to find the true match if multiple candidates happen to have the same Hamming distance to a given query. All these together make the binary descriptor less effective, given large-scale visual recognition tasks. In this paper, we propose a novel learning-based feature descriptor, namely Unsupervised Deep Binary Descriptor (UDBD), which learns transformation invariant binary descriptors via projecting the original data and their transformed sets into a joint binary space. Moreover, we involve a ℓ 2,1-norm loss term in the binary embedding process to gain simultaneously the robustness against data noises and less probability of mistakenly flipping bits of the binary descriptor, on top of it, a graph constraint is used to preserve the original manifold structure in the binary space. Furthermore, a weak bit mechanism is adopted to find the real match from candidates sharing the same minimum Hamming distance, thus enhancing matching performance. Extensive experimental results on public datasets show the superiority of UDBD in terms of matching and retrieval accuracy over state-of-the-arts.

Original languageEnglish
Article number9206151
Pages (from-to)9266-9278
Number of pages13
JournalIEEE Transactions on Image Processing
Volume29
Early online date25 Sept 2020
DOIs
Publication statusPublished - 01 Oct 2020

Keywords

  • deep learning
  • feature matching
  • Image hashing
  • local binary descriptor
  • similarity retrieval

Fingerprint

Dive into the research topics of 'On Aggregation of Unsupervised Deep Binary Descriptor with Weak Bits'. Together they form a unique fingerprint.

Cite this