Disentangled Capsule Routing for Fast Part-Object Relational Saliency

Yi Liu, Dingwen Zhang, Nian Liu, Shoukun Xu, Jungong Han

Research output: Contribution to journalArticlepeer-review

7 Citations (SciVal)
150 Downloads (Pure)

Abstract

Recently, the Part-Object Relational (POR) saliency underpinned by the Capsule Network (CapsNet) has been demonstrated to be an effective modeling mechanism to improve the saliency detection accuracy. However, it is widely known that the current capsule routing operations have huge computational complexity, which seriously limited the usability of the POR saliency models in real-time applications. To this end, this paper takes an early step towards a fast POR saliency inference by proposing a novel disentangled part-object relational network. Concretely, we disentangle horizontal routing and vertical routing from the original omnidirectional capsule routing, thus generating Disentangled Capsule Routing (DCR). This mechanism enjoys two advantages. On one hand, DCR that disentangles orthogonal 1D (i.e., vertical and horizontal) routing greatly reduces parameters and routing complexity, resulting in much faster inference than omnidirectional 2D routing adopted by existing CapsNets. On the other hand, thanks to the light POR cues explored by DCR, we could conveniently integrate the part-object routing process to different feature layers in CNN, rather than just applying it to the small-scaled one as in previous works. This helps to increase saliency inference accuracy. Compared to previous POR saliency detectors, DPORTNet infers visual saliency (5 ∼ 9) × faster, and is more accurate. DPORTNet is available under the open-source license at https://github.com/liuyi1989/DCR.
Original languageEnglish
Pages (from-to)6719-6732
Number of pages14
JournalIEEE Transactions on Image Processing
Volume31
DOIs
Publication statusPublished - 25 Oct 2022

Keywords

  • Salient object detection
  • capsule network
  • disentangled capsule routing
  • multi-level information integration
  • part-object relationship

Fingerprint

Dive into the research topics of 'Disentangled Capsule Routing for Fast Part-Object Relational Saliency'. Together they form a unique fingerprint.

Cite this