Bi-directional Progressive Guidance Network for RGB-D Salient Object Detection

Yang Yang, Qi Qin, Yongjiang Luo, Yi Liu, Qiang Zhang, Jungong Han

Research output: Contribution to journalArticlepeer-review

60 Citations (Scopus)
293 Downloads (Pure)

Abstract

Most existing RGB-D salient detection models pay more attention to the quality of the depth images, while in some special cases, the quality of RGB images may even have greater impacts on saliency detection, which has long been ignored and underestimated. To address this problem, in this paper, we present a Bi-directional Progressive Guidance Network (BPGNet) for RGB-D salient object detection, where the qualities of both RGB and depth images are involved. Since it is usually difficult to determine which modality data have low quality in advance, a bi-directional framework based on progressive guidance (PG) strategy is employed to extract and enhance the unimodal features with the aid of another modality data via the alternative interactions between the saliency prediction results and the extracted features from the multi-modality input data. Specifically, the proposed PG strategy is achieved by using the proposed Global Context Awareness (GCA), Auxiliary Feature Extraction (AFE) and Cross-modality Feature Enhancement (CFE) modules. Benefiting from the proposed PG strategy, the disturbing information within the input RGB and depth images can be well suppressed, while the discriminative information within the input images gets enhanced. On top of that, a Fusion Prediction Module (FPM) is further designed to adaptively select those features with higher discriminability as well as enhancing the common information for the final saliency prediction. Experimental results demonstrate that our proposed model is comparable to those of state-of-the-art RGB-D SOD models.
Original languageEnglish
Pages (from-to)5346-5360
Number of pages15
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume32
Issue number8
Early online date19 Jan 2022
DOIs
Publication statusPublished - 01 Aug 2022

Keywords

  • bi-directional progressive guidance
  • image quality
  • RGB-D images
  • salient object detection

Fingerprint

Dive into the research topics of 'Bi-directional Progressive Guidance Network for RGB-D Salient Object Detection'. Together they form a unique fingerprint.

Cite this