HPMF: Hypergraph-guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images

Yan Li, Mingzhe Hao, Jiaman Ma*, Amirkhan Temirbayev, Ying Li*, Shijian Lu, Changjing Shang, Qiang Shen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Few-shot object detection (FSOD) within remote sensing imagery has achieved great advancements in recent years. However, most existing methods are facing one key challenge while handling remote sensing images: many unlabeled instances in few-shot images are treated as background, which tends to degrade the generalization of the trained model severely. This paper presents HPMF, a Hypergraph-guided Prototype Mining Framework that addresses the challenge through joint optimization from three perspectives. The first is Hierarchical Reference Mining (HRM) which constructs a class-instance dual-driven prototype space that enables mining the unlabeled instances via cross-hierarchical similarity fusion. The second is a Robust Pseudo-box Estimator (RPE) that generates high-quality pseudo bounding boxes for the HRM-mined instances via adaptive density clustering and multi-statistic aggregation. The third is a Hypergraph-Guided Decoder (HGD) that introduces hypergraphs into the transformer decoder for group semantic modeling, enhancing high-order semantic association and similarity of instance features, thereby further improving the mining performance of the HRM module. Extensive experiments under various settings show that the proposed HPMF outperforms state-of-the-art methods consistently across multiple widely adopted remote-sensing FSOD benchmarks such as DIOR, NWPU-VHR10 v2, and HRRSD.

Original languageEnglish
Number of pages13
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume63
DOIs
Publication statusPublished - 24 Sept 2025

Keywords

  • Few-shot learning
  • object detection
  • prototype learning
  • remote sensing imagery

Fingerprint

Dive into the research topics of 'HPMF: Hypergraph-guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images'. Together they form a unique fingerprint.

Cite this