TY - JOUR
T1 - HPMF
T2 - Hypergraph-guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images
AU - Li, Yan
AU - Hao, Mingzhe
AU - Ma, Jiaman
AU - Temirbayev, Amirkhan
AU - Li, Ying
AU - Lu, Shijian
AU - Shang, Changjing
AU - Shen, Qiang
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025/9/24
Y1 - 2025/9/24
N2 - Few-shot object detection (FSOD) within remote sensing imagery has achieved great advancements in recent years. However, most existing methods are facing one key challenge while handling remote sensing images: many unlabeled instances in few-shot images are treated as background, which tends to degrade the generalization of the trained model severely. This paper presents HPMF, a Hypergraph-guided Prototype Mining Framework that addresses the challenge through joint optimization from three perspectives. The first is Hierarchical Reference Mining (HRM) which constructs a class-instance dual-driven prototype space that enables mining the unlabeled instances via cross-hierarchical similarity fusion. The second is a Robust Pseudo-box Estimator (RPE) that generates high-quality pseudo bounding boxes for the HRM-mined instances via adaptive density clustering and multi-statistic aggregation. The third is a Hypergraph-Guided Decoder (HGD) that introduces hypergraphs into the transformer decoder for group semantic modeling, enhancing high-order semantic association and similarity of instance features, thereby further improving the mining performance of the HRM module. Extensive experiments under various settings show that the proposed HPMF outperforms state-of-the-art methods consistently across multiple widely adopted remote-sensing FSOD benchmarks such as DIOR, NWPU-VHR10 v2, and HRRSD.
AB - Few-shot object detection (FSOD) within remote sensing imagery has achieved great advancements in recent years. However, most existing methods are facing one key challenge while handling remote sensing images: many unlabeled instances in few-shot images are treated as background, which tends to degrade the generalization of the trained model severely. This paper presents HPMF, a Hypergraph-guided Prototype Mining Framework that addresses the challenge through joint optimization from three perspectives. The first is Hierarchical Reference Mining (HRM) which constructs a class-instance dual-driven prototype space that enables mining the unlabeled instances via cross-hierarchical similarity fusion. The second is a Robust Pseudo-box Estimator (RPE) that generates high-quality pseudo bounding boxes for the HRM-mined instances via adaptive density clustering and multi-statistic aggregation. The third is a Hypergraph-Guided Decoder (HGD) that introduces hypergraphs into the transformer decoder for group semantic modeling, enhancing high-order semantic association and similarity of instance features, thereby further improving the mining performance of the HRM module. Extensive experiments under various settings show that the proposed HPMF outperforms state-of-the-art methods consistently across multiple widely adopted remote-sensing FSOD benchmarks such as DIOR, NWPU-VHR10 v2, and HRRSD.
KW - Few-shot learning
KW - object detection
KW - prototype learning
KW - remote sensing imagery
UR - https://www.scopus.com/pages/publications/105017439828
U2 - 10.1109/TGRS.2025.3613849
DO - 10.1109/TGRS.2025.3613849
M3 - Article
AN - SCOPUS:105017439828
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
ER -