Zero-shot Learning via Discriminative Dual Semantic Auto-encoder

Nan Xing, Yang Liu, Hong Zhu, Jing Wang, Jungong Han

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

6 Dyfyniadau(SciVal)
97 Wedi eu Llwytho i Lawr (Pure)

Crynodeb

Zero-shot learning (ZSL) is an effective method to perform the recognition task without any training samples of specific classes. Most existing ZSL models put emphasis on learning an embedding between visual space and semantic space directly. However, few ZSL models research whether the human-designed semantic features are discriminative enough to recognize different classes. Moreover, one-way mapping suffers from the project domain shift problem. In this article, we propose to learn a Discriminative Dual Semantic Auto-encoder (DDSA) based on the encoder-decoder paradigm to solve this problem. DDSA attempts to construct two bidirectional embeddings to connect the visual space and the semantic space with the help of the learned aligned space which includes discriminative information of the visual features and semantic features. Based on the DDSA, we additionally propose a Deep DDSA to capture deep aligned features that are more conducive to zero-shot classification. The key to the proposed framework is that it implicitly exact the principal information from visual space and semantic space to construct aligned features, which is not only semantic-preserving but also discriminative. Extensive experiments on five benchmarks (SUN, CUB, AWA1, AWA2 and aPY) demonstrate the effectiveness of the proposed framework with state-of-the-art performance obtained on both conventional ZSL and generalized ZSL settings.

Iaith wreiddiolSaesneg
Rhif yr erthygl9303397
Tudalennau (o-i)733-742
Nifer y tudalennau10
CyfnodolynIEEE Access
Cyfrol9
Dyddiad ar-lein cynnar22 Rhag 2020
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 04 Ion 2021

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Zero-shot Learning via Discriminative Dual Semantic Auto-encoder'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn