Affiliations: School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
Correspondence:
[*]
Corresponding author. Haofeng Zhang, School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China. E-mail: [email protected].
Abstract: Zero Shot learning (ZSL) aims to use the information of seen classes to recognize unseen classes, which is achieved by transferring knowledge of the seen classes from the semantic embeddings. Since the domains of the seen and unseen classes do not overlap, most ZSL algorithms often suffer from domain shift problem. In this paper, we propose a Dual Discriminative Auto-encoder Network (DDANet), in which visual features and semantic attributes are self-encoded by using the high dimensional latent space instead of the feature space or the low dimensional semantic space. In the embedded latent space, the features are projected to both preserve their original semantic meanings and have discriminative characteristics, which are realized by applying dual semantic auto-encoder and discriminative feature embedding strategy. Moreover, the cross modal reconstruction is applied to obtain interactive information. Extensive experiments are conducted on four popular datasets and the results demonstrate the superiority of this method.
Keywords: Zero shot learning, domain shift, dual auto-encoder, discriminative projection
