Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Shi, Shuoa | Huo, Changweia; c | Guo, Yingchuna; * | Lean, Stephenb | Yan, Ganga | Yu, Minga
Affiliations: [a] School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin, China | [b] School of Fundamental Sciences, Massey University, Palmerston North, New Zealand | [c] Beijing Branch of China United Network Communication Co., Ltd, Beijing, China
Correspondence: [*] Corresponding author. Yingchun Guo, School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin, 300401, China. E-mail: [email protected].
Abstract: Person re-identification with natural language description is a process of retrieving the corresponding person’s image from an image dataset according to a text description of the person. The key challenge in this cross-modal task is to extract visual and text features and construct loss functions to achieve cross-modal matching between text and image. Firstly, we designed a two-branch network framework for person re-identification with natural language description. In this framework we include the following: a Bi-directional Long Short-Term Memory (Bi-LSTM) network is used to extract text features and a truncated attention mechanism is proposed to select the principal component of the text features; a MobileNet is used to extract image features. Secondly, we proposed a Cascade Loss Function (CLF), which includes cross-modal matching loss and single modal classification loss, both with relative entropy function, to fully exploit the identity-level information. The experimental results on the CUHK-PEDES dataset demonstrate that our method achieves better results in Top-5 and Top-10 than other current 10 state-of-the-art algorithms.
Keywords: Person re-identification, cross-modal, natural language description, cascade loss function, truncated attention mechanism
DOI: 10.3233/JIFS-210382
Journal: Journal of Intelligent & Fuzzy Systems, vol. 41, no. 6, pp. 6575-6587, 2021
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
[email protected]
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office [email protected]
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
如果您在出版方面需要帮助或有任何建, 件至: [email protected]