Semi-supervised semantic segmentation using an improved generative adversarial network

Article type: Research Article

Authors: Xu, Di^{; *} | Wang, Zhili^{; *}

Affiliations: State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China

Correspondence: [*] Corresponding authors. Di Xu, State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China. E-mail: [email protected]; Zhili Wang, E-mail: [email protected].

Abstract: This paper proposes a better semi-supervised semantic segmentation network using an improved generative adversarial network. It is important for the discriminator on the pixel level to know whether it correctly distinguishes the predicted probability map. However, currently there is no correlation between the actual credibility and the confidence map generated by the pixel-level discriminator. We study this problem and a new network is proposed, which includes one generator and two discriminators. One of the discriminators can output more reliable confidence maps on the pixel level and the other is trained to generate the probability on the image level, which is used as the dynamic threshold in the semi-supervised module instead of being set manually. In addition, the trusted region shared by the two discriminators is used to provide the semi-supervised reference. Through experiments on the PASCAL VOC 2012 and Cityscapes datasets, the proposed network brings better gains, proving the effectiveness of the network.

Keywords: Semi-supervise semantic segmentation, generative adversarial network, confidence map

DOI: 10.3233/JIFS-202220

Journal: Journal of Intelligent & Fuzzy Systems, vol. 40, no. 5, pp. 9709-9719, 2021