Clustering based approach for incomplete data streams processing

Article type: Research Article

Authors: Najib, Fatma M.^{; *} | Ismail, Rasha M. | Badr, Nagwa L. | Gharib, Tarek F.

Affiliations: Faculty of Computer and Information Sciences, Ain Shams University, Cairo, Egypt

Correspondence: [*] Corresponding author. Fatma M. Najib, Faculty of Computer and Information Sciences, Ain Shams University, Cairo, Egypt. E-mail: [email protected].

Abstract: Recent applications such as sensor networks generate continuous and dynamic data streams. Data streams are often gathered from multiple data sources with some incompleteness. Clustering such data is constrained by incompleteness of data, data distribution, and continuous nature of data streams. Ignoring missing values in incomplete data clustering, especially in high missing rates decreases the clustering performance. Traditional clustering is applied on the whole data without dealing with data distribution. This paper presents an efficient framework called Fuzzy c-means clustering for Incomplete Data streams (FID) that works adaptively with incomplete data streams even with high missing rates. The proposed FID estimates missing values based on the corresponding nearest-neighbors’ intervals. To overcome the previously mentioned data streams clustering problems, the continuous clustering mechanism is adopted and extended to accurately handle the incomplete data streams. Experimental results using two different data sets prove the efficiency of the proposed FID comparing to the alternative approaches.

Keywords: Data streams, incomplete data clustering, fuzzy clustering, nearest neighbor rule

DOI: 10.3233/JIFS-191184

Journal: Journal of Intelligent & Fuzzy Systems, vol. 38, no. 3, pp. 3213-3227, 2020