Geographical aggregation of microblog posts for LDA topic modeling

Issue title: Special Section: Intelligent and Fuzzy Systems applied to Language & Knowledge Engineering

Guest editors: David Pinto and Vivek Singh

Article type: Research Article

Authors: López-Ramírez, Pablo | Molina-Villegas, Alejandro^{; *} | Siordia, Oscar S.

Affiliations: Conacyt – Centro De Investigación En Ciencias De Información Geoespacial, Mexico

Correspondence: [*] Corresponding author. Molina-Villegas Alejandro, Conacyt – Centro de Investigación en Ciencias de Información Geoespacial, Mexico. E-mail: [email protected].

Abstract:  In this paper we propose an aggregation strategy for geolocated Twitter posts based on a hierarchical definition of the regular activity patterns within a specific region. The aggregation yields a series of documents that are used to train a topic model. The resulting model is tested against the ones produced by two other aggregation strategies proposed in the literature: aggregation by user and by hashtag. For comparison, we use quality metrics widely used on the literature. The results show that the Geographical Aggregation performs similarly to hashtag aggregation in terms of Jensen-Shannon Divergence and outperforms other aggregation schemes in its ability to reproduce the original cluster labels. One potential application behind this is the discovery of unusual events or as a basis for geolocating messages from text.

Keywords: Probabilistic topic modeling, geolocation, social network

DOI: 10.3233/JIFS-179037

Journal: Journal of Intelligent & Fuzzy Systems, vol. 36, no. 5, pp. 4901-4908, 2019