Statistical learning in official statistics: The case of statistical matching

Article type: Research Article

Authors: D’Orazio, Marcello^{a; b}

Affiliations: [a] Office of Chief Statistician, Food and Agriculture Organization of the United Nations, Viale delle Terme di Caracalla, Rome, Italy | [b] Italian National Institute of Statistics, Rome, Italy | Tel.: +39 06 570 52073; E-mail: [email protected] or [email protected]

Correspondence: [*] Corresponding author: Office of Chief Statistician, Food and Agriculture Organization of the United Nations, Viale delle Terme di Caracalla, Rome, Italy. Tel.: +39 06 570 52073; E-mail: [email protected]@istat.it.

Abstract: Data integration is becoming a crucial task in National Statistical Institutes in order to exploit the information provided by already existing data sources. Here the focus is on statistical matching methods; they are designed to integrate data stemming out from traditional sample surveys referred to the same target population. In particular, this work shows how popular statistical learning techniques can be beneficial for matching purposes. Two proposals are presented, having a different final scope: the creation of a “fused” data set or the assessment of the uncertainty due to the typical statistical matching scenario. The characteristics of these procedures are investigated through a series of simulations and in an application to real survey data. The achieved results are encouraging and show that some statistical learning techniques can be very effective in exploiting the information provided by already existing survey data, permitting a reduction of the uncertainty determined by the typical statistical matching setting.

Keywords: Data integration, machine learning

DOI: 10.3233/SJI-190518

Journal: Statistical Journal of the IAOS, vol. 35, no. 3, pp. 435-441, 2019