Affiliations: [a] Department of Statistical Methods, University of Łódź, Łódź, Poland | [b] Department of Trade and Services, Statistics Poland, Poland | [c] Department of Statistics, Poznań University of Economics and Business, Poznań, Poland | [d] Centre for Small Area Estimation, Statistical Office in Poznań, Poznań, Poland
Correspondence:
[*]
Corresponding author: Jacek Białek, Department of Statistical Methods, University of Łódź, Łódź, Poland; Department of Trade and Services, Statistics Poland, Poland. %****␣sji-37-sji210816_temp.tex␣Line␣25␣**** E-mail: [email protected],[email protected].
Abstract: Scanner data offer new opportunities for CPI or HICP calculation. They can be obtained from a wide variety of retailers (supermarkets, home electronics, Internet shops, etc.) and provide information at the level of the barcode. One of advantages of using scanner data is the fact that they contain complete transaction information, i.e. prices and quantities for every sold item. After clearing data and unifying product names, products should be carefully classified (e.g. into COICOP 5 or below), matched, filtered and aggregated. One of new challenges connected with scanner data is the appropriate choice of the index formula. In this article we present a proposal for the implementation of individual stages of handling scanner data. We also point out potential problems during scanner data processing and their solutions. We compare a large number of price index methods based on real scanner data sets and we verify their sensitivity on adopted data filtering and aggregating methods. One of the aims is also to compare calculations of multilateral indices in terms of how time-consuming they are. Finally, the paper investigates distances between these indices and the theoretical, expected value of the price share when prices are log-normally distributed. It is a new approach to providing an additional criterion in the price index selection.
