Affiliations: Statistics Netherlands, 6401 CZ Heerlen, The Netherlands
Corresponding author: Sofie De Broe, Center for Big Data Statistics, Statistics Netherlands, PO Box 4481, 6401 CZ Heerlen, The Netherlands. Tel.: +31 570 64 71; E-mail: [email protected].
Abstract: Since 2009 Statistics Netherlands (SN) has been exploring the use of Big Data (BD) in official statistics. This research resulted in new or improved official statistical products such as the Consumer Price Index based on web scraped prices, and the traffic intensity indicator using traffic loop data. With the aim to make use of new BD sources, SN established the Center for Big Data Statistics (CBDS). The CBDS builds upon acquired data science expertise in an ecosystem of academic and private partners in order to make official statistics using survey, administrative and BD sources and methods. This multisource approach provides better insights into complex policy questions. One of these complex questions for policy makers is the energy transition and how to move away from carbon based to renewable energy sources. More detailed data is necessary in order to get a better insight into locally produced renewable energy and to allow policy makers to design policies that allow matching offer and demand. We use multiple data sources in a combined fashion to provide insight into solar energy provision. We conclude by giving general guidelines for the process to embed the experimental statistic in the official statistical process.
Keywords: Big data, experimental statistics, beta products, solar power, energy statistics, energy transition