Big Data: What can official statistics expect?

Abstract

New data sources are becoming available, in particular as a consequence of the enormously growing use of electronic media. These new data sources, often called the Big Data, open new opportunities for official statistics: Statistical products may be delivered in shorter time, with more detailed breakdowns, at lesser costs, and with reduced response burden. The paper gives a short overview of Big Data pilots and projects conducted in official statistics at national and international levels. The experiences from these projects in using the new data sources indicate that there is no uniform methodological approach for using the new data in the various statistical domains nor to take advantage of the new opportunities. Official statistics cannot expect that Big Data will substitute actual data sources like data from surveys and administration, but they may play a role as supplements for existing data in the production of certain statistics. A number of challenges are involved in using Big Data in official statistics: Solutions for methodological and technological issues are needed, a quality framework must be developed, and the staff has to get acquainted with new skills. Further issues concern the statistical environment such as legislative requirements, costs of sourcing of Big Data, and privacy, and have only indirectly to do with the statistical production. Finding solutions for these issues and developing standards that will be accepted internationally may require substantial efforts and take some time.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 18 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.