Big Data andofficial Statistics Experiences at Statistics Netherlands
|
|
- Geoffrey Nichols
- 8 years ago
- Views:
Transcription
1 Big Data andofficial Statistics Experiences at Statistics Netherlands Peter Struijs Poznań, Poland, 10 September 2015
2 Outline Big Data and official statistics Experiences at Statistics Netherlands with: - use of road sensor data - use of mobile phone location data - use of public social media messages Issues and solutions Strategic, policy and organisational challenges Cooperation and collaboration 2
3 What is Big Data? 3
4 4
5 Data sources and approaches Surveys / questionnaires Administrative data sources sampling theory Where does Big Data fit in? New methods may be needed, e.g. modeling for nowcasting and other methods not based on sampling theory 5
6 Potential Opportunities New statistics More detailed statistics More timely statistics Nowcasts and early indicators Quality improvement Response burden reduction Cost reduction and higher efficiency 6
7 Examples of possible Big Data sources Road sensor data Mobile phone location data Public social media messages Websites Google Trends Satellite information Etc 7
8 Data scientists involved in the research shown Piet Daas (photo) May Offermans Marco Puts Martijn Tennekes 8
9 Statistics based on road sensor data Aim: Statistics on traffic intensities Characteristics of the data source Research on the usability of the data Process of using the data for statistics Issues when using traffic loop data 9
10 Road sensor data Source: National Data Warehouse for Traffic Information (NDW) There are traffic loops on Dutch motorways, and on provincial roads Each minute (24/7) the number of passing vehicles is counted, and their average speed Three different length classes are distinguished No identification of vehicles Around 230 million records a day used Locations 10
11 The main roads 11
12 A special dike 12
13 Road sensors in the dike 13
14 Minute data of one sensor for 196 days 14
15 Researching the data Cross correlation between sensor pairs - Used to validate metadata Trajectory speed vs. point speed - Average speed is 98 Km/h
16 Small, medium-sized & large vehicles 22
17 Sensors in a road segment 17
18 Process of making traffic intensities statistics Select sensors on Dutch highways Preprocessing Remove non-informative variables Remove bad records Exclude bad sensors Quality indicators for daily data per sensor Processing - Reduce dimensions on same road and region Obtain number of vehicles for each road and region For each road and region, calculate monthly traffic intensity Use of R-Hadoop 18 Validation and publication
19 Data options Historical database - Request data via web interface - Minute data for all highways (48 variables, Jan April 2014: around 2.5 TB) Data stream - Every minute, all data for all active sensors - Continuously collected 19
20 Road sensor data: Issues and non-issues Non-issues: Privacy Data acquisition Issues: Methodology - Selectivity - Quality Infrastructural needs Other issues - Skills needed - Transition from research to regular statistics 20
21 References: statistical use of road sensor data Publication of statistical results (in Dutch): Explanation in English: C3E4C4E9375B/0/a13busiestnationalmotorwayinthenetherlands.pdf Research reference: Puts, M., Tennekes, M. and Daas, P. (2014) Using Road Sensor Data for Official Statistics: Towards a Big Data Methodology. Paper for Strata + Hadoop World, Barcelona, Spain. 21
22 Statistics based on mobile phone location data Why use mobile phone data for official statistics? Characteristics of the data source Research on the usability of the data Issues when using mobile phone location data Solutions tothe issues 22
23 Possible uses of mobile phone data Daytime population statistics Mobility statistics Tourism statistics Other uses 23
24 Mobile phone activity as a data source Nearly every person in the Netherlands has a mobile phone - Usually on them - Almost always switched on - Many people are very active during the day There is a grid of antennas with good coverage 24 Data of a single mobile company was used - Hourly aggregates per area - Threshold of 15 events
25 Daytime population based on mobile phone data
26 Issues when using mobile phone data Privacy Data acquisition Methodology - Representativeness - Selectivity - Quality Other issues - Infrastructure - Skills needed 26
27 Solutions Agreement with data provider to provide only aggregates and apply a threshold Data provider performed analysis of mobile phone ownership characteristics A large number of analyses were made, with the regular population registration data as a reference A number of assumptions had to be made 27
28 References: statistical use of mobile phone data Research references: Daas, P.J.H., Puts, M.J., Buelens, B. and van den Hurk, P.A.M. (2015) Big Data as a Source for Official Statistics. Journal of Official Statistics 31(2), pp Daas, P. and Burger, J. (2014) Profiling big data sources to assess their selectivity. Paper for the 2015 New Techniques and Technologies for Statistics conference, Brussels, Belgium. 28
29 Mobile phone data versus road sensor data 29
30 Statistics based on social media data Why use social media data for official statistics? Characteristics of the data source Research on the usability of the data Issues when using social media data 30
31 Possible uses of social media data Sentiment indicators - e.g. consumer confidence index Social indicators - e.g. social coherence indices Other uses 31
32 Social media Dutch are very active on social media! - Around 60% according to a surveyna altijd bij zich en staat vrijwel altijd aan Steeds meer mensen hebben een smartphone! Mogelijke informatiebron voor: - Welke onderwerpen zijn actueel: Aantal berichten en sentiment hierover - Als meetinstrument te gebruiken voor:. 32 Map by Eric Fischer (via Fast Company)
33 The data All social media messages: - that are written in Dutch - and are public These messages are systematically and instantly collected by the Dutch firm Coosto Dataset of more than 3.5 billion messages: - covering June 2010 till the present - between 3-4 million new messages added per day 33
34 Research question Can we replicate the consumer confidence index by only using social media data, while reducing production time? 34
35 Sentiment determination Bag of words approach - list of Dutch words with their associated sentiment - added social media specific words ( FAIL, LOL, OMG etc.) Use overall score to determine sentiment - is either positive, negative or neutral Average sentiment per period (day / week / month) - (#positive - #negative)/#total * 100% 35
36 Sentiment per platform (~10%) (~80%)
37 Build a model Idea: Fitting characteristics derived from social media messages to consumer confidence Success: If correlation can be found that is high and remains high, that is, has predictive power 37
38 Figure 1. Development of daily, weekly and monthly aggregates of social media sentiment from June 2010 until November 2013, in green, red and black, respectively. In the insert the development of consumer confidence is shown for the identical period. 38
39 Results High correlation achieved (0.9) Changes in consumer confidence preceed changes in sentiment by one week Short processing time, so time-to-market may be reduced. Sentiment index can be produced on a weekly basis To be considered: - Use model-based figures as early indicators - Reduce sampling of consumer confidence index 39
40 General sentiment indicator (draft version) 40
41 Issues when using social media data Lesser issues: Privacy Data acquisition Main issues: Methodology - Selectivity - Meaning of the data - Validity of methods used Other issues - Skills needed 41
42 Questions on the validity of methods used Is it acceptable, under certain conditions, to base official statistics on correlations? If so, what are the conditions? What to do if there is a shock? 42
43 Reference: statistical use of social media data Research reference: Daas, P.J.H. and Puts, M.J.H. (2014) Social Media Sentiment and Consumer Confidence. European Central Bank Statistics Paper Series No. 5, Frankfurt, Germany. 43
44 Big Data Characteristics Definition: Volume Velocity Variety Data characteristics: Unstructured data Selectivity Population dynamics Event data Organic data Distributed data Data use: Other ways of processing Fundamentally new applications 44
45 Overview of Issues Getting access to the data Usability of the data - Meaning of the data, stability of the source, reproducability Methodologal issues - Selectivity, representativeness, unknown population, quality and validity Privacy, confidentiality and reputation IT-infrastructure and security Knowledge and skills Transition from research to production Strategic challenges 45
46 Possible responses to the issues Invest in good relations with the data provider Invest in methodological research and play with the data to get a grip on quality Use only aggregate data if possible Explore alternatives to population-based estimation methods Keep an open mindset Take the strategic challenges seriously 46
47 Strategic aspects Others start producing statistics - there may be quality issues - but they are extremely rapid - and there is obviously demand Need for good, impartial information (benchmark information) will remain - without a monopoly for NSIs There is a need for validation of information produced by others 47
48 Billion Prices Project MIT 48
49 49
50 The Roadmap Approach Awareness that Big Data is a strategic issue Position paper for Board of Directors Roadmap Big Data External validation of the Roadmap Roadmap updated twice a year for Board of Directors Roadmap monitor Deputy Director General responsible at strategic level Coordination group forbig Data 50
51 The Scope of the Roadmap Identification of outputs to be based on Big Data For each output, definition of time target and ownership Identification by owner of conditions to be fulfilled Commitment by supporting services for fulfilling the conditions (IT, data collection, methodological support, ) Supporting programmes 51
52 The Roadmap Projects Focus projects Road sensor data for traffic intensities statistics Mobile phone data for daytime population statistics Other projects Internet data for price statistics Financial transactions data for statistics Social media data for detecting trends in social cohesion Internet data for encoding enterprise purchases and sales 52
53 Supporting Programmes Big Data features in: Innovation programme Methodological research programme 53
54 Cooperation and Collaboration on Big Data Statistics Netherlands works together with: Other NSIs UN, UNECE, EU, WorldBank ESSnet on Big Data (to be confirmed) Government organisations Universities and research organisations Data providers IT providers Big Data firms Research consortia (e.g. H2020) 54
55 UNECE Big Data Activities Classification of Big Data sources Big Data project in 2014, with three Task Teams: - Partnerships - Privacy - Quality Sandbox in 2014, 2015 and possibly beyond Big Data survey, together with UNSD Results: 55
56 UN Big Data Activities Global Working Group on Big Data for Official Statistics with eight Task Teams: - Mobile phone data - Satellite imagery - Social media data - Access / partnerships - Advocacy / communication - Big Data and SDGs - Training / skills / capacity building - Cross-cutting issues UNSD survey on Big Data for official statistics 56
57 Draft Big Data Access Principles (UN) Social responsibility Level playing field Equal treatment Confidentiality and security Transparency Respect for business interest Proportionality 57
58 Conclusion: The Way Forward Get to know Big Data Use Big Data for efficiency and response burden reduction Use Big Data for early indicators Use Big Data for filling gaps and new demands Use new professional methods where needed Create the right environment Don t do it alone! 58
59 General references Glasson, M., Trepanier, J., Patruno, V., Daas, P., Skaliotis, M. and Khan, A. (2013) What does "Big Data" mean for Official Statistics? Paper for the High-Level Group for the Modernization of Statistical Production and Services, March 10. Struijs, P., Braaksma, B. and Daas, P. (2014) Official Statistics and Big Data. Big Data & Society, April June, pp Struijs, P. and Daas, P.J.H. (2013) Big Data, Big Impact? Paper for the Seminar on Statistical Data Collection, Geneva, Switzerland. Struijs, P. and Daas, P. (2014) Quality Approaches to Big Data in Official Statistics. Paper for the European Conference on Quality in Official Statistics 2014, Vienna, Austria. 59
60 The Future 60
61 Questions? Thank you for your attention! 61
Big data, the future of statistics
Big data, the future of statistics Experiences from Statistics Netherlands Dr. Piet J.H. Daas Senior-Methodologist, Big Data research coordinator and Marco Puts, Martijn Tennekes, Alex Priem, Edwin de
More informationBig Data @ CBS. Experiences at Statistics Netherlands. Dr. Piet J.H. Daas Methodologist, Big Data research coördinator. Statistics Netherlands
Big Data @ CBS Experiences at Statistics Netherlands Dr. Piet J.H. Daas Methodologist, Big Data research coördinator Statistics Netherlands April 20, Enschede Overview Big Data Research theme at Statistics
More information* With contributions of: Edwin de Jonge and Paul van den Hurk. Definition and the 3 V s. Can Big Data be used for official statistics?
Big Data (and official statistics) Piet Daas and Mark van der Loo* 3 Statistics Netherlands * With contributions of: Edwin de Jonge and Paul van den Hurk Overview What s Big Data? Definition and the 3
More informationBig Data (and official statistics) *
Distr. GENERAL Working Paper 11 April 2013 ENGLISH ONLY UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE (ECE) CONFERENCE OF EUROPEAN STATISTICIANS ORGANISATION FOR ECONOMIC COOPERATION AND DEVELOPMENT (OECD)
More informationVisualization and Big Data in Official Statistics
Visualization and Big Data in Official Statistics Martijn Tennekes In cooperation with Piet Daas, Marco Puts, May Offermans, Alex Priem, Edwin de Jonge From a Official Statistics point of view Three types
More informationBig Data as a Data Source for Official Statistics: experiences at Statistics Netherlands
Proceedings of Statistics Canada Symposium 2014 Beyond traditional survey taking: adapting to a changing world Big Data as a Data Source for Official Statistics: experiences at Statistics Netherlands Piet
More informationBig Data. Case studies in Official Statistics. Martijn Tennekes. Special thanks to Piet Daas, Marco Puts, May Offermans, Alex Priem, Edwin de Jonge
Big Data Case studies in Official Statistics Martijn Tennekes Special thanks to Piet Daas, Marco Puts, May Offermans, Alex Priem, Edwin de Jonge From a Official Statistics point of view Three types of
More informationSelectivity of Big data
Discussion Paper Selectivity of Big data The views expressed in this paper are those of the author(s) and do not necessarily reflect the policies of Statistics Netherlands 2014 11 Bart Buelens Piet Daas
More informationBig Data and Official Statistics
Big Data and Official Statistics Daas P.J.H. 1, Puts M.J. 2, Buelens B. 3 and van den Hurk P.A.M. 4 1 Statistics Netherlands, Methodology sector, e-mail: pjh.daas@cbs.nl 2 Statistics Netherlands, Traffic
More informationUnited Nations Global Working Group on Big Data for Official Statistics Task Team on Cross-Cutting Issues
United Nations Global Working Group on Big Data for Official Statistics Task Team on Cross-Cutting Issues Deliverable 2: Revision and Further Development of the Classification of Big Data Version 12 October
More informationWHAT DOES BIG DATA MEAN FOR OFFICIAL STATISTICS?
UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS 10 March 2013 WHAT DOES BIG DATA MEAN FOR OFFICIAL STATISTICS? At a High-Level Seminar on Streamlining Statistical Production
More informationHow To Use Big Data For Official Statistics
UNITED NATIONS ECE/CES/BUR/2015/FEB/11 ECONOMIC COMMISSION FOR EUROPE 20 January 2015 CONFERENCE OF EUROPEAN STATISTICIANS Meeting of the 2014/2015 Bureau Geneva (Switzerland), 17-18 February 2015 For
More informationBig Data and Official Statistics The UN Global Working Group
Big Data and Official Statistics The UN Global Working Group Dr. Ronald Jansen Chief, International Trade Statistics United Nations Statistics Division jansen1@un.org Overview What is Big Data? What is
More informationRe-make/Re-model : Should big data change the modelling paradigm in official statistics? 1
Statistical Journal of the IAOS 31 (2015) 193 202 193 DOI 10.3233/SJI-150892 IOS Press Re-make/Re-model : Should big data change the modelling paradigm in official statistics? 1 Barteld Braaksma a, and
More informationbig data in the European Statistical System
Conference by STATEC and EUROSTAT Savoir pour agir: la statistique publique au service des citoyens big data in the European Statistical System Michail SKALIOTIS EUROSTAT, Head of Task Force 'Big Data'
More informationModernization of European Official Statistics through Big Data methodologies and best practices: ESS Big Data Event Roma 2014
Modernization of European Official Statistics through Big Data methodologies and best practices: ESS Big Data Event Roma 2014 CONCEPT PAPER (DRAFT VERSION v0.3) Big Data for Official Statistics: recognition
More informationUnlocking the Full Potential of Big Data
Unlocking the Full Potential of Big Data Lilli Japec, Frauke Kreuter JOS anniversary June 2015 facebook.com/statisticssweden @SCB_nyheter The report is available at https://www.aapor.org Task Force Members:
More informationResults of the Task Team Privacy
United Nations Economic Commission for Europe Statistical Division Workshop on the Modernisation of Statistical Production and Services November 19-20, 2014 The Role of Big Data in the Modernisation of
More informationInternational collaboration to understand the relevance of Big Data for official statistics
Statistical Journal of the IAOS 31 (2015) 159 163 159 DOI 10.3233/SJI-150889 IOS Press International collaboration to understand the relevance of Big Data for official statistics Steven Vale United Nations
More informationEconomic and Social Council
United Nations E/CN.3/2015/4 Economic and Social Council Distr.: General 12 December 2014 Original: English Statistical Commission Forty-sixth session 3 6 March 2015 Item 3(a) (iii) of the provisional
More informationIntroduction to Quality Assessment
Introduction to Quality Assessment EU Twinning Project JO/13/ENP/ST/23 23-27 November 2014 Component 3: Quality and metadata Activity 3.9: Quality Audit I Mrs Giovanna Brancato, Senior Researcher, Head
More informationData Visualization in Official Statistics
Data Visualization in Official Statistics Martijn Tennekes Jan van der Laan, Edwin de Jonge, Jessica Solcer, Alex Priem Statistics Netherlands / CBS - Creates and publishes official statistics on economics,
More informationHLG - Big Data Sandbox for Statistical Production
HLG - Big Data Sandbox for Statistical Production Learning to produce meaningful statistics from big data Tatiana Yarmola (ex) Intern at the UNECE Statistical Division INEGI, December 3, 2013 Big Data:
More informationInnovation at Statistics Netherlands
Innovation at Statistics Netherlands Barteld Braaksma 1, Marleen Verbruggen 2 1 Statistics Netherlands, e-mail: bbka@cbs.nl 2 Statistics Netherlands, e-mail: mvbn@cbs.nl Abstract In 2012, Statistics Netherlands
More informationReport of the 2015 Big Data Survey. Prepared by United Nations Statistics Division
Statistical Commission Forty-seventh session 8 11 March 2016 Item 3(c) of the provisional agenda Big Data for official statistics Background document Available in English only Report of the 2015 Big Data
More informationUN Global Working Group on Big Data
UN Global Working Group on Big Data UNECE Workshop on Statistical Data Collection Washington, DC 29 April 1 May 2015 United Nations Statistics Division Nancy Snyder, Statistician, International Merchandise
More informationNew and Emerging Methods
New and Emerging Methods Big Data as a Source of Statistical Information 1 Piet J.H. Daas and Marco J.H. Puts Abstract Big Data is an extremely interesting data source for statistics. Since more and more
More informationBig data coming soon... to an NSI near you. John Dunne. Central Statistics Office (CSO), Ireland John.Dunne@cso.ie
Big data coming soon... to an NSI near you John Dunne Central Statistics Office (CSO), Ireland John.Dunne@cso.ie Big data is beginning to be explored and exploited to inform policy making. However these
More informationUSE OF GEOSPATIAL AND WEB DATA FOR OECD STATISTICS
USE OF GEOSPATIAL AND WEB DATA FOR OECD STATISTICS CCSA SPECIAL SESSION ON SHOWCASING BIG DATA 1 OCTOBER 2015 Paul Schreyer Deputy-Director, Statistics Directorate, OECD OECD APPROACH OECD: Facilitator
More informationItem 5.2. 3 rd International Transport Forum. Big Data to monitor air and maritime transport. Paris, 17-18 March 2016
3 rd International Transport Forum Paris, 17-18 March 2016 Item 5.2 Big Data to monitor air and maritime transport DG EUROSTAT - Anna Białas-Motyl, Transport statistics & TF Big Data Content Big Data at
More informationRATIONALISING DATA COLLECTION: AUTOMATED DATA COLLECTION FROM ENTERPRISES
Distr. GENERAL 8 October 2012 WP. 13 ENGLISH ONLY UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Seminar on New Frontiers for Statistical Data Collection (Geneva, Switzerland,
More informationData Intensive Research Initiative for South Africa (DIRISA)
Data Intensive Research Initiative for South Africa (DIRISA) A Reinterpreted Vision A. Vahed 25 November 2014 Outline Background Data Landscape Strategy & Objectives Activities & Outputs Organisational
More informationICT MICRODATA LINKING PROJECTS. Brian Ring Central Statistics Office
ICT MICRODATA LINKING PROJECTS Brian Ring Central Statistics Office Some CSO Background CSO runs annual survey of enterprises and households integration work to date has focussed on data from enterprises
More informationBig Data for Official Statistics The 2030 Agenda for Sustainable Development
Big Data for Official Statistics The 2030 Agenda for Sustainable Development Ronald Jansen Assistant Director United Nations Statistics Division 10/09/2015 United Nations Statistics Division Slide 1 Overview
More informationThis survey addresses the broader, organizational context in which Big Data projects operate. A companion survey addresses individual projects.
Introduction This survey has been developed jointly by the United Nations Statistics Division (UNSD) and the United Nations Economic Commission for Europe (UNECE). Our goal is to provide an overview of
More informationBig Data, Official Statistics and Social Science Research: Emerging Data Challenges
Big Data, Official Statistics and Social Science Research: Emerging Data Challenges Professor Paul Cheung Director, United Nations Statistics Division Building the Global Information System Elements of
More informationBig data for official statistics
Big data for official statistics Strategies and some initial European applications Martin Karlberg and Michail Skaliotis, Eurostat 27 September 2013 Seminar on Statistical Data Collection WP 30 1 Big Data
More informationSTATISTICS PAPER SERIES
STATISTICS PAPER SERIES NO 5 / SEPTEMBER 2014 SOCIAL MEDIA SENTIMENT AND CONSUMER CONFIDENCE Piet J.H. Daas and Marco J.H. Puts In 2014 all ECB publications feature a motif taken from the 20 banknote.
More informationNew Frontiers for Official Statistics
European Data Forum 2015 November 16-17, 2015, Luxembourg New Frontiers for Official Statistics Mariana KOTZEVA EUROSTAT, Deputy Director General Key issues 1. A dynamically changing data ecosystem 2.
More informationA Suggested Framework for the Quality of Big Data. Deliverables of the UNECE Big Data Quality Task Team December, 2014
A Suggested Framework for the Quality of Big Data Deliverables of the UNECE Big Data Quality Task Team December, 2014 Contents 1. Executive Summary... 3 2. Background... 5 3. Introduction... 7 4. Principles...
More informationDimensions of Statistical Quality
Inter-agency Meeting on Coordination of Statistical Activities SA/2002/6/Add.1 New York, 17-19 September 2002 22 August 2002 Item 7 of the provisional agenda Dimensions of Statistical Quality A discussion
More informationBig data in official statistics Insights about world heritage from the analysis of Wikipedia use
Big data in official statistics Insights about world heritage from the analysis of Wikipedia use Fernando Reis, European Commission - Eurostat International Symposium on the Measurement of Digital Cultural
More informationWhite Paper. How Streaming Data Analytics Enables Real-Time Decisions
White Paper How Streaming Data Analytics Enables Real-Time Decisions Contents Introduction... 1 What Is Streaming Analytics?... 1 How Does SAS Event Stream Processing Work?... 2 Overview...2 Event Stream
More informationTHE STATISTICAL DATA WAREHOUSE: A CENTRAL DATA HUB, INTEGRATING NEW DATA SOURCES AND STATISTICAL OUTPUT
Distr. GENERAL 8 October 2012 WP. 18 ENGLISH ONLY UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Seminar on New Frontiers for Statistical Data Collection (Geneva, Switzerland,
More informationINNOBAROMETER 2015 - THE INNOVATION TRENDS AT EU ENTERPRISES
Eurobarometer INNOBAROMETER 2015 - THE INNOVATION TRENDS AT EU ENTERPRISES REPORT Fieldwork: February 2015 Publication: September 2015 This survey has been requested by the European Commission, Directorate-General
More informationHow to use Big Data in Industry 4.0 implementations. LAURI ILISON, PhD Head of Big Data and Machine Learning
How to use Big Data in Industry 4.0 implementations LAURI ILISON, PhD Head of Big Data and Machine Learning Big Data definition? Big Data is about structured vs unstructured data Big Data is about Volume
More informationTowards Principles for Access to Data for Official Statistics
Towards Principles for Access to Data for Official Statistics Discussion note by the United Nations Global Working Group on Big Data for Official Statistics for the 13th World Telecommunication/ICT Indicators
More informationAdvanced Metering Infrastructure
Advanced Metering Infrastructure Research Project 2 Vic Ding SNE, UvA February 8th 2012 Agenda Background Research motivation and questions Research methods Research findings Stakeholders Legislation Smart
More informationThe use of Big Data for statistics
Workshop on the use of mobile positioning data for tourism statistics Prague (CZ), 14 May 2014 The use of Big Data for statistics EUROSTAT, Unit G-3 "Short-term statistics; tourism" What is the role of
More informationThe Sandbox 2015 Report
United Nations Economic Commission for Europe Statistical Division Workshop on the Modernisation of Official Statistics November 24-25, 2015 The Sandbox project The Sandbox 2015 Report Antonino Virgillito
More informationIT OUTSOURCING STUDY GERMANY/AUSTRIA 2015 MANAGEMENT SUMMARY
IT OUTSOURCING STUDY GERMANY/AUSTRIA 2015 MANAGEMENT SUMMARY Whitelane Research / Navisco AG - Sourcing Professionals 1 MANAGEMENT SUMMARY The 2015 German/Austrian IT Outsourcing Study, conducted by Whitelane
More informationCompany information around the globe
Company information around the globe bvdinfo.com Company information across the globe Find, analyse and compare companies worldwide using Orbis Find Analyse Compare Orbis combines information from regulatory
More informationNew forms of data for official statistics Niels Ploug Statistics Denmark npl@dst.dk
New forms of data for official statistics Niels Ploug Statistics Denmark npl@dst.dk Abstract Keywords: administrative data, Big Data, data integration, meta data Introduction The use of new forms of data
More informationRecent developments in EU Transport Policy
Recent developments in EU Policy Paolo Bolsi DG MOVE - Unit A3 Economic Analysis and Impact Assessment 66 th Session - Working Party on Statistics United Nations Economic Committee for Europe 17-19 June
More informationOfficial Statistics in the Age. of Big Data. SAS Forum BeLux 2014. Michail.Skaliotis@ec.europa.eu Albrecht.Wirthmann@ec.europa.eu.
Official Statistics in the Age SAS Forum BeLux 2014 of Big Data Michail.Skaliotis@ec.europa.eu Albrecht.Wirthmann@ec.europa.eu Table of Contents / Storyboard What is "Official Statistics"? Drivers of Big
More informationHow To Understand The Data Collection Of An Electricity Supplier Survey In Ireland
COUNTRY PRACTICE IN ENERGY STATISTICS Topic/Statistics: Electricity Consumption Institution/Organization: Sustainable Energy Authority of Ireland (SEAI) Country: Ireland Date: October 2012 CONTENTS Abstract...
More informationBig Data: What Can Official Statistics Expect?
Big Data: What Can Official Statistics Expect? Peter Hackl Österreichische Statistiktage 2015 Outline Data Needs in Official Statistics Alternative Data Sources Historical Facts Some Initiatives in Detail
More informationCSPA. Common Statistical Production Architecture International activities on Big Data in Official Statistics. Carlo Vaccari Istat (vaccari@istat.
CSPA Common Statistical Production Architecture International activities on Big Data in Official Statistics Carlo Vaccari Istat (vaccari@istat.it) Data deluge Big Data definitions Data Characteristics:
More informationThis survey addresses individual projects, partnerships, data sources and tools. Please submit it multiple times - once for each project.
Introduction This survey has been developed jointly by the United Nations Statistics Division (UNSD) and the United Nations Economic Commission for Europe (UNECE). Our goal is to provide an overview of
More informationSurvey on Merchants' Costs of Processing Cash and Card Payments Preliminary Results
Survey on Merchants' Costs of Processing Cash and Card Payments Preliminary Results 19 February 2014 Background Visa and MasterCard MIF cases MIFs are a restriction of competition 'Merchant Indifference
More information2. Metadata update 2.1 Metadata last certified 07 August 2013 2.2 Metadata last posted 07 August 2013 2.3 Metadata last update 07 August 2013
1. Contact 1.1 Contact organisation STATEC 1.2 Contact organisation unit Unit SOC4: Price statistics 1.5 Contact mail address 13, rue Erasme L-1468 Luxembourg 2. Metadata update 2.1 Metadata last certified
More informationEIOPA Stress Test 2011. Press Briefing Frankfurt am Main, 4 July 2011
EIOPA Stress Test 2011 Press Briefing Frankfurt am Main, 4 July 2011 Topics 1. Objectives 2. Initial remarks 3. Framework 4. Participation 5. Results 6. Summary 7. Follow up 2 Objectives Overall objective
More informationFleet Logistics and TÜV SÜD in strategic partnership
Press release Fleet Logistics and TÜV SÜD in strategic partnership to create major international fleet business Leading pan European fleet management specialist, Fleet Logistics, has announced a strategic
More informationPRINCIPLES FOR EVALUATION OF DEVELOPMENT ASSISTANCE
PRINCIPLES FOR EVALUATION OF DEVELOPMENT ASSISTANCE DEVELOPMENT ASSISTANCE COMMITTEE PARIS, 1991 DAC Principles for Evaluation of Development Assistance Development Assistance Committee Abstract: The following
More informationWat verwacht de hybride consument van de verschillende distributiesystemen? Jan Verlinden Insurance Leader Belgium Capgemini
Wat verwacht de hybride consument van de verschillende distributiesystemen? Jan Verlinden Insurance Leader Belgium Capgemini Each Year, Capgemini and Efma Publish Insights on the Insurance Sector Through
More informationBig Data Big Noise. Its relevance to industrial Statistics in the context of SDG monitoring. Shyam Upadhyaya UNIDO
Big Data Big Noise Its relevance to industrial Statistics in the context of SDG monitoring Shyam Upadhyaya UNIDO CCSA SPECIAL SESSION ON SHOWCASING BIG DATA 1 October 2015, Bangkok Data revolution and
More informationESS event: Big Data in Official Statistics. Antonino Virgillito, Istat
ESS event: Big Data in Official Statistics Antonino Virgillito, Istat v erbi v is 1 About me Head of Unit Web and BI Technologies, IT Directorate of Istat Project manager and technical coordinator of Web
More informationGlobal Financial Services Conference 2013
Global Financial Services Conference 2013 Engagement at ING: how to maintain high levels of employee engagement in a totally transformed bank Sarah Keizer, ING Yves Duhaldeborde, Towers Watson Thursday
More informationT-61.6010 Non-discriminatory Machine Learning
T-61.6010 Non-discriminatory Machine Learning Seminar 1 Indrė Žliobaitė Aalto University School of Science, Department of Computer Science Helsinki Institute for Information Technology (HIIT) University
More informationEconomic and Social Council
United Nations E/CN.3/2015/4 Economic and Social Council Distr.: General 12 December 2014 Original: English Statistical Commission Forty-sixth session 3-6 March 2015 Item 3 (a) (iii) of the provisional
More informationEconomic and Social Council
United Nations E/CN.3/2016/6* Economic and Social Council Distr.: General 17 December 2015 Original: English Statistical Commission Forty-seventh session 8-11 March 2016 Item 3 (c) of the provisional agenda**
More informationProject Outline: Data Integration: towards producing statistics by integrating different data sources
Project Outline: Data Integration: towards producing statistics by integrating different data sources Introduction There are many new opportunities created by data sources such as Big Data and Administrative
More informationHMG Corporate Development Team. gloria.andreu@havasmg.com ines.campanella@havasmg.com oscar.munoz@havasmg.com santiago.murillo@havasmg.
HMG Corporate Development Team gloria.andreu@havasmg.com ines.campanella@havasmg.com oscar.munoz@havasmg.com santiago.murillo@havasmg.com NOTICE: Proprietary and Confidential All the content of this document
More informationACCESSIBLE INFORMATION PROVISION FOR LIFELONG LEARNING KEY POLICY MESSAGES
ACCESSIBLE INFORMATION PROVISION FOR LIFELONG LEARNING KEY POLICY MESSAGES Introduction The purpose of this paper is to give an overview of the conclusions and recommendations of the European Agency for
More informationFleet Logistics partners with AlertDriving to offer online driver training and risk assessment
Fleet Logistics partners with AlertDriving to offer online driver training and risk assessment Europe s largest independent fleet management provider, Fleet Logistics, has entered into a strategic partnership
More informationCOMMISSION OF THE EUROPEAN COMMUNITIES. Proposal for a RECOMMENDATION OF THE COUNCIL AND OF THE EUROPEAN PARLIAMENT
COMMISSION OF THE EUROPEAN COMMUNITIES Brussels, 12.10.2004 COM(2004) 642 final 2004/0239 (COD) Proposal for a RECOMMENDATION OF THE COUNCIL AND OF THE EUROPEAN PARLIAMENT on further European cooperation
More informationUse of Mobile Positioning Data for Tourism Statistics
Peter Laimer Johanna Ostertag-Sydler Directorate Spatial Statistics Workshop 14 th May 2014 Prague, Czech Republic Use of Mobile Positioning Data for Tourism Statistics Austrian views www.statistik.at
More informationFCD in the real world system capabilities and applications
19th ITS World Congress, Vienna, Austria, 22/26 October 2012 EU-00040 FCD in the real world system capabilities and applications Anita Graser 1*, Melitta Dragaschnig 1, Wolfgang Ponweiser 1, Hannes Koller
More informationSUMMARY OF THE IMPACT ASSESSMENT
EN EN EN COMMISSION OF THE EUROPEAN COMMUNITIES Brussels, SEC(2008) 350/2 COMMISSION STAFF WORKING DOCUMENT accompanying the Proposal for a DIRECTIVE OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL facilitating
More informationIT OUTSOURCING STUDY EUROPE 2015/2016 MANAGEMENT SUMMARY
IT OUTSOURCING STUDY EUROPE 2015/2016 MANAGEMENT SUMMARY Whitelane Research 1 MANAGEMENT SUMMARY The 2015/2016 European IT Outsourcing Study, conducted by Whitelane Research, investigates more than 4480
More informationChapter 7. Using Hadoop Cluster and MapReduce
Chapter 7 Using Hadoop Cluster and MapReduce Modeling and Prototyping of RMS for QoS Oriented Grid Page 152 7. Using Hadoop Cluster and MapReduce for Big Data Problems The size of the databases used in
More informationDiscussion Paper on Follow-up and Review of the Post-2015 Development Agenda - 12 May 2015
Discussion Paper on Follow-up and Review of the Post-2015 Development Agenda - 12 May 2015 Introduction This discussion paper outlines some key elements on follow-up and review which have emerged from
More informationPRESS RELEASE Amsterdam, 23 July 2010
CORPORATE COMMUNICATIONS PRESS RELEASE Amsterdam, 23 July 2010 ING comfortably passes CEBS stress test Outcome reflects strong capital position and resilient balance sheet Under adverse stress scenario
More informationEU Twinning Project IS12/ENP-APFI/08
EU Twinning Project IS12/ENP-APFI/08 Support to the Israeli Central Bureau of Statistics in the development of National Accounts, Education Statistics, Survey Methodology, ICBS Website and Coordination
More informationAssuring the Cloud. Hans Bootsma Deloitte Risk Services hbootsma@deloitte.nl +31 (0)6 1098 0182
Assuring the Cloud Hans Bootsma Deloitte Risk Services hbootsma@deloitte.nl +31 (0)6 1098 0182 Need for Assurance in Cloud Computing Demand Fast go to market Support innovation Lower costs Access everywhere
More informationReport on impacts of raised thresholds defining SMEs
Knowledge creating results--- DG Internal Market Report on impacts of raised thresholds defining SMEs Impact assessment on raising the thresholds in the 4th Company Law Directive (78/660/EEC) defining
More informationTesting 3Vs (Volume, Variety and Velocity) of Big Data
Testing 3Vs (Volume, Variety and Velocity) of Big Data 1 A lot happens in the Digital World in 60 seconds 2 What is Big Data Big Data refers to data sets whose size is beyond the ability of commonly used
More informationREPORT FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT AND THE COUNCIL
EUROPEAN COMMISSION Brussels, 25.9.2014 COM(2014) 592 final REPORT FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT AND THE COUNCIL on the implementation in the period from 4 December 2011 until 31 December
More informationDeveloping and Analyzing Firm-Level Indicators on Productivity and Reallocation
Policy brief 2024 February 2011 John Haltiwanger and Eric Bartelsman Developing and Analyzing Firm-Level Indicators on Productivity and Reallocation In brief Productivity growth is the main driver of long-run
More informationHow To Understand Factoring
EIF Project "Jeremie" General Report on Factoring 1 Market analysis on Factoring in EU 25+2 prepared by International Factors Group (IFG) for European Investment Fund (EIF) project JEREMIE Preliminary
More informationThe Impact of Big Data on Social Research David Rhind Sharon Witherspoon
The Impact of Big Data on Social Research David Rhind Sharon Witherspoon 1 www.nuffieldfoundation.org The landscape to be covered What is Big Data? Just consultants hype? Key questions for SRA Technology
More informationEuropean Statistical System Code of Practice Peer Reviews: (Version 1.3)
EUROPEAN COMMISSION EUROSTAT Deputy Director-General Unit 0-2: Statistical governance, quality and evaluation Luxembourg, 08 March 2007 European Statistical System Code of Practice Peer Reviews: The National
More information13 Reasons (or more) Not To Do A Joint Degree
13 Reasons (or more) Not To Do A Joint Degree Anemona Peres Joint Degree Project Manager Frontex 25-06-13 2 25-06-13 FRONTEX: Managing EU borders 3 25-06-13 The Dream, the Art and the Passion 25-06-13
More informationREPORT. Public seminar, 10 November 2010, 1.30-5.00 p.m. Concordia Theatre, The Hague
REPORT Complexity-oriented oriented Planning, Monitoring and Evaluation (PME) From alternative to mainstream? Public seminar, 10 November 2010, 1.30-5.00 p.m. Concordia Theatre, The Hague 1. What was the
More informationKeywords: big data, official statistics, quality, Wikipedia page views, AIS.
Comparative assessment of three quality frameworks for statistics derived from big data: the cases of Wikipedia page views and Automatic Identification Systems Fernando Reis 1, Loredana di Consiglio 1,
More informationESS EA TF Item 2 Enterprise Architecture for the ESS
ESS EA TF Item 2 Enterprise Architecture for the ESS Document prepared by Eurostat (with the support of Gartner INC) 1.0 Introduction The members of the European Statistical System (ESS) have set up a
More informationFrance Telecom Orange investor day conquests 2015
France Telecom Orange investor day conquests 2015 customer relations Jean-Philippe Vanot Deputy CEO Quality & Corporate Social Responsibility May 31 st, 2011 cautionary statement This presentation contains
More informationA Scientific Study "ETAC" European Truck Accident Causation
A Scientific Study "ETAC" European Truck Accident Causation Executive Summary and Recommendations 1 Introduction 1.1 The project and its objectives Currently, only limited statistics are available regarding
More informationCareers of doctorate holders (CDH) 2009 Publicationdate CBS-website: 19-12-2011
Careers of doctorate holders (CDH) 2009 11 0 Publicationdate CBS-website: 19-12-2011 The Hague/Heerlen Explanation of symbols. = data not available * = provisional figure ** = revised provisional figure
More informationThe Way Forward Making the Business Case
Data and Statistics for the Post-2015 Development Agenda Implications for Regional Collaboration in Asia and the Pacific, UN ESCAP, December 2014 Using the Data Revolution to provide more effective and
More information