Big Data. Duncan Baldwin Deputy ascl.org.uk

Transcription

1 Big Data Duncan Baldwin Deputy

2 How big is big?

3 A brief history of data Following the introduction of the printing press around 1450, eight million books were printed and distributed across Europe in 50 years This was more than all the hand written information in the preceding 1200 years since the founding of Constantinople Now it takes 3 years to double the amount of stored information. In 2007 it is estimated there was in excess of 300 exabytes of stored information (1 exabyte = 1 billion ie 10 9 gigabytes)* Of this, only 7% was analog (paper, books, photos..) In book form this would cover the USA 52 layers thick In CDs would form 5 piles reaching the moon 320 times as much information per person as was in Library of Alexandria, which held the entire knowledge of the world. *Hilbert and Lopez 2011 Mayer-Schoenberger/Cukier 2013

4

5 Today Google processes over 15 petabytes (10 15 ) of information every day (1 human brain stores about 1 petabyte) Facebook uploads 10 million photos per hour Youtube users upload an hour of video every second

6 Is 2016 the year of the zettabyte? Cisco predict that in 2016 the world will transmit > 1ZB via the internet for the first time 1ZB = bytes 1ZB is roughly 323 trillion copies of War and Peace or 2 billion years worth of music files

7 Big Data Ability of society to harness information in novel ways to produce new insights, goods and services

8 Think of the horse 17,000 years ago we had cave paintings of a horse Then we had photographs of a horse. Still a stationary horse though. Now we have 24 frames per second video of a horse We can tell more about horses from the video than the painting. A quantitative change has produced a qualitative change.

9 Targeting customers Wal-Mart and hurricanes, Target and pregnancy, Obama s campaign Optimising business processes Stock control, supply chain and traffic control Healthcare Algorithms developed to detect infections 24 hours earlier in premature babies by monitoring every heartbeat and breath Sports performance and officiating Hawkeye. Individual performance via apps. Science and research CERN uses 65,000 processors to analyse 30 petabytes of input, then distributes across 150 data centres Security, Town and City Planning, Financial Trading.

10 Using big data in retail Let me tell you a secret the secret of successful retailing. Are you ready? It s this: never stop listening to customers and giving them what they want. I am sorry if you were expecting a magic recipe. But it is that simple. Sir Terry Leahy Former CEO, Tesco

11 What do Tesco know about you? Name Date of birth Gender Address Telephone number What you look like? address Other family members Dietary needs Ethnicity/religion/nationality Mode of travel Attendance Behaviour Assessment TIMS?

12 Rewrite this paragraph from a school leader s point of view, if you were using your data as powerfully as Tesco: We can now target specific service offers to customers with specific profiles. Put this tool in the hands of well-trained and empowered category directors and they can collaborate with suppliers to develop more of the products and services that customers want. Stephen Heal. Former Tesco Business Development Director

13 Your essay homework Tesco know more about a packet of frozen peas than most schools know about one of their students. Discuss

14 The last word? I would rather have yogurt than privacy Liberati Permablog

15 Big Data mindset shifts 1. N = all If we can analyse most, if not all data, sampling becomes unnecessary 2. Accept mess There is a trade-off between volume, speed and precision 3. Correlation, not causality With enough data we can look for links that tell us what, but not why Machine learning

16 Are there big data sets in education? National Pupil Dataset FFT HMRC data linked to URN and destinations These are the tide marks, not the waves The profession does not own them

17 Blueprint for a self-improving system You can mandate adequacy; you can t mandate greatness. It has to be unleashed. Joel Klein Leading the Way: 2 Leading the Way: Blueprint for a Self-Improving System Blueprint for a Self-Improving System

18 Element 4: Accountability Accountability is the obligation of an individual and organisation to account for its activities, accept responsibility for them, and to disclose the results in a transparent manner. The highest form of accountability is the individual s professional accountability for the quality of his or her own work and to the people who the profession serves. In a self-improving system, we believe that teachers and school leaders are agents of their own accountability.

19 What if? Schools collaborated using their data This generated new insights into learning and leadership New economies of scale and deployment of resources became possible This supported the highest form of accountability

20 Three key benefits Benchmarking How is this type of learner doing elsewhere? Today? What makes a difference? Research What do we know about children who.. come by bus?.sit at the back? School-led initiatives What are learner destinations on exit? Can we deploy resources better?

21 S&T Select Committee Report Feb 2016 Properly exploited, this data should be transformative, increasing efficiency, unlocking new avenues in life-saving research and creating as yet unimagined opportunities for innovation across all sectors and industries.

22 What next? Statement of ambition Real time, outcome focussed big data set Owned by the profession for the improvement of the profession Leading to better outcomes for pupils, better informed leaders and teachers. How? Pilot the data transfer and analytical tools Establish a charitable trust to oversee this Gain funding Establish a steering group from within the sector Seek volunteers

23 We don t know what we don t know But we do know the profession needs to lead the quest to find out, and the time is now!

24 Whilst the information provided at this event was correct to the best of the knowledge of the presenters and organisers, neither ASCL nor Professional Development can accept liability if at a later date this should prove not to be the case. Nor can they be held responsible for any errors or any consequences resulting from its use. Please also see the ASCL website for details of our copyright statement.