1 Big Data better business benefits Paul Edwards, HouseMark 2 December 2014
2 What I ll cover.. Explain what big data is Uses for Big Data and the potential for social housing What Big Data means for HouseMark Some practical data protection considerations What I won t be doing: Giving detailed legal advice and guidance - there are other better qualified people doing this today..
3 What is Big Data?
4 What is Big Data? We hear a lot about big data and its capacity to transform our daily lives. But what do we mean by Big Data and what does it mean in practical terms for social housing providers and their customers?
5 What is Big Data? There are lots of definitions of big data - & some of them are incredibly complex and technical. a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications - Wikipedia data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed time Like drinking from a firehose
6 The Four Vs of Big Data The quantity of data to be captured continues to grow exponentially Data comes in many formats, from diverse sources Bits and bytes have to be processed at high speed Data needs to be converted into meaningful insights
7 Big Data In simple terms: Big Data is a popular term used to describe the exponential growth and availability of data, both structured and unstructured So there are ever increasing amounts of data out there and in lots of different forms. There s a view that Big Data may be as important to business and society as the Internet has become Why?
8 How might Big Data be used?
9 Big Data The hopeful vision is that organisations will be able to take data from any source, harness relevant data and analyse it to find answers that enable, for example: Cost reductions Time reductions Smarter business decision making Better service New product development and optimised offerings
10 Big Data in Action Exploiting the "four virtual Internets individually and collectively: People Things Data Ideas They are emerging to enable broader collaboration and knowledge and also as an invaluable source of big data to fuel advances in business capabilities
11 Big Data in Action - People The Internet of People Social networks opportunities to create better and more instant communication and feedback with customers through social media Crowd sourcing Street Bump is a crowd-sourcing project that helps residents improve their neighbourhood streets. Volunteers use the Street Bump mobile app to collect road condition data while they drive. The data provides governments with real-time information to fix problems and plan long term investments
12 Big Data in Action Things The Internet of Things Exponential increase in intelligent objects connected to the internet By 2020 estimates suggest 50 billion devices connected to the internet, as smart sensors become more present Massive potential here for social landlords Care for the elderly Energy efficiency Health & Safety Asset management
13 Big Data in Action Data The Internet of Data Increase in data storage and processing capability creates huge potential for data mining & analysis Opportunity to bring together key data sources Key intelligence to identify need and plan services More intelligent management of people and assets Tailoring services around individual needs Real time data to support performance management and business planning More sophisticated forward predictions e.g. asset lifecycles and costing
14 Big Data in Action Ideas The Internet of Ideas The Galaxy Zoo project used volunteers to classify over a million galaxies An example of citizen science building capacity to make sense of the mass of available data Open Notebook Science makes the full record of scientific research available online This enables other scientists to obtain detailed descriptions of procedures, raw and analysed data to either compare with their own work or to build on Scope for social housing to share research which underpins the development of evidence based practice?
15 Big Data for all Big Data is not just for big organisations Cloud partnering advantages cost scalable new capabilities avoid data silos security and compliance aspects are solvable All businesses need other data Open data Third party data Private sector companies swap customer data, e.g. credit reference agencies, supermarkets and suppliers
16 Big Data can also be small data Small timescales: services based on real-time sandbox analytics not just massive scale processing Small segments: segment-of-one personalisation is what a consumer values the most Big Data is also really small, subsecond or ultra personalised information and every level in between it s complicated understanding every customers life
17 Analytical Strategy: Structuring Unstructured Data Unstructured data just means patterns we haven t found yet. Geospatial location data, voice, video, streaming data, behavioural data. Example: changing frequencies of buying behaviours identify/influence actionable customer segments which people are more sensitive to influencing at certain reoccurring times? the reverse: remove them from promotions if they are least sensitive at certain times
18 Analytical Strategy: Structuring Unstructured Data Example: Segmentation based on serial basket journey analysis how did a VIP customer become a VIP customer? who can be nudged into becoming a VIP? segmentation based on serial behaviour & predictive models
19 Analytical Strategy: personalisation Big Data can also enable: Personalisation of production automation: advice, suggestions, support, queries, tips more precise use of resources more granular campaigns Tailoring offers to local circumstances Personalisation of delivery channel, technology, tone, timing by person by minute/ day/ time period Personalisation requires customer data because Customers need different things Customer needs are dynamic
20 Analytical Strategy: Visualisation Perhaps the most important thing is when it comes to Big Data is that visualisation encourages interaction with the data Studies show that managers using visualised data are more than twice as likely as their peers to interact extensively with it - 33% vs. 15% Exploring data visually lets the data s story unfold vividly in a way the brain can grasp in a flash. A light bulb goes off, says Wells Fargo Vice President of Strategic Planning Dana Zuber, he says, You just don t get that with a spreadsheet.
21 Big data in practice Personalised Insurance - Telematics Black box technology Tracks acceleration, braking, cornering, journey length and time Dynamic and individual calculation of premiums Big data benefits More flexible products Targeting services Incentivises behaviour Competitive advantage
22 What does Big Data mean to HouseMark in practical terms?
23 Big Data opportunities Big Data provides opportunities to: Adopt new ways of using data in and between organisations Connect the fundamental business objectives back to the raw data using data science analytical techniques Increase acceptance and expectation of strategy and operations based on analysis and evidence not just gut feel
24 Big Data analytics Big Data analytics involves the triangulation of data sources to: discover patterns to create business intelligence to inform decision making Big Data analytics involves: structured data HouseMark benchmarking unstructured data s, website logs and comments open data DCLG, HCA, LAs, Home Office, ONS commercial data Ordnance Survey, RICS, Dataspring machine data GPS vehicle data, energy meters, appliance
25 What does Big Data mean to HouseMark It s about being aware of and utilising: The latest available data sources The latest tools and techniques for mass data Capture Storage Interpretation and analysis Conveying insights to a wide audience
26 A Housing Data Ecosystem
27 Opportunities for Big Data in social housing
28 Latest available data sources Now Massive dataset capturing landlords costs, performance and satisfaction. Next More real-time collection of existing data. People and property database pilot Link to open data and other sources. Open Data Zone
29 Data capture Now Strong reputation for bringing consistency to data collected from over 400 landlords through clear definitions and rigorous validation. Next Automated More collection direct from system source automated data collection. Advances in collection methods open up opportunities of greater granularity in data collected right down to property and tenant level if necessary. Capturing data from new sensor technology in social housing the Internet of Things
30 Interpretation and analysis Now In-house data analysts within HouseMark s Data Services team. Next Academic partnerships Partnerships with university data scientists and statisticians, starting with the Advanced Data Analytics Centre at Nottingham University.
31 Conveying insights to a wide audience Now Traditional paper reports and web-based presentations of data, including dashboards and scorecards with a VFM focus. Next Cutting-edge tools Extending GIS capacity in conjunction with funding from the Nottingham Geospatial Institute. More use of Microsoft business intelligence and analysis reporting tools on our interactive website.
32 Some practical data protection considerations
33 Data protection considerations Not all big data analytics involve personal data E.g. climate & weather data Personal data Is it necessary? Can it be anonymised? Privacy impact assessment Personal data - to identify general trends or make decisions that affect individuals Repurposing data Is the new purpose compatible with the original? Is consent required?
34 Data protection considerations Fair processing Transparency re collection and purpose Information security Lost data Stolen data: Climategate, Edward Snowden Privacy, confidentiality, etc. Jigsaw effect - if you know the sex, date and year of birth, and the city of someone in the US, then 53% of the US population can be uniquely identified
35 Data protection considerations Data minimisation Big data analytics not an excuse for stockpiling data can you articulate/ justify long term uses? Transparency Be transparent & open
36 Some tips & learning points Get proper advice Be clear what is and what is not personal and sensitive data Be clear what you want to do with the data clear purpose. Ensure it is securely stored It s more complicated than you might think!!
37 Summing up
38 Key Considerations Don t forget about your own data Make better use of your own data Supplement with openly available public data The technology is not the big problem, it s skills big data technologies are widely available the big problem is having the right skills to exploit it Being better informed is not much use unless you can make good use of the better information Is there a sector solution to this?
39 Big Data in Action It s not about the data it s about the insight it gives you to underpin your decision making, increase your operational efficiency and improve outcomes Big data can help you to: Design services and customer access channels Balance service demand and service quality Make best use of available resources Inform investment and manage risk Private sector will Exploit big data to maximise profit Public sector challenge To use big data to maximise social value from available resources
Customer-Centricity in a World of Data: Turning Big Data into a Big Opportunity Richard Maraschi Business Analytics Solutions Leader IBM Global Media & Entertainment Joe Wikert General Manager & Publisher
White provides GRASP-powered big data predictive analytics that increases marketing effectiveness and customer satisfaction with API-driven adaptive apps that anticipate, learn, and adapt to deliver contextual,
SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology
Strategies For Setting Up Your Organisation For Success With Big Data Kevin Long Business Development Director Teradata Agenda Developing a big data strategy and plan that is aligned with your organisation
Kingdom Big Data & Analytics Summit 28 FEB 1 March 2016 Agenda MASTERCLASS A 28 Feb 2016 9.00am To 12.00pm Big Data Technology and Analytics Workshop MASTERCLASS LEADERS Venkata P. Alla A highly respected
EPSRC Cross-SAT Big Data Workshop: Well Sorted Materials 5th August 2015 Contents Introduction 1 Dendrogram 2 Tree Map 3 Heat Map 4 Raw Group Data 5 For an online, interactive version of the visualisations
Demystifying Big Data James Rawlins Senior Consultant What s the Big Idea? Objectives for the session Understand what is meant by Big Data Provide some context around what is Big Are we big? Understand
Big Data / FDAAWARE Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015 1 Agenda BIG DATA What is Big Data? Characteristics of Big Data Where it is being used? FDAAWARE
www.pwc.co.uk Data analytics Delivering intelligence in the moment January 2014 Our point of view Extracting insight from an organisation s data and applying it to business decisions has long been a necessary
Big Data and its Real Impact on Your Security & Privacy Framework: A Pragmatic Overview Erik Luysterborg Partner, Deloitte EMEA Data Protection & Privacy leader Prague, SCCE, March 22 nd 2016 1. 2016 Deloitte
Big Data and New Paradigms in Information Management Vladimir Videnovic Institute for Information Management 2 "I am certainly not an advocate for frequent and untried changes laws and institutions must
Customer Experience Management 10 tips for the successful development and execution of Chris Bland Research Director SPA Future Thinking Introduction, sometimes referred to as Customer Feedback Programmes,
EMPOWER YOUR BUSINESS WITH DATA maximizing data s business value AND KEEPING IT SAFE EMPOWER YOUR BUSINESS WITH DATA maximizing data s business value AND KEEPING IT SAFE Data is an organization s lifeblood.
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
Population Analytics Population Analytics: A New Opportunity for Mobile Operators Few new mobile-based technologies have the potential to change the way that organisations think about their customers and
ACS 2015 Annual Canberra Conference Are You Big Data Ready? Vladimir Videnovic Business Solutions Director Oracle Big Data and Analytics Introduction Introduction What is Big Data? If you can't explain
Superfast Business Wales Customer Relationship Management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. Business Guide Customer Relationship
BIG Data Analytics Move to Competitive Advantage where is technology heading today Standardization Open Source Automation Scalability Cloud Computing Mobility Smartphones/ tablets Internet of Things Wireless
Beyond listening Driving better decisions with business intelligence from social sources From insight to action with IBM Social Media Analytics State of the Union Opinions prevail on the Internet Social
The big data revolution Expert report in partnership with Big data, big challenges Big data is changing the world a hundred terabytes at a time. It allows marketers to make highly informed and effective
WHITE PAPER Ubuntu and Hadoop: the perfect match February 2012 Copyright Canonical 2012 www.canonical.com Executive introduction In many fields of IT, there are always stand-out technologies. This is definitely
Dan Jewett, VP Product Management 7 Tips to Succeed with Big Data 2 Just when you thought big data couldn t get any bigger, it got bigger still. Regardless of its actual size, big data is showing its value.
THE STATE OF Customer Analytics Taking A Proactive Approach To Loyalty & Retention By Kerry Doyle An Exclusive Research Report UBM TechWeb research conducted an online study of 339 marketing professionals
A financial software company Projecting USD10 million revenue lift with the IBM Netezza data warehouse appliance Overview The need A financial software company sought to analyze customer engagements to
Bruhati Technologies ISO 9001:2008 certified Technology fit for Business About us 1 Strong, agile and adaptive Leadership Geared up technologies for and fast moving long lasting With sound understanding
The Cloud for Insights A Guide for Small and Medium Business As the volume of data grows, businesses are using the power of the cloud to gather, analyze, and visualize data from internal and external sources
WHITE PAPER The metrics that matter How actionable analytics can transform field service management performance. www. Introduction The top strategic action for two-thirds of service organisations is to
mwd a d v i s o r s Turning Big Data into Big Insights Helena Schwenk A special report prepared for Actuate May 2013 This report is the fourth in a series and focuses principally on explaining what s needed
REAL-TIME OPERATIONAL INTELLIGENCE Competitive advantage from unstructured, high-velocity log and machine Big Data 2 SQLstream: Our s-streaming products unlock the value of high-velocity unstructured log
Consumers are becoming smarter than organisations. The implications are stark. Smart Organisations need to answer a whole new set of exam questions... David Williams, CEO Delivering an Unmatched Customer
Pulsar TRAC Big Social Data for Research Made by Face PULSAR TRAC is an advanced social intelligence platform designed for researchers and planners by researchers and planners. We have developed a robust
Customer Relationship Management (CRM) Customer relationship management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. It is about putting
One View Of Customer Data & Marketing Data Ian Kenealy, Head of Customer Data & Analytics, RSA spoke to the CX Network and shared his thoughts on all things customer, data and analytics! Can you briefly
5 Point Social Media Action Plan. Workshop delivered by Ian Gibbins, IG Media Marketing Ltd (email@example.com, tel: 01733 241537) On behalf of the Chambers Communications Sector Introduction: There
BUY BIG DATA IN RETAIL Table of contents What is Big Data?... How Data Science creates value in Retail... Best practices for Retail. Case studies... 3 7 11 1. Social listening... 2. Cross-selling... 3.
Probes and Big Data: Opportunities and Challenges Fiona Calvert, Director Information Services and Mapping, Department of Transport Planning and Local Infrastructure New data sources, probes and big data
Superfast Business Wales Customer Relationship Management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. Business Guide Customer Relationship
Strategic Decisions Supported by SAP Big Data Solutions Angélica Bedoya / Strategic Solutions GTM Mar /2014 What critical new signals Might you be missing? Use Analytics Today 10% 75% Need Analytics by
Annex: Concept Note Friday Seminar on Emerging Issues Big Data for Policy, Development and Official Statistics New York, 22 February 2013 How is Big Data different from just very large databases? 1 Traditionally,
Don Campbell Chief Technology Officer, Business Analytics, IBM Technology and Trends for Smarter Business Analytics Business Analytics software Where organizations are focusing Business Analytics Enhance
JAN-MAR 2014 R E P R I N T RC & risk compliance & CREATING DATA PRIVACY OPPORTUNITIES USING BIG IN EUROPE DATA AND ANALYTICS REPRINTED FROM: RISK & COMPLIANCE MAGAZINE JAN-MAR 2015 2014 ISSUE RC & risk
Analytics & Big Data What, Why and How Colin Murphy FSAI Dr. Richard Southern Sinead Kiernan FSAI 07.04.2014 Agenda Introduction What is Analytics and Big Data? Growth of Analytics and Big Data What does
Table of Contents Introduction: Gathering Website Intelligence 1 Customize Your System for Your Organization s Needs 2 CRM, Website Analytics and Email Integration 3 Action Checklist: Increase the Effectiveness
Enabling Service Innovation on a Smarter Planet with Integrated Service Management Chris Mallon, Service Management Executive, IBM Canada Our world is getting smarter intelligence is being infused into
IBM Social Media Analytics Analyze social media data to better understand your customers and markets Highlights Understand consumer sentiment and optimize marketing campaigns. Improve the customer experience
Improving customer service with data 19 may 2015 Maarten Jonker Leiden Contents Introduction Our approach Our practice Increasing our understanding of data and using knowledge Achmea s digital-first principles
Today s chemical companies face extraordinary business challenges, from the massive volatility in raw materials and input costs, to currency fluctuations and a globally competitive marketplace. The selling
A strategic approach to fraud A continuous cycle of fraud risk management The risk of fraud is rising at an unprecedented rate. Today s tough economic climate is driving a surge in first party fraud for
Quick Guide: Selecting ICT Tools for your Business This Quick Guide is one of a series of information products targeted at small to medium sized businesses. It is designed to help businesses better understand,
Harnessing Big Data to Improve Customer Service By Marty Tibbitts The goal is to apply analytics methods that move beyond customer satisfaction to nurturing customer loyalty by more deeply understanding
Digital Marketing Institute s Professional Diploma in Digital Selling Validated by the Syllabus Advisory Council (SAC) Content Professional Diploma in Digital Selling Welcome Course overview Course content
Stephen Loudermilk, Global Director, Media & Analyst Relations, LexisNexis Chairman, PRSA Tech Section and Treasurer, PRSA Southeast District firstname.lastname@example.org 678-694-2353 Overview What
Three powerful analytics use cases for Customer Link 1 How linked data powers smarter analytics and better predictive models 0123 4567 8901 2345 The power of linked data When it comes to adopting new tech
The Cloud for Insights A Guide for Enterprise As the volume of data grows, businesses are using the power of the cloud to gather, analyze, and visualize data from internal and external sources to improve
GUIDE CONTENT MARKETING 101 How to make it work for your business from strategy to execution Firstbase 1. WHAT IS CONTENT MARKETING AND WHY SHOULD YOU CARE? INTRODUCTION To understand the enormous potential
Big Data - An Automotive Outlook Graeme Banister, Frost & Sullivan The Hague 12 th September 2013 Table of Contents Frost & Sullivan Overview 3 Big Data Basics 6 Big Data & The Automotive Ecosystem 9 Big
Facebook Advertising Playbook TABLE OF CONTENTS I. INTRODUCTION 6 II. ABOUT THIS REPORT 6 III. ABOUT IMPARTURE 7 1. INTRODUCTION TO FACEBOOK ADVERTISING 8 1.1 UNDERSTANDING TERMINOLOGY 8 2. THE CASE FOR
Purpose This Quick Guide is one of a series of information products targeted at small to medium sized enterprises (SMEs). It is designed to help SMEs better understand, and take advantage of, new information
TEXT ANALYTICS INTEGRATION A TELECOMMUNICATIONS BEST PRACTICES CASE STUDY VISION COMMON ANALYTICAL ENVIRONMENT Structured Unstructured Analytical Mining Text Discovery Text Categorization Text Sentiment
A first in the Fleet Management & Telematics Transport Sector The combination of 2 industry-leading cloud-based technologies Truckfile is utilised by 17,000 UK customers operating 110,000 vehicles Ctrack
Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms
Data segmentation for email Prepared by: Paul Herbert June 2012 email According to the Direct Marketing Association, seven out of ten companies are expecting more budget to flow into email over the next
IBM Software Business Analytics Social Analytics Social Business Analytics Gaining business value from social media 2 Social Business Analytics Contents 2 Overview 3 Analytics as a competitive advantage
Enabling the SmartGrid through Cloud Computing April 2012 Creating Value, Delivering Results 2012 eglobaltech Incorporated. Tech, Inc. All rights reserved. 1 Overall Objective To deliver electricity from
Big Data Analytics- Innovations at the Edge Brian Reed Chief Technologist Healthcare Four Dimensions of Big Data 2 The changing Big Data landscape Annual Growth ~100% Machine Data 90% of Information Human
Big Data Challenges and Success Factors Deloitte Analytics Your data, inside out Big Data refers to the set of problems and subsequent technologies developed to solve them that are hard or expensive to
WHITE PAPER MULTI-CHANNEL CAMPAIGNS IN A CONNECTED WORLD White paper - Multi-Channel Campaigns in a Connected World - Prodware 1 Create and deploy IT solutions for business Navigating Multi-channel Marketing
Why Modern B2B Marketers Need Predictive Marketing Sponsored by www.raabassociatesinc.com email@example.com www.mintigo.com firstname.lastname@example.org Introduction Marketers have used predictive modeling
Big Data Meets Customer Service... how ITS can Prepare for the Tsunami of Data that will inevitably follow? Rationale ITS Industry is already generating large data sets from traditional ITS applications
Why big data? Lessons from a Decade+ Experiment in Big Data David Belanger PhD Senior Research Fellow Stevens Institute of Technology email@example.com 1 What Does Big Look Like? 7 Image Source Page:
Industrial Internet @GE Dr. Stefan Bungart The vision is clear The real opportunity for change surpassing the magnitude of the consumer Internet is the Industrial Internet, an open, global network that
IBM Analyze social media data to improve business outcomes Highlights Grow your business by understanding consumer sentiment and optimizing marketing campaigns. Make better decisions and strategies across
pricing software Adding value to the pricing of personal lines and commercial business s pricing software is used by 17 of the world s top 20 P&C insurers. pricing software Effective pricing is fundamental
SOLUTION BRIEF Understanding Your Customer Journey by Extending Adobe Analytics with Big Data Business Challenge Today s digital marketing teams are overwhelmed by the volume and variety of customer interaction
Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data
THE NEW ERA OF ABOUT THE AUTHOR Paul Rogers is the Head of Customer Experience and CRM within HCL s Applications Division. Based in London, Paul is responsible for leading HCL s CRM consulting and technology
Big Data Executive Full Questionnaire Big Date Executive Full Questionnaire Appendix B Questionnaire Welcome The survey has been designed to provide a benchmark for enterprises seeking to understand the