1 Big Data better business benefits Paul Edwards, HouseMark 2 December 2014
2 What I ll cover.. Explain what big data is Uses for Big Data and the potential for social housing What Big Data means for HouseMark Some practical data protection considerations What I won t be doing: Giving detailed legal advice and guidance - there are other better qualified people doing this today..
3 What is Big Data?
4 What is Big Data? We hear a lot about big data and its capacity to transform our daily lives. But what do we mean by Big Data and what does it mean in practical terms for social housing providers and their customers?
5 What is Big Data? There are lots of definitions of big data - & some of them are incredibly complex and technical. a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications - Wikipedia data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed time Like drinking from a firehose
6 The Four Vs of Big Data The quantity of data to be captured continues to grow exponentially Data comes in many formats, from diverse sources Bits and bytes have to be processed at high speed Data needs to be converted into meaningful insights
7 Big Data In simple terms: Big Data is a popular term used to describe the exponential growth and availability of data, both structured and unstructured So there are ever increasing amounts of data out there and in lots of different forms. There s a view that Big Data may be as important to business and society as the Internet has become Why?
8 How might Big Data be used?
9 Big Data The hopeful vision is that organisations will be able to take data from any source, harness relevant data and analyse it to find answers that enable, for example: Cost reductions Time reductions Smarter business decision making Better service New product development and optimised offerings
10 Big Data in Action Exploiting the "four virtual Internets individually and collectively: People Things Data Ideas They are emerging to enable broader collaboration and knowledge and also as an invaluable source of big data to fuel advances in business capabilities
11 Big Data in Action - People The Internet of People Social networks opportunities to create better and more instant communication and feedback with customers through social media Crowd sourcing Street Bump is a crowd-sourcing project that helps residents improve their neighbourhood streets. Volunteers use the Street Bump mobile app to collect road condition data while they drive. The data provides governments with real-time information to fix problems and plan long term investments
12 Big Data in Action Things The Internet of Things Exponential increase in intelligent objects connected to the internet By 2020 estimates suggest 50 billion devices connected to the internet, as smart sensors become more present Massive potential here for social landlords Care for the elderly Energy efficiency Health & Safety Asset management
13 Big Data in Action Data The Internet of Data Increase in data storage and processing capability creates huge potential for data mining & analysis Opportunity to bring together key data sources Key intelligence to identify need and plan services More intelligent management of people and assets Tailoring services around individual needs Real time data to support performance management and business planning More sophisticated forward predictions e.g. asset lifecycles and costing
14 Big Data in Action Ideas The Internet of Ideas The Galaxy Zoo project used volunteers to classify over a million galaxies An example of citizen science building capacity to make sense of the mass of available data Open Notebook Science makes the full record of scientific research available online This enables other scientists to obtain detailed descriptions of procedures, raw and analysed data to either compare with their own work or to build on Scope for social housing to share research which underpins the development of evidence based practice?
15 Big Data for all Big Data is not just for big organisations Cloud partnering advantages cost scalable new capabilities avoid data silos security and compliance aspects are solvable All businesses need other data Open data Third party data Private sector companies swap customer data, e.g. credit reference agencies, supermarkets and suppliers
16 Big Data can also be small data Small timescales: services based on real-time sandbox analytics not just massive scale processing Small segments: segment-of-one personalisation is what a consumer values the most Big Data is also really small, subsecond or ultra personalised information and every level in between it s complicated understanding every customers life
17 Analytical Strategy: Structuring Unstructured Data Unstructured data just means patterns we haven t found yet. Geospatial location data, voice, video, streaming data, behavioural data. Example: changing frequencies of buying behaviours identify/influence actionable customer segments which people are more sensitive to influencing at certain reoccurring times? the reverse: remove them from promotions if they are least sensitive at certain times
18 Analytical Strategy: Structuring Unstructured Data Example: Segmentation based on serial basket journey analysis how did a VIP customer become a VIP customer? who can be nudged into becoming a VIP? segmentation based on serial behaviour & predictive models
19 Analytical Strategy: personalisation Big Data can also enable: Personalisation of production automation: advice, suggestions, support, queries, tips more precise use of resources more granular campaigns Tailoring offers to local circumstances Personalisation of delivery channel, technology, tone, timing by person by minute/ day/ time period Personalisation requires customer data because Customers need different things Customer needs are dynamic
20 Analytical Strategy: Visualisation Perhaps the most important thing is when it comes to Big Data is that visualisation encourages interaction with the data Studies show that managers using visualised data are more than twice as likely as their peers to interact extensively with it - 33% vs. 15% Exploring data visually lets the data s story unfold vividly in a way the brain can grasp in a flash. A light bulb goes off, says Wells Fargo Vice President of Strategic Planning Dana Zuber, he says, You just don t get that with a spreadsheet.
21 Big data in practice Personalised Insurance - Telematics Black box technology Tracks acceleration, braking, cornering, journey length and time Dynamic and individual calculation of premiums Big data benefits More flexible products Targeting services Incentivises behaviour Competitive advantage
22 What does Big Data mean to HouseMark in practical terms?
23 Big Data opportunities Big Data provides opportunities to: Adopt new ways of using data in and between organisations Connect the fundamental business objectives back to the raw data using data science analytical techniques Increase acceptance and expectation of strategy and operations based on analysis and evidence not just gut feel
24 Big Data analytics Big Data analytics involves the triangulation of data sources to: discover patterns to create business intelligence to inform decision making Big Data analytics involves: structured data HouseMark benchmarking unstructured data s, website logs and comments open data DCLG, HCA, LAs, Home Office, ONS commercial data Ordnance Survey, RICS, Dataspring machine data GPS vehicle data, energy meters, appliance
25 What does Big Data mean to HouseMark It s about being aware of and utilising: The latest available data sources The latest tools and techniques for mass data Capture Storage Interpretation and analysis Conveying insights to a wide audience
26 A Housing Data Ecosystem
27 Opportunities for Big Data in social housing
28 Latest available data sources Now Massive dataset capturing landlords costs, performance and satisfaction. Next More real-time collection of existing data. People and property database pilot Link to open data and other sources. Open Data Zone
29 Data capture Now Strong reputation for bringing consistency to data collected from over 400 landlords through clear definitions and rigorous validation. Next Automated More collection direct from system source automated data collection. Advances in collection methods open up opportunities of greater granularity in data collected right down to property and tenant level if necessary. Capturing data from new sensor technology in social housing the Internet of Things
30 Interpretation and analysis Now In-house data analysts within HouseMark s Data Services team. Next Academic partnerships Partnerships with university data scientists and statisticians, starting with the Advanced Data Analytics Centre at Nottingham University.
31 Conveying insights to a wide audience Now Traditional paper reports and web-based presentations of data, including dashboards and scorecards with a VFM focus. Next Cutting-edge tools Extending GIS capacity in conjunction with funding from the Nottingham Geospatial Institute. More use of Microsoft business intelligence and analysis reporting tools on our interactive website.
32 Some practical data protection considerations
33 Data protection considerations Not all big data analytics involve personal data E.g. climate & weather data Personal data Is it necessary? Can it be anonymised? Privacy impact assessment Personal data - to identify general trends or make decisions that affect individuals Repurposing data Is the new purpose compatible with the original? Is consent required?
34 Data protection considerations Fair processing Transparency re collection and purpose Information security Lost data Stolen data: Climategate, Edward Snowden Privacy, confidentiality, etc. Jigsaw effect - if you know the sex, date and year of birth, and the city of someone in the US, then 53% of the US population can be uniquely identified
35 Data protection considerations Data minimisation Big data analytics not an excuse for stockpiling data can you articulate/ justify long term uses? Transparency Be transparent & open
36 Some tips & learning points Get proper advice Be clear what is and what is not personal and sensitive data Be clear what you want to do with the data clear purpose. Ensure it is securely stored It s more complicated than you might think!!
37 Summing up
38 Key Considerations Don t forget about your own data Make better use of your own data Supplement with openly available public data The technology is not the big problem, it s skills big data technologies are widely available the big problem is having the right skills to exploit it Being better informed is not much use unless you can make good use of the better information Is there a sector solution to this?
39 Big Data in Action It s not about the data it s about the insight it gives you to underpin your decision making, increase your operational efficiency and improve outcomes Big data can help you to: Design services and customer access channels Balance service demand and service quality Make best use of available resources Inform investment and manage risk Private sector will Exploit big data to maximise profit Public sector challenge To use big data to maximise social value from available resources
Customer-Centricity in a World of Data: Turning Big Data into a Big Opportunity Richard Maraschi Business Analytics Solutions Leader IBM Global Media & Entertainment Joe Wikert General Manager & Publisher
The big data revolution Expert report in partnership with Big data, big challenges Big data is changing the world a hundred terabytes at a time. It allows marketers to make highly informed and effective
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
BIG Data Analytics Move to Competitive Advantage where is technology heading today Standardization Open Source Automation Scalability Cloud Computing Mobility Smartphones/ tablets Internet of Things Wireless
White provides GRASP-powered big data predictive analytics that increases marketing effectiveness and customer satisfaction with API-driven adaptive apps that anticipate, learn, and adapt to deliver contextual,
Strategies For Setting Up Your Organisation For Success With Big Data Kevin Long Business Development Director Teradata Agenda Developing a big data strategy and plan that is aligned with your organisation
Big Data and its Real Impact on Your Security & Privacy Framework: A Pragmatic Overview Erik Luysterborg Partner, Deloitte EMEA Data Protection & Privacy leader Prague, SCCE, March 22 nd 2016 1. 2016 Deloitte
WHITE PAPER Ubuntu and Hadoop: the perfect match February 2012 Copyright Canonical 2012 www.canonical.com Executive introduction In many fields of IT, there are always stand-out technologies. This is definitely
ACS 2015 Annual Canberra Conference Are You Big Data Ready? Vladimir Videnovic Business Solutions Director Oracle Big Data and Analytics Introduction Introduction What is Big Data? If you can't explain
Kingdom Big Data & Analytics Summit 28 FEB 1 March 2016 Agenda MASTERCLASS A 28 Feb 2016 9.00am To 12.00pm Big Data Technology and Analytics Workshop MASTERCLASS LEADERS Venkata P. Alla A highly respected
www.pwc.co.uk Data analytics Delivering intelligence in the moment January 2014 Our point of view Extracting insight from an organisation s data and applying it to business decisions has long been a necessary
One View Of Customer Data & Marketing Data Ian Kenealy, Head of Customer Data & Analytics, RSA spoke to the CX Network and shared his thoughts on all things customer, data and analytics! Can you briefly
Superfast Business Wales Customer Relationship Management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. Business Guide Customer Relationship
WHITE PAPER The metrics that matter How actionable analytics can transform field service management performance. www. Introduction The top strategic action for two-thirds of service organisations is to
Big Data and New Paradigms in Information Management Vladimir Videnovic Institute for Information Management 2 "I am certainly not an advocate for frequent and untried changes laws and institutions must
Demystifying Big Data James Rawlins Senior Consultant What s the Big Idea? Objectives for the session Understand what is meant by Big Data Provide some context around what is Big Are we big? Understand
Population Analytics Population Analytics: A New Opportunity for Mobile Operators Few new mobile-based technologies have the potential to change the way that organisations think about their customers and
EPSRC Cross-SAT Big Data Workshop: Well Sorted Materials 5th August 2015 Contents Introduction 1 Dendrogram 2 Tree Map 3 Heat Map 4 Raw Group Data 5 For an online, interactive version of the visualisations
SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology
Big Data / FDAAWARE Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015 1 Agenda BIG DATA What is Big Data? Characteristics of Big Data Where it is being used? FDAAWARE
THE STATE OF Customer Analytics Taking A Proactive Approach To Loyalty & Retention By Kerry Doyle An Exclusive Research Report UBM TechWeb research conducted an online study of 339 marketing professionals
Customer Relationship Management (CRM) Customer relationship management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. It is about putting
Customer Experience Management 10 tips for the successful development and execution of Chris Bland Research Director SPA Future Thinking Introduction, sometimes referred to as Customer Feedback Programmes,
Superfast Business Wales Customer Relationship Management, or CRM, is an approach to doing business that can transform the performance and profitability of an organisation. Business Guide Customer Relationship
The Cloud for Insights A Guide for Small and Medium Business As the volume of data grows, businesses are using the power of the cloud to gather, analyze, and visualize data from internal and external sources
Beyond listening Driving better decisions with business intelligence from social sources From insight to action with IBM Social Media Analytics State of the Union Opinions prevail on the Internet Social
Discover How a 360-Degree View of the Customer Boosts Productivity and Profits eguide eguide Discover How a 360-Degree View of the Customer Boosts Productivity and Profits A guide on the benefits of using
White Paper Analyzing Big Data: The Path to Competitive Advantage by Marcia Kaplan Contents Introduction....2 How Big is Big Data?................................................................................
Analytics & Big Data What, Why and How Colin Murphy FSAI Dr. Richard Southern Sinead Kiernan FSAI 07.04.2014 Agenda Introduction What is Analytics and Big Data? Growth of Analytics and Big Data What does
A financial software company Projecting USD10 million revenue lift with the IBM Netezza data warehouse appliance Overview The need A financial software company sought to analyze customer engagements to
Customer Engagement: Fitness First Overview Company Fitness First is a leading fitness brand Challenge To maximise the effectiveness of its marketing, Fitness First needed to turn raw customer data into
Pulsar TRAC Big Social Data for Research Made by Face PULSAR TRAC is an advanced social intelligence platform designed for researchers and planners by researchers and planners. We have developed a robust
5 Point Social Media Action Plan. Workshop delivered by Ian Gibbins, IG Media Marketing Ltd (email@example.com, tel: 01733 241537) On behalf of the Chambers Communications Sector Introduction: There
REAL-TIME OPERATIONAL INTELLIGENCE Competitive advantage from unstructured, high-velocity log and machine Big Data 2 SQLstream: Our s-streaming products unlock the value of high-velocity unstructured log
GUIDE CONTENT MARKETING 101 How to make it work for your business from strategy to execution Firstbase 1. WHAT IS CONTENT MARKETING AND WHY SHOULD YOU CARE? INTRODUCTION To understand the enormous potential
Digital transformation can help you tame the perfect storm. The digital future for insurance. Following the 2008 financial crisis, the insurance sector has faced tighter regulation, which has made it harder
Probes and Big Data: Opportunities and Challenges Fiona Calvert, Director Information Services and Mapping, Department of Transport Planning and Local Infrastructure New data sources, probes and big data
Today s chemical companies face extraordinary business challenges, from the massive volatility in raw materials and input costs, to currency fluctuations and a globally competitive marketplace. The selling
Consumers are becoming smarter than organisations. The implications are stark. Smart Organisations need to answer a whole new set of exam questions... David Williams, CEO Delivering an Unmatched Customer
Big Data - An Automotive Outlook Graeme Banister, Frost & Sullivan The Hague 12 th September 2013 Table of Contents Frost & Sullivan Overview 3 Big Data Basics 6 Big Data & The Automotive Ecosystem 9 Big
THE NEW ERA OF ABOUT THE AUTHOR Paul Rogers is the Head of Customer Experience and CRM within HCL s Applications Division. Based in London, Paul is responsible for leading HCL s CRM consulting and technology
Enabling Service Innovation on a Smarter Planet with Integrated Service Management Chris Mallon, Service Management Executive, IBM Canada Our world is getting smarter intelligence is being infused into
Understanding the impact of the connected revolution Vodafone Power to you 02 Introduction With competitive pressures intensifying and the pace of innovation accelerating, recognising key trends, understanding
Quick Guide: Selecting ICT Tools for your Business This Quick Guide is one of a series of information products targeted at small to medium sized businesses. It is designed to help businesses better understand,
Harnessing Big Data to Improve Customer Service By Marty Tibbitts The goal is to apply analytics methods that move beyond customer satisfaction to nurturing customer loyalty by more deeply understanding
Don Campbell Chief Technology Officer, Business Analytics, IBM Technology and Trends for Smarter Business Analytics Business Analytics software Where organizations are focusing Business Analytics Enhance
BIG DATA: PROMISE, POWER AND PITFALLS NISHANT MEHTA Agenda Promise Definition Drivers of and for Big Data Increase revenue using Big Data Power Optimize operations and decrease costs Discover new revenue
DELIVERING COMPETITIVE ADVANTAGE Talent and the Networked Economy This booklet outlines ManpowerGroup s #RelationshipsMatter programme. Collaboratively delivered through social, mobile and digital, #RelationshipsMatter
Customer Experience Management Best Practices for Voice of the Customer (VoC) Programmes Jörg Höhner Senior Vice President Global Head of Automotive SPA Future Thinking The Evolution of Customer Satisfaction
Bruhati Technologies ISO 9001:2008 certified Technology fit for Business About us 1 Strong, agile and adaptive Leadership Geared up technologies for and fast moving long lasting With sound understanding
TELECOMS.COM INTELLIGENCE INDUSTRY SURVEY BIG DATA 2016 Survey Results of Over 1500 Telecoms Professionals on Trends and Applications of Big Data Telecoms.com Intelligence Industry Survey 2016 Big data
Purpose This Quick Guide is one of a series of information products targeted at small to medium sized enterprises (SMEs). It is designed to help SMEs better understand, and take advantage of, new information
IBM Software Business Analytics Social Analytics Social Business Analytics Gaining business value from social media 2 Social Business Analytics Contents 2 Overview 3 Analytics as a competitive advantage
mwd a d v i s o r s Turning Big Data into Big Insights Helena Schwenk A special report prepared for Actuate May 2013 This report is the fourth in a series and focuses principally on explaining what s needed
Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require
What GPS Will Do for You in 2015: the Future of Fleet Tracking GPS systems confer a competitive advantage on companies that use them for fleet vehicles. Fleet managers who use GPS systems to track drivers
SOCIAL MEDIA LISTENING AND ANALYSIS Spring 2014 EXECUTIVE SUMMARY In this digital age, social media has quickly become one of the most important communication channels. The shift to online conversation
EMPOWER YOUR BUSINESS WITH DATA maximizing data s business value AND KEEPING IT SAFE EMPOWER YOUR BUSINESS WITH DATA maximizing data s business value AND KEEPING IT SAFE Data is an organization s lifeblood.
Stephen Loudermilk, Global Director, Media & Analyst Relations, LexisNexis Chairman, PRSA Tech Section and Treasurer, PRSA Southeast District firstname.lastname@example.org 678-694-2353 Overview What
Facebook Advertising Playbook TABLE OF CONTENTS I. INTRODUCTION 6 II. ABOUT THIS REPORT 6 III. ABOUT IMPARTURE 7 1. INTRODUCTION TO FACEBOOK ADVERTISING 8 1.1 UNDERSTANDING TERMINOLOGY 8 2. THE CASE FOR
BUY BIG DATA IN RETAIL Table of contents What is Big Data?... How Data Science creates value in Retail... Best practices for Retail. Case studies... 3 7 11 1. Social listening... 2. Cross-selling... 3.
7 Ways Predictive Intelligence Can Elevate Your Email Marketing Email is the cornerstone of digital marketing. In fact, 68% of marketers say that email is core to their business 1. With competition for
Article 6: September 2014 Internet of Things This year the focus of business has shifted to the Internet of Things (IoT), the connection and sharing of information between objects, machines, people and
Three powerful analytics use cases for Customer Link 1 How linked data powers smarter analytics and better predictive models 0123 4567 8901 2345 The power of linked data When it comes to adopting new tech
A strategic approach to fraud A continuous cycle of fraud risk management The risk of fraud is rising at an unprecedented rate. Today s tough economic climate is driving a surge in first party fraud for
Strategic Decisions Supported by SAP Big Data Solutions Angélica Bedoya / Strategic Solutions GTM Mar /2014 What critical new signals Might you be missing? Use Analytics Today 10% 75% Need Analytics by
Dan Jewett, VP Product Management 7 Tips to Succeed with Big Data 2 Just when you thought big data couldn t get any bigger, it got bigger still. Regardless of its actual size, big data is showing its value.
Data segmentation for email Prepared by: Paul Herbert June 2012 email According to the Direct Marketing Association, seven out of ten companies are expecting more budget to flow into email over the next
Big Data Meets Customer Service... how ITS can Prepare for the Tsunami of Data that will inevitably follow? Rationale ITS Industry is already generating large data sets from traditional ITS applications
Elevate Customer Experience and Engagement in the New Digital World John Chan CRM Solutions Lead, Microsoft Business Solutions Microsoft Asia Customer buying behavior has fundamentally changed therefore,
IBM Social Media Analytics Analyze social media data to better understand your customers and markets Highlights Understand consumer sentiment and optimize marketing campaigns. Improve the customer experience
2015 State of Artificial Intelligence & Big Data in the Enterprise 2 Table of Contents Introduction...3 Demographics...3 Executive Summary...4 Key Findings...5 Conclusions, Insights and Guidance...8 Respondent
Decisioning for Telecom Customer Intimacy Experian Telecom Analytics Turning disruption into opportunity The traditional telecom business model is being disrupted by a variety of pressures from heightened
Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms
WHITE PAPER MULTI-CHANNEL CAMPAIGNS IN A CONNECTED WORLD White paper - Multi-Channel Campaigns in a Connected World - Prodware 1 Create and deploy IT solutions for business Navigating Multi-channel Marketing
The retailers guide to data discovery How smart retailers are using visual data discovery to search for actionable insights that boost profits and help them understand their customers next move quicker
Why Modern B2B Marketers Need Predictive Marketing Sponsored by www.raabassociatesinc.com email@example.com www.mintigo.com firstname.lastname@example.org Introduction Marketers have used predictive modeling