Copernicus Big Data Workshop Big Data-ready, Secure & Sovereign Cloud A Technology Enabler for Copernicus Data Innovation March 14 th, 2014 Brussels F. BOUJEMAA R&D Manager E. MICONNET - Head of Cyber Security Lab faycal.boujemaa@cloudwatt.com emmanuel.miconnet@thalesgroup.com
About Cloudwatt Sovereign Public Cloud Services Provider (w/european scope) Complying with French & European Regulation (data location, privacy, resiliency ) Joint Venture (Orange, Thales & Digital Society Strategic Fund) Making the most of Orange IT & Networking expertise with IT & Thales Mission-Critical Systems expertise
Software / integration Tightly-Coupling Big Data & Secure Open Source-based Cloud Copernicus & other Closed/ Open Data Decide Predict Simulate Agencies, Enterprises Decision Makers, Researchers Scalable IaaS ISVs, Developers Big Data PaaS Dev. / Deployment Tools Closed / Open Data Catalogues Storage HDD/SSD Visualization Layer Network Analytics Layer Scalable as-a-service Compute S e c u r i t y Hadoop cluster Life-cycle Mgt. Savanna Value-added Integrators (VAIs) + Data Scientists Big Data-ready IaaS Partner's Value-added
4 / Why moving towards Big Data & Big Analytics for Security? Large IS generate large volumes of data which are not/poorly exploited The coupling between Big Data / Big Analytics and Cloud Computing allows to develop new products & services, optimizing critical information management processes (anomaly detection, forensics ) 2013 Model based Approach Cybersecurity Big Analytics Approach 2010 2011 Smart Transport Smart City 130 billions of logs / year Sampling is not suited Anomalies may span on large periods 2009 Detection & forensics of efrauds Large graphs (Social Network Analysis) 5 billions of transactions / year (STIF/Ticketing) + Other data Limitations of model-based reasoning Real time, complex requests 2 billions of transactions / year Exhaustiveness, real time, complex requests 500 000 nodes SQL modeling not suited. Performance problems to traverse graphs, partition the data, complex requests Highly heterogeneous data coming from Thales systems (ticketing, maintenance & supervision) and external data: Open data, social data. Exhaustiveness, real time, complex requests
5 / Cybersecurity / Big Analytics Use Case Cyber Intelligence Logs Analytics Logs & Content Analytics IS Dynamic Mapping Detection / Forensics of cyber threats mentioned in the social media Analysis of the behaviours of hacker communities Anticipation, prevention of attacks (and reaction speedup) Detection / Filtering of anomalous behaviours & events while reducing the false alarm rate Forensics on the detected anomalies Correlations between IDS alerts and content data to deepen the analysis of the security events Correlations between anomalies detected in the network flows and the content data Dynamic cartography of the IS to visualize the topology of the monitored system and visually detect anomalies Mapping of the alarms raised by security devices and by log mining tools on the IS topology Architecture & Algorithms Migration towards a graph DB Text clustering Graph clustering Tulip/Thales platform Architecture & Algorithms Hadoop, MapReduce Toolbox Analytics Architecture & Algorithms Hadoop, MapReduce Toolbox Analytics Architecture & Algorithms Tulip/Thales platform Big Data Architecture & Big Analytics algorithms CYBELS Alert notification Decision making / enhanced strategies for critical infrastructure protection and defence
Innovation Platform for Adding-value to Copernicus Data A Marketplace fostering: Service Creation (mono-domain) Service Composition (x-domains) Service Monetization & Revenue Sharing Ecosystem & users Management Enterprises, Agencies Nomadic End-users Home Education Emergency Climate change Cloud Operator Health SmartCities Orchestrate Compose. Oceanography Agriculture Infrastructure (compute / storage / network) Innovation Ecosystem Closed/Open Data Providers Crowd- Sourcing ISVs System Integ. Agencies Academia Research Centers
Summarizing Innovation Ecosystem Value-Added Reseller (VAR) Value-Added Integrator (VAI) Agencies Customers End-Users Innovation Players Innovative Services White Label Marketplace Operator B2B2B (XaaS) Enterprises Business Market Marketplace X/SaaS PaaS White Label Marketplace B2B2C (XaaS) Consumers Mass Market Hadoop-Enhanced IaaS Network Test & Dev. Innovation Players ISO 27001 Certif. Other Copernicus Partner Platforms
This Platform is ours, please tell us more about your needs Thanks for your attention faycal.boujemaa@cloudwatt.com emmanuel.miconnet@thalesgroup.com