Big Data & Privacy. It s Time for a New Deal on Personal Data Dino Pedreschi. KDD LAB ISTI CNR and Univ. of Pisa

Size: px
Start display at page:

Download "Big Data & Privacy. It s Time for a New Deal on Personal Data Dino Pedreschi. KDD LAB ISTI CNR and Univ. of Pisa http://kdd.isti.cnr."

Transcription

1 Big Data & Privacy It s Time for a New Deal on Personal Data Dino Pedreschi KDD LAB ISTI CNR and Univ. of Pisa Taiwan-Italy Workshop Roma 27 Feb 2015

2 SIAMO TUTTI POLLICINI DIGITALI La Vita Nova, e-magazine de Il Sole 24 Ore Fosca Giannotti, Dino Pedreschi

3 Big data proxies of social life Shopping patterns & lifestyle Relationships & social ties Movements Desires, opinions, sentiments

4

5

6

7 9 Analisi di Reti Sociali. Aprile-Maggio 2011 marzo 26, 2015

8

9

10

11 CITY USERS SOCIOMETER

12 Dimmi come chiami ti dirò chi sei! Residente A Visitore B Pendolare A B A

13 City User Sociometer Chiamate Pendolari userid CellStar tid PI010U 2 PI002U 2 PI002U 2 PI034U 1 PI023U 1 CellEnd ID PI010U 2 PI002U 2 PI002U 2 PI034U 1 PI023U 1 TimestampStart :37: :46: :53: :59: :03:21+01 TimestampEnd :38: :46: :53: :02: :04:56+01 Analisi di data mining Anonimizzazione Visitatori/Turisti Profilo aggregato Mappa dei profili Residenti

14 Urban Sociometer: the city user indicator Analysing the GSM call habits we can build continuous indicators of social profiles Pisa january 2012

15 Big Data

16 big data bene comune

17

18 DEMOCRATIZING BIG DATA: THE ETHICAL CHALLENGES OF SOCIAL MINING

19 Big Data Analytics & Social Mining The Social Microscope

20 a tool to measure, understand, and possibly predict human behavior

21

22

23 Personal data is the new oil of the Internet and the new currency of the digital world Maglena Kuneva, former European Commissioner of Consumer Protection

24 Who s got the big benefits so far? A few latifundists of data GAFA Profiling for behavioral advertising and target marketing NSA Profiling for discovering potential terrorists Mass surveillance STASI_2.0

25 THE DARK SIDE OF BIG DATA

26

27

28

29 Quale è il limite al controllo sociale?

30 BIG BROTHER BIG DATA COMMONS

31 BIG DATA, EUROPEAN WAY PRIVACY-BY-DESIGN NEW DEAL ON DATA

32 Privacy by Design in Data Mining In many cases (most analy7c ques7ons), it is possible to reconcile the dilemma between privacy protec7on and knowledge sharing Make data anonymous with reference to a specific service Use anonymous data to extract knowledge Only a lible loss in data quality ocen earns a strong privacy protec7on Anna Monreale : Privacy by Design in Data Mining. PhD Thesis 2011

33 Privacy-by-Design in Data Analytics Service Provider Mining and AnalyCcal Engine AnonymizaCon AnonymizaCon is not trivial De- idencficacon is not enough

34 Privacy-Aware socio-meter Profiles computed on anonymous data Output: quan7fica7on of profiles (safe!!) Clustering for Building profiles Aggregated call ac7vi7es assuring anonymity computed by the Telco Operator User 1 User 2.. User n- 1 User n A. Monreale, F. GiannoP, D. Pedreschi, S. Rinzivillo. Privacy- by- design for big data analy7cs. 2013

35 Probability of re-identification for 4 weeks (10M users) Observe the User for 4 weeks Probability of re-identification 1% users P <=0,0001(K=10000) 3% users P <= (K=300000) 70% users P <= (K= )..

36 A data-centric methodology for empirical risk assessment Ongoing project KDD LAB ISTI CNR Pisa Toyota InfoTechnology Center Tokyo Anirban Basu, Anna Monreale, Juan Camilo Corena, Fosca Giannotti, Dino Pedreschi, Shinsaku Kiyomoto, Yutaka Miyake, Tadashi Yanagihara, Roberto Trasarti. A Privacy Risk Model for Trajectory Data. Trust Management VIII - 8th IFIP WG Int. Conf., IFIPTM Proceedings, p , Springer 2014

37 Set the power of big data free 2013/12/0 9 Providing data from business to other business partners. Data used in many ways (Research/Commercial). The required privacy level differs depending on the user. Example: Usage of Probe Data Probe Database Data Center User of Data In-house Departments Group Businesses Parastatal Facilities Required Privacy Level LOW Probe Data Probe Data Probe Data Research Facilities Third Parties HIGH Necessity of method to allow free distribution of (derived) data to various users. 39

38 Privacy-by-Design in Big Data Analytics For each query: - Attack Models - Privacy Measures In case of privacy risks - Privacy by design data transformation

39 RaC Risk and Coverage Curve

40 Exploring the space of RaC curves DB (Raw data) Dimensions from Data (giving rise to different mappings f) Dimensions from Background Knowledge BK Risk Assessment Best Configuration Risk Mitigation: Randomization Generalization..

41

42 Data Statistics Use case 5 Area Covered: 4611 Km 2 Time slots for the analysis 1 hour. Distribution of users moving in the different time slots: Number of trajectories: Number of users: Temporal window: 1 month Note: given two location L1 and L2 and the travel time t needed to reach L2 from L1, considering an average speed of 70 Km/h, t is <= 1 hour.

43 Attack Model 5.1: RAC U

44 i-rac Indexes

45 A NEW DEAL ON PERSONAL DATA DEMOCRATIZING BIG DATA

46 A user-centric ecosystem for Big Data Engage people in the creation and use of big data and knowledge, by empowering individuals with self-knowledge Incentivize individual to participate, to align own self-interest with broader societal goals Based on transparency, trust & privacy

47 Democratize Big Data Design a user-centric ecosystem for big data Empower everyone with tools to integrate own digital breadcrumbs into meaningful knowledge, to boost self-awareness Conosci te stesso Know yourself

48 «Know yourself» examples Your own health records Not only for improving health care system But also for understanding more about your health status, nutrition behavior, prevention advises,..., compared to others Your mobility tracks Not only for insurance control, traffic monitoring But also for understanding your behavior, compared to others

49 When do I typically go to the supermarket?

50 Conoscenza individuale e conoscenza collettiva Novel Indicators Collective Knowledge Collec7ve paberns Individual profiles Personal data store for self knowledge Conoscenza di se Self- awareness Social mining of many individuals Social mining of individual histories Mobility Data Mobility Data Mobility Data Mobility Data Mobility Data Mobility Traditional Data DB Mobility sources Data

51

52 Toscana Mobile Territorial Lab HII project Trusted Cloud of EIT-ICT LAB A living lab of volunteer users who will create a Personal Data Store ecosystem Focus on mobility, telecom services and supermarket transactions Joint project of

53 Key publications F Giannotti, M Nanni, F Pinelli, D Pedreschi. Trajectory pattern mining. ACM SIGKDD 2007 F Giannotti, D Pedreschi. Mobility, data mining and privacy: Geographic knowledge discovery. Springer, 2008 A Monreale, F Pinelli, R Trasarti, F Giannotti. WhereNext: a location predictor on trajectory pattern mining. ACM SIGKDD 2009 S Rinzivillo, D Pedreschi, M Nanni, F Giannotti, N Andrienko, G Andrienko. Visually driven analysis of movement data by progressive clustering. Information Visualization 7 (3-4), D Wang, D Pedreschi, C Song, F Giannotti, AL Barabasi. Human mobility, social ties, and link prediction. ACM SIGKDD 2011 F Giannotti, M Nanni, D Pedreschi, F Pinelli, C Renso, S Rinzivillo, R Trasarti. Unveiling the complexity of human mobility by querying and mining massive trajectory data. The VLDB 20(5) 2011 R Trasarti, F Pinelli, M Nanni, F Giannotti. Mining mobility user profiles for car pooling. ACM SIGKDD 2011

54 Key publications M Coscia, G Rossetti, F Giannotti, D Pedreschi. Demon: a local-first discovery method for overlapping communities. ACM SIGKDD 2012 S Rinzivillo, S Mainardi, F Pezzoni, M Coscia, D Pedreschi, F Giannotti. Discovering the geographical borders of human mobility. KI- Künstliche Intelligenz 26 (3) 2012 D Pennacchioli, M Coscia, S Rinzivillo, D Pedreschi, F Giannotti. Explaining the Product Range Effect in Purchase Data. IEEE BIGDATA 2013 B Furletti, L Gabrielli, C Renso, S Rinzivillo. Analysis of GSM Calls Data for Understanding User Mobility Behavior. IEEE BIG DATA 2013 L Milli, A Monreale, G Rossetti, D Pedreschi, F Giannotti, F Sebastiani. Quantification trees. IEEE ICDM 2013

55 Vision papers F GiannoP, D Pedreschi, A Pentland, P Lukowicz, D Kossmann, J Crowley, D Helbing. A planetary nervous system for social mining and colleccve awareness. The European Physical Journal Special Topics 214 (1), 49-75, 2012 J van den Hoven, D Helbing, D Pedreschi, J Domingo- Ferrer, F GiannoP. FuturICT The road towards ethical ICT. The European Physical Journal Special Topics 214 (1), , 2012 M BaBy, KW Axhausen, F GiannoP, A Pozdnoukhov, A Bazzani, M Wachowicz. Smart cices of the future. The European Physical Journal Special Topics 214 (1), , 2012

56 Special thanks to Fosca GiannoP, co- lead of KDD LAB Salvo Rinzivillo, Mirco Nanni, Roberto Trasar7, Salvatore Ruggieri, Chiara Renso, Anna Monreale, Franco Turini all the fantas7c folks at KDD LAB Pisa many interna7onal collaborators

57 Knowledge Discovery & Data Mining Laboratory kdd.isti.cnr.it

DEMOCRATIZING BIG DATA: THE ETHICAL CHALLENGES OF SOCIAL MINING. Dino PEDRESCHI (KDDLab, Dipartimento di Informatica, Università di Pisa)

DEMOCRATIZING BIG DATA: THE ETHICAL CHALLENGES OF SOCIAL MINING. Dino PEDRESCHI (KDDLab, Dipartimento di Informatica, Università di Pisa) DEMOCRATIZING BIG DATA: THE ETHICAL CHALLENGES OF SOCIAL MINING Dino PEDRESCHI (KDDLab, Dipartimento di Informatica, Università di Pisa) Siamo tutti pollicini digitali Plenty of digital breadcrumbs behind

More information

Mobile phone data for Mobility statistics

Mobile phone data for Mobility statistics International Conference on Big Data for Official Statistics Organised by UNSD and NBS China Beijing, China, 28-30 October 2014 Mobile phone data for Mobility statistics Emanuele Baldacci Italian National

More information

Use of mobile phone data to estimate mobility flows. Measuring urban population and inter-city mobility using big data in an integrated approach

Use of mobile phone data to estimate mobility flows. Measuring urban population and inter-city mobility using big data in an integrated approach Use of mobile phone data to estimate mobility flows. Measuring urban population and inter-city mobility using big data in an integrated approach Barbara Furletti, Lorenzo Gabrielli, Giuseppe Garofalo,

More information

Use of mobile phone data to estimate visitors mobility flows

Use of mobile phone data to estimate visitors mobility flows Use of mobile phone data to estimate visitors mobility flows Lorenzo Gabrielli, Barbara Furletti, Fosca Giannotti, Mirco Nanni, Salvatore Rinzivillo Abstract Big Data originating from the digital breadcrumbs

More information

CONTENTS. List of Contributors Preface Acknowledgments. mobility data modeling and representation

CONTENTS. List of Contributors Preface Acknowledgments. mobility data modeling and representation CONTENTS List of Contributors Preface Acknowledgments page xi xv xix part i mobility data modeling and representation 1 Trajectories and Their Representations 3 S. Spaccapietra, C. Parent, L. Spinsanti

More information

Mobility Data Mining and Analytics

Mobility Data Mining and Analytics Sponsored by: Mobility Data Mining and Analytics 2 nd Datasim Summer School 14 th July 2014 S. Rinzivillo KDD Lab ISTI CNR Pisa, Italy BIG DATA availability What we buy Whom we interact with What we search

More information

Small area model-based estimators using big data sources

Small area model-based estimators using big data sources Small area model-based estimators using big data sources Monica Pratesi 1 Stefano Marchetti 2 Dino Pedreschi 3 Fosca Giannotti 4 Nicola Salvati 5 Filomena Maggino 6 1,2,5 Department of Economics and Management,

More information

Analysis of GSM calls data for understanding user mobility behavior

Analysis of GSM calls data for understanding user mobility behavior Analysis of GSM calls data for understanding user mobility behavior Barbara Furletti, Lorenzo Gabrielli, Chiara Renso, Salvatore Rinzivillo KDDLab, ISTI-CNR, Pisa, Italy Email: {barbara.furletti,lorenzo.gabrielli,chiara.renso,salvatore.rinzivillo}@isti.cnr.it

More information

Laurea in Computer Science/Science dell Informazione (MSc equivalent, 1982, Univ. Pisa, 110/110 cum laude)

Laurea in Computer Science/Science dell Informazione (MSc equivalent, 1982, Univ. Pisa, 110/110 cum laude) Fosca GIANNOTTI Curriculum Vitae Fosca Giannotti was born on 4 October 1958 in Castiglione Garfagnana (Lucca, Italy). She is married with Dino Pedreschi and has a son (Nicola, 21) and a daughter (Bianca,

More information

Thomas Risse. 2 nd International Alexandria Workshop 2015

Thomas Risse. 2 nd International Alexandria Workshop 2015 Thomas Risse 2 nd International Alexandria Workshop 2015 We inhabit a measurable global society nowadays The increasing wealth of data is a chance to disentangle the social complexity Thomas Risse 2 Big

More information

Mapping Linear Networks Based on Cellular Phone Tracking

Mapping Linear Networks Based on Cellular Phone Tracking Ronen RYBOWSKI, Aaron BELLER and Yerach DOYTSHER, Israel Key words: Cellular Phones, Cellular Network, Linear Networks, Mapping. ABSTRACT The paper investigates the ability of accurately mapping linear

More information

Estimating Economic Development with Mobile Phone Data

Estimating Economic Development with Mobile Phone Data Estimating Economic Development with Mobile Phone Data [Experiments and Analysis Paper] Luca Pappalardo KDD Lab University of Pisa Pisa, Italy lpappalardo@di.unipi.it Zbigniew Smoreda SENSE Orange Lab

More information

Identifying users profiles from mobile calls habits

Identifying users profiles from mobile calls habits Identifying users profiles from mobile calls habits Barbara Furletti KDDLAB - ISTI CNR Pisa, Italy barbara.furletti@isti.cnr.it Lorenzo Gabrielli KDDLAB- ISTI CNR Pisa, Italy lorenzo.gabrielli@isti.cnr.it

More information

Small area model-based estimators using big data sources

Small area model-based estimators using big data sources Small area model-based estimators using big data sources Monica Pratesi 1, Dino Pedreschi 2, Fosca Giannotti 3, Stefano Marchetti 4, Nicola Salvati 5, Filomena Maggino 6 1 University of Pisa, e-mail: m.pratesi@ec.unipi.it

More information

Privacy-by-design in big data analytics and social mining

Privacy-by-design in big data analytics and social mining Monreale et al. EPJ Data Science 2014, 2014:10 REGULAR ARTICLE OpenAccess Privacy-by-design in big data analytics and social mining Anna Monreale 1,2*, Salvatore Rinzivillo 2, Francesca Pratesi 1,2, Fosca

More information

Curriculm vitae. Chiara Renso

Curriculm vitae. Chiara Renso Curriculm vitae Chiara Renso Anagraphical data Chiara Renso Born in Verona, Italy, 17 October 1968 Since 2000 she is a researcher at National Research Council (CNR), at ISTI Institute in Pisa, Italy Contents

More information

Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability

Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability Nick Bowen Colin Harrison IBM June 2008 1 Background Global Technology

More information

Estimation of Human Mobility Patterns and Attributes Analyzing Anonymized Mobile Phone CDR:

Estimation of Human Mobility Patterns and Attributes Analyzing Anonymized Mobile Phone CDR: Estimation of Human Mobility Patterns and Attributes Analyzing Anonymized Mobile Phone CDR: Developing Real-time Census from Crowds of Greater Dhaka Ayumi Arai 1 and Ryosuke Shibasaki 1,2 1 Department

More information

a Data Science initiative @ Univ. Piraeus [GR]

a Data Science initiative @ Univ. Piraeus [GR] a Data Science initiative @ Univ. Piraeus [GR] The Data Science Lab members June 2015 What is Data Science source: quora.com! Looking at data! Tools and methods used to analyze large amounts of data! Anything

More information

Big data & social mining: new models for social innovation and business

Big data & social mining: new models for social innovation and business Towards a European Laboratory on Big Data Analytics and Social Mining Big data & social mining: new models for social innovation and business Roberto Minerva Corrado Moiso Fabrizio Antonelli Telecom Italia

More information

Privacy Preserving Outsourcing for Frequent Itemset Mining

Privacy Preserving Outsourcing for Frequent Itemset Mining Privacy Preserving Outsourcing for Frequent Itemset Mining M. Arunadevi 1, R. Anuradha 2 PG Scholar, Department of Software Engineering, Sri Ramakrishna Engineering College, Coimbatore, India 1 Assistant

More information

Eindhoven December 4, 2014

Eindhoven December 4, 2014 Eindhoven December 4, 2014 Waves: Visualizing spatio-temporal Soccer Data Insight Reports of sport events can be enhanced by real-time feature analysis. Solutions Complex spatio-temporal sports-analytics

More information

Big Data Analytics in Mobile Environments

Big Data Analytics in Mobile Environments 1 Big Data Analytics in Mobile Environments 熊 辉 教 授 罗 格 斯 - 新 泽 西 州 立 大 学 2012-10-2 Rutgers, the State University of New Jersey Why big data: historical view? Productivity versus Complexity (interrelatedness,

More information

Foundations of Multidimensional Network Analysis

Foundations of Multidimensional Network Analysis 2 International Conference on Advances in Social Networks Analysis and Mining Foundations of Multidimensional Network Analysis Michele Berlingerio Michele Coscia 2 Fosca Giannotti Anna Monreale 2 Dino

More information

An Order-Invariant Time Series Distance Measure [Position on Recent Developments in Time Series Analysis]

An Order-Invariant Time Series Distance Measure [Position on Recent Developments in Time Series Analysis] An Order-Invariant Time Series Distance Measure [Position on Recent Developments in Time Series Analysis] Stephan Spiegel and Sahin Albayrak DAI-Lab, Technische Universität Berlin, Ernst-Reuter-Platz 7,

More information

Homomorphic Encryption Schema for Privacy Preserving Mining of Association Rules

Homomorphic Encryption Schema for Privacy Preserving Mining of Association Rules Homomorphic Encryption Schema for Privacy Preserving Mining of Association Rules M.Sangeetha 1, P. Anishprabu 2, S. Shanmathi 3 Department of Computer Science and Engineering SriGuru Institute of Technology

More information

Example application (1) Telecommunication. Lecture 1: Data Mining Overview and Process. Example application (2) Health

Example application (1) Telecommunication. Lecture 1: Data Mining Overview and Process. Example application (2) Health Lecture 1: Data Mining Overview and Process What is data mining? Example applications Definitions Multi disciplinary Techniques Major challenges The data mining process History of data mining Data mining

More information

Constructing Semantic Interpretation of Routine and Anomalous Mobility Behaviors from Big Data

Constructing Semantic Interpretation of Routine and Anomalous Mobility Behaviors from Big Data Constructing Semantic Interpretation of Routine and Anomalous Mobility Behaviors from Big Data Georg Fuchs 1,3, Hendrik Stange 1, Dirk Hecker 1, Natalia Andrienko 1,2,3, Gennady Andrienko 1,2,3 1 Fraunhofer

More information

Process Mining in Big Data Scenario

Process Mining in Big Data Scenario Process Mining in Big Data Scenario Antonia Azzini, Ernesto Damiani SESAR Lab - Dipartimento di Informatica Università degli Studi di Milano, Italy antonia.azzini,ernesto.damiani@unimi.it Abstract. In

More information

Towards Mega-Modeling: A Walk through Data Analysis Experiences

Towards Mega-Modeling: A Walk through Data Analysis Experiences Towards Mega-Modeling: A Walk through Data Analysis Experiences Stefano Ceri DEIB Politecnico di Milano stefano.ceri@polimi.it Emanuele Della Valle DEIB Politecnico di Milano emanuele.dellavalle@polimi.it

More information

BIG DATA FOR MODELLING 2.0

BIG DATA FOR MODELLING 2.0 BIG DATA FOR MODELLING 2.0 ENHANCING MODELS WITH MASSIVE REAL MOBILITY DATA DATA INTEGRATION www.ptvgroup.com Lorenzo Meschini - CEO, PTV SISTeMA COST TU1004 final Conference www.ptvgroup.com Paris, 11

More information

Privacy Challenges of Telco Big Data

Privacy Challenges of Telco Big Data Dr. Günter Karjoth June 17, 2014 ITU telco big data workshop Privacy Challenges of Telco Big Data Mobile phones are great sources of data but we must be careful about privacy 1 / 15 Sources of Big Data

More information

Explaining the Product Range Effect in Purchase Data

Explaining the Product Range Effect in Purchase Data Explaining the Product Range Effect in Purchase Data Diego Pennacchioli, Michele Coscia, Salvatore Rinzivillo, Dino Pedreschi, Fosca Giannotti diego.pennacchioli@isti.cnr.it 2013 IEEE International Conference

More information

ES ET DE LA VIE PRIVÉE E 29 th INTERNATIONAL CONFERENCE OF DATA PROTECTION AND PRIVACY COMMISSIONERS

ES ET DE LA VIE PRIVÉE E 29 th INTERNATIONAL CONFERENCE OF DATA PROTECTION AND PRIVACY COMMISSIONERS ES ET DE LA VIE PRIVÉE E 29 th INTERNATIONAL CONFERENCE OF DATA PROTECTION AND PRIVACY COMMISS The Impact of Data Mining on Privacy in the Public and Private Sectors Richard S. Rosenberg Professor Emeritus,

More information

Big Data Mining Services and Knowledge Discovery Applications on Clouds

Big Data Mining Services and Knowledge Discovery Applications on Clouds Big Data Mining Services and Knowledge Discovery Applications on Clouds Domenico Talia DIMES, Università della Calabria & DtoK Lab Italy talia@dimes.unical.it Data Availability or Data Deluge? Some decades

More information

Big Data - Security and Privacy

Big Data - Security and Privacy Big Data - Security and Privacy Elisa Bertino CS Department, Cyber Center, and CERIAS Purdue University Cyber Center! Big Data EveryWhere! Lots of data is being collected, warehoused, and mined Web data,

More information

ICT infrastructure as key enabler of Smart Cities

ICT infrastructure as key enabler of Smart Cities ICT infrastructure as key enabler of Smart Cities Thierry Van Landegem Alcatel-Lucent, Bell Labs FIA Aalborg May 2012 COPYRIGHT 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. THE WORLD IS CHANGING FROM RURAL

More information

1 General Information 3. 2 Qualifications 3. 3 Covered Positions 3. 4 Studies 4. 5 Research Statement 5. 6 Participation to Research Projects 6

1 General Information 3. 2 Qualifications 3. 3 Covered Positions 3. 4 Studies 4. 5 Research Statement 5. 6 Participation to Research Projects 6 CURRICULUM VITAE MICHELE BERLINGERIO Contents 1 General Information 3 2 Qualifications 3 3 Covered Positions 3 4 Studies 4 5 Research Statement 5 6 Participation to Research Projects 6 7 Fundings and Awards

More information

Mining the Temporal Dimension of the Information Propagation

Mining the Temporal Dimension of the Information Propagation Mining the Temporal Dimension of the Information Propagation Michele Berlingerio, Michele Coscia 2, and Fosca Giannotti 3 IMT-Lucca, Lucca, Italy 2 Dipartimento di Informatica, Pisa, Italy {name.surname}@isti.cnr.it

More information

A Novel Technique of Privacy Protection. Mining of Association Rules from Outsourced. Transaction Databases

A Novel Technique of Privacy Protection. Mining of Association Rules from Outsourced. Transaction Databases A Novel Technique of Privacy Protection Mining of Association Rules from Outsource Transaction Databases 1 Dhananjay D. Wadkar, 2 Santosh N. Shelke 1 Computer Engineering, Sinhgad Academy of Engineering

More information

Privacy: Legal Aspects of Big Data and Information Security

Privacy: Legal Aspects of Big Data and Information Security Privacy: Legal Aspects of Big Data and Information Security Presentation at the 2 nd National Open Access Workshop 21-22 October, 2013 Izmir, Turkey John N. Gathegi University of South Florida, Tampa,

More information

Project Participants

Project Participants Annual Report for Period:10/2006-09/2007 Submitted on: 08/15/2007 Principal Investigator: Yang, Li. Award ID: 0414857 Organization: Western Michigan Univ Title: Projection and Interactive Exploration of

More information

Program in Business Informatics. Experiences at the University of Pisa

Program in Business Informatics. Experiences at the University of Pisa A Graduate Program in Business Informatics: Experiences at the University of Pisa Antonio Albano Coordinator of the Graduate Program in Business Informatics albano@di.unipi.it Salvatore Ruggieri QA Manager

More information

Information Security, PII and Big Data

Information Security, PII and Big Data ITU Workshop on ICT Security Standardization for Developing Countries (Geneva, Switzerland, 15-16 September 2014) Information Security, PII and Big Data Edward (Ted) Humphreys ISO/IEC JTC 1/SC 27 (WG1

More information

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot www.etidaho.com (208) 327-0768 Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot 3 Days About this Course This course is designed for the end users and analysts that

More information

NYC Taxi Trip and Fare Data Analytics using BigData

NYC Taxi Trip and Fare Data Analytics using BigData NYC Taxi Trip and Fare Data Analytics using BigData Umang Patel #1 # Department of Computer Science and Engineering University of Bridgeport, USA 1 umapatel@my.bridgeport.edu Abstract As there is an amassed

More information

Scalable Cluster Analysis of Spatial Events

Scalable Cluster Analysis of Spatial Events International Workshop on Visual Analytics (2012) K. Matkovic and G. Santucci (Editors) Scalable Cluster Analysis of Spatial Events I. Peca 1, G. Fuchs 1, K. Vrotsou 1,2, N. Andrienko 1 & G. Andrienko

More information

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 Yannis Stavrakas Vassilis Plachouras IMIS / RC ATHENA Athens, Greece {yannis, vplachouras}@imis.athena-innovation.gr Abstract.

More information

Hortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc. 2011 2014. All Rights Reserved

Hortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc. 2011 2014. All Rights Reserved Hortonworks & SAS Analytics everywhere. Page 1 A change in focus. A shift in Advertising From mass branding A shift in Financial Services From Educated Investing A shift in Healthcare From mass treatment

More information

Utilizing big data to bring about innovative offerings and new revenue streams DATA-DERIVED GROWTH

Utilizing big data to bring about innovative offerings and new revenue streams DATA-DERIVED GROWTH Utilizing big data to bring about innovative offerings and new revenue streams DATA-DERIVED GROWTH ACTIONABLE INTELLIGENCE Ericsson is driving the development of actionable intelligence within all aspects

More information

Privacy Preserved Association Rule Mining For Attack Detection and Prevention

Privacy Preserved Association Rule Mining For Attack Detection and Prevention Privacy Preserved Association Rule Mining For Attack Detection and Prevention V.Ragunath 1, C.R.Dhivya 2 P.G Scholar, Department of Computer Science and Engineering, Nandha College of Technology, Erode,

More information

Your door to future governance solutions

Your door to future governance solutions Your door to future governance solutions www.egovlab.eu 2 3 not just in theory but also in practice 4 5 www.egovlab.eu * Word from egovlab s director Vasilis Koulolias: The power of information and communication

More information

Privacy Challenges in the Internet of Things (IoT) a European Perspective

Privacy Challenges in the Internet of Things (IoT) a European Perspective Privacy Challenges in the Internet of Things (IoT) a European Perspective Alicja Gniewek, PhD Student Interdisciplinary Centre for Security, Reliability and Trust Weicker Building, Université du Luxembourg

More information

Data Mining & Data Stream Mining Open Source Tools

Data Mining & Data Stream Mining Open Source Tools Data Mining & Data Stream Mining Open Source Tools Darshana Parikh, Priyanka Tirkha Student M.Tech, Dept. of CSE, Sri Balaji College Of Engg. & Tech, Jaipur, Rajasthan, India Assistant Professor, Dept.

More information

GPS Enabled Taxi Probe s Big Data Processing for Traffic Evaluation of Bangkok Using Apache Hadoop Distributed System

GPS Enabled Taxi Probe s Big Data Processing for Traffic Evaluation of Bangkok Using Apache Hadoop Distributed System GPS Enabled Taxi Probe s Big Data Processing for Traffic Evaluation of Bangkok Using Apache Hadoop Distributed System Paper Identification number: AYRF14-060 Saurav RANJIT 1, Masahiko NAGAI 1, 2, Itti

More information

Alcatel-Lucent 8920 Service Quality Manager for IPTV Business Intelligence

Alcatel-Lucent 8920 Service Quality Manager for IPTV Business Intelligence Alcatel-Lucent 8920 Service Quality Manager for IPTV Business Intelligence IPTV service intelligence solution for marketing, programming, internal ad sales and external partners The solution is based on

More information

Geo- social Network Analysis and Applica5ons

Geo- social Network Analysis and Applica5ons Geo- social Network Analysis and Applica5ons Cecilia Mascolo joint work with C. Brown, A. Noulas and S. Scellato Big Data and Social Media Workshop February 2013, Glasgow, UK. My Interests Geo- social

More information

Some Research Challenges for Big Data Analytics of Intelligent Security

Some Research Challenges for Big Data Analytics of Intelligent Security Some Research Challenges for Big Data Analytics of Intelligent Security Yuh-Jong Hu hu at cs.nccu.edu.tw Emerging Network Technology (ENT) Lab. Department of Computer Science National Chengchi University,

More information

Discovery of User Groups within Mobile Data

Discovery of User Groups within Mobile Data Discovery of User Groups within Mobile Data Syed Agha Muhammad Technical University Darmstadt muhammad@ess.tu-darmstadt.de Kristof Van Laerhoven Darmstadt, Germany kristof@ess.tu-darmstadt.de ABSTRACT

More information

Beyond listening Driving better decisions with business intelligence from social sources

Beyond listening Driving better decisions with business intelligence from social sources Beyond listening Driving better decisions with business intelligence from social sources From insight to action with IBM Social Media Analytics State of the Union Opinions prevail on the Internet Social

More information

Data Mining and Knowledge Discovery in Databases (KDD) State of the Art. Prof. Dr. T. Nouri Computer Science Department FHNW Switzerland

Data Mining and Knowledge Discovery in Databases (KDD) State of the Art. Prof. Dr. T. Nouri Computer Science Department FHNW Switzerland Data Mining and Knowledge Discovery in Databases (KDD) State of the Art Prof. Dr. T. Nouri Computer Science Department FHNW Switzerland 1 Conference overview 1. Overview of KDD and data mining 2. Data

More information

Societal Data Resources and Data Processing Infrastructure

Societal Data Resources and Data Processing Infrastructure Societal Data Resources and Data Processing Infrastructure Bruno Martins INESC-ID & Instituto Superior Técnico bruno.g.martins@ist.utl.pt 1 DATASTORM Task on Societal Data Project vision : Build infrastructure

More information

Discovering Trajectory Outliers between Regions of Interest

Discovering Trajectory Outliers between Regions of Interest Discovering Trajectory Outliers between Regions of Interest Vitor Cunha Fontes 1, Lucas Andre de Alencar 1, Chiara Renso 2, Vania Bogorny 1 1 Dep. de Informática e Estatística Universidade Federal de Santa

More information

The Advantages of Using Visual Interfaces

The Advantages of Using Visual Interfaces Knowledge Extraction and Integration using Automatic and Visual Methods Vedran Sabol, Roman Kern, Barbara Kump, Viktoria Pammer, Michael Granitzer vsabol rkern bkump vpammer mgrani@know-center.at Know-Center,

More information

Horizontal Aggregations in SQL to Prepare Data Sets for Data Mining Analysis

Horizontal Aggregations in SQL to Prepare Data Sets for Data Mining Analysis IOSR Journal of Computer Engineering (IOSRJCE) ISSN: 2278-0661, ISBN: 2278-8727 Volume 6, Issue 5 (Nov. - Dec. 2012), PP 36-41 Horizontal Aggregations in SQL to Prepare Data Sets for Data Mining Analysis

More information

Web Mining Seminar CSE 450. Spring 2008 MWF 11:10 12:00pm Maginnes 113

Web Mining Seminar CSE 450. Spring 2008 MWF 11:10 12:00pm Maginnes 113 CSE 450 Web Mining Seminar Spring 2008 MWF 11:10 12:00pm Maginnes 113 Instructor: Dr. Brian D. Davison Dept. of Computer Science & Engineering Lehigh University davison@cse.lehigh.edu http://www.cse.lehigh.edu/~brian/course/webmining/

More information

Big Data challenges to foster AI research and applications

Big Data challenges to foster AI research and applications GRUPPO TELECOM ITALIA Workshop on Embracing Potential of Big Data Pisa, 12 Dicembre 2014 Big Data challenges to foster AI research and applications Fabrizio Antonelli SKIL Lab The Joint Open Labs of Telecom

More information

PRACTICAL DATA MINING IN A LARGE UTILITY COMPANY

PRACTICAL DATA MINING IN A LARGE UTILITY COMPANY QÜESTIIÓ, vol. 25, 3, p. 509-520, 2001 PRACTICAL DATA MINING IN A LARGE UTILITY COMPANY GEORGES HÉBRAIL We present in this paper the main applications of data mining techniques at Electricité de France,

More information

How People Read Books Online: Mining and Visualizing Web Logs for Use Information

How People Read Books Online: Mining and Visualizing Web Logs for Use Information How People Read Books Online: Mining and Visualizing Web Logs for Use Information Rong Chen 1, Anne Rose 2, Benjamin B. Bederson 2 1 Department of Computer Science and Technique College of Computer Science,

More information

Web Advertising Personalization using Web Content Mining and Web Usage Mining Combination

Web Advertising Personalization using Web Content Mining and Web Usage Mining Combination 8 Web Advertising Personalization using Web Content Mining and Web Usage Mining Combination Ketul B. Patel 1, Dr. A.R. Patel 2, Natvar S. Patel 3 1 Research Scholar, Hemchandracharya North Gujarat University,

More information

Viral Marketing in Social Network Using Data Mining

Viral Marketing in Social Network Using Data Mining Viral Marketing in Social Network Using Data Mining Shalini Sharma*,Vishal Shrivastava** *M.Tech. Scholar, Arya College of Engg. & I.T, Jaipur (Raj.) **Associate Proffessor(Dept. of CSE), Arya College

More information

A Survey on Web Research for Data Mining

A Survey on Web Research for Data Mining A Survey on Web Research for Data Mining Gaurav Saini 1 gauravhpror@gmail.com 1 Abstract Web mining is the application of data mining techniques to extract knowledge from web data, including web documents,

More information

EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION

EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION A: INTRODUCTION TO THE ALLIANCE S CONTRIBUTION The EuroTech Universities Alliance is a strategic

More information

Big Data Analytics. Genoveva Vargas-Solar http://www.vargas-solar.com/big-data-analytics French Council of Scientific Research, LIG & LAFMIA Labs

Big Data Analytics. Genoveva Vargas-Solar http://www.vargas-solar.com/big-data-analytics French Council of Scientific Research, LIG & LAFMIA Labs 1 Big Data Analytics Genoveva Vargas-Solar http://www.vargas-solar.com/big-data-analytics French Council of Scientific Research, LIG & LAFMIA Labs Montevideo, 22 nd November 4 th December, 2015 INFORMATIQUE

More information

IJCSES Vol.7 No.4 October 2013 pp.165-168 Serials Publications BEHAVIOR PERDITION VIA MINING SOCIAL DIMENSIONS

IJCSES Vol.7 No.4 October 2013 pp.165-168 Serials Publications BEHAVIOR PERDITION VIA MINING SOCIAL DIMENSIONS IJCSES Vol.7 No.4 October 2013 pp.165-168 Serials Publications BEHAVIOR PERDITION VIA MINING SOCIAL DIMENSIONS V.Sudhakar 1 and G. Draksha 2 Abstract:- Collective behavior refers to the behaviors of individuals

More information

KAVE ecosystem unlocks the potential of Big Data Building blocks for scalable, manageable and cost-efficient data analysis

KAVE ecosystem unlocks the potential of Big Data Building blocks for scalable, manageable and cost-efficient data analysis 1 KAVE ecosystem unlocks the potential of Big Data KAVE ecosystem unlocks the potential of Big Data Building blocks for scalable, manageable and cost-efficient data analysis Advisory www.kpmg.com/nl 2

More information

Federico Rajola. Customer Relationship. Management in the. Financial Industry. Organizational Processes and. Technology Innovation.

Federico Rajola. Customer Relationship. Management in the. Financial Industry. Organizational Processes and. Technology Innovation. Federico Rajola Customer Relationship Management in the Financial Industry Organizational Processes and Technology Innovation Second edition ^ Springer Contents 1 Introduction 1 1.1 Identification and

More information

On the Analysis and Visualisation of Anonymised Call Detail Records

On the Analysis and Visualisation of Anonymised Call Detail Records On the Analysis and Visualisation of Anonymised Call Detail Records Varun J, Sunil H.S, Vasisht R SJB Research Foundation Uttarahalli Road, Kengeri, Bangalore, India Email: (varun.iyengari,hs.sunilrao,vasisht.raghavendra)@gmail.com

More information

Hyper-Personalization with MNO Subscriber Data

Hyper-Personalization with MNO Subscriber Data Hyper-Personalization with MNO Subscriber Data Approaches and Recent Trends Regarding the Use of MNO Data for Hyper-Personalization By Zach Cohen, Shahzad Zia and Carly Christian Private and public-sector

More information

Discovering Chasing Behavior in Moving Object Trajectories

Discovering Chasing Behavior in Moving Object Trajectories Discovering Chasing Behavior in Moving Object Trajectories Fernando de Lucca Siqueira and Vania Bogorny [fernandols, vania] @inf.ufsc.br Departamento de Informatica e Estatistica UFSC, Florianopolis, Brazil

More information

Identifying Spatial Structure of Urban Functional Centers Using Travel Survey Data: A Case Study of Singapore

Identifying Spatial Structure of Urban Functional Centers Using Travel Survey Data: A Case Study of Singapore Identifying Spatial Structure of Urban Functional Centers Using Travel Survey Data: A Case Study of Singapore Chen Zhong Future Cities Laboratory, Department of Architecture, ETH Zurich, 8092 Zurich, Switzerland

More information

A Case of Study on Hadoop Benchmark Behavior Modeling Using ALOJA-ML

A Case of Study on Hadoop Benchmark Behavior Modeling Using ALOJA-ML www.bsc.es A Case of Study on Hadoop Benchmark Behavior Modeling Using ALOJA-ML Josep Ll. Berral, Nicolas Poggi, David Carrera Workshop on Big Data Benchmarks Toronto, Canada 2015 1 Context ALOJA: framework

More information

Analyzing Customer Churn in the Software as a Service (SaaS) Industry

Analyzing Customer Churn in the Software as a Service (SaaS) Industry Analyzing Customer Churn in the Software as a Service (SaaS) Industry Ben Frank, Radford University Jeff Pittges, Radford University Abstract Predicting customer churn is a classic data mining problem.

More information

NEW TECHNIQUE TO DEAL WITH DYNAMIC DATA MINING IN THE DATABASE

NEW TECHNIQUE TO DEAL WITH DYNAMIC DATA MINING IN THE DATABASE www.arpapress.com/volumes/vol13issue3/ijrras_13_3_18.pdf NEW TECHNIQUE TO DEAL WITH DYNAMIC DATA MINING IN THE DATABASE Hebah H. O. Nasereddin Middle East University, P.O. Box: 144378, Code 11814, Amman-Jordan

More information

STAR WARS AND THE ART OF DATA SCIENCE

STAR WARS AND THE ART OF DATA SCIENCE STAR WARS AND THE ART OF DATA SCIENCE MELODIE RUSH, SENIOR ANALYTICAL ENGINEER CUSTOMER LOYALTY Original Presentation Created And Presented By Mary Osborne, Business Visualization Manager At 2014 SAS Global

More information

Profile Based Personalized Web Search and Download Blocker

Profile Based Personalized Web Search and Download Blocker Profile Based Personalized Web Search and Download Blocker 1 K.Sheeba, 2 G.Kalaiarasi Dhanalakshmi Srinivasan College of Engineering and Technology, Mamallapuram, Chennai, Tamil nadu, India Email: 1 sheebaoec@gmail.com,

More information

MASSIF: A Highly Scalable SIEM

MASSIF: A Highly Scalable SIEM MASSIF: A Highly Scalable SIEM Ricardo Jimenez-Peris Univ. Politecnica de Madrid (UPM) rjimenez@fi.upm.es DEMONS Workshop Berlin, April 25 th 2012 MASSIF in a Nutshell MASSIF aims at developing the next

More information

The Internet of Things... Hype or not?

The Internet of Things... Hype or not? The Internet of Things... Hype or not? Filip De Maeyer Philip Leenders 2013 global revenues of USD 5.8 billion Client-centric, services-focused business 73% of Global Fortune 100 and 59% of Global Fortune

More information

Social Network Analysis: Introduzione all'analisi di reti sociali

Social Network Analysis: Introduzione all'analisi di reti sociali Social Network Analysis: Introduzione all'analisi di reti sociali Michele Coscia Dipartimento di Informatica Università di Pisa www.di.unipi.it/~coscia Piano Lezioni Introduzione Misure + Modelli di Social

More information

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data

More information

Smart Data Platform for CAPS

Smart Data Platform for CAPS Ivano Gauna CSI-Piemonte Bruxelles CSI-Piemonte profile Smart Data Platform for CAPS Consortium for Information Systems: q One of the main ICT agencies in Italy q Founded in 1977 q Owned by public stakeholders

More information

Technology & Applications. Three Technology Must-Haves to Improve Sales Effectiveness and Boost Win Rates

Technology & Applications. Three Technology Must-Haves to Improve Sales Effectiveness and Boost Win Rates Technology & Applications Three Technology Must-Haves to Improve Sales Effectiveness and Boost Win Rates Executive Summary To drive sales excellence, sales professionals need to monitor their objectives,

More information

An innovative and comprehensive framework for Social Driven Vulnerability Assessment. 20 November 2014

An innovative and comprehensive framework for Social Driven Vulnerability Assessment. 20 November 2014 An innovative and comprehensive framework for Social Driven Vulnerability Assessment 20 November 2014 Who are we? Enrico Frumento (twitter: enricoff) ICT Security Specialist @ CEFRIEL Main Activities:

More information

IAF BIG DATA ETHICAL ASSESSMENT PROJECT MAY 2015

IAF BIG DATA ETHICAL ASSESSMENT PROJECT MAY 2015 IAF BIG DATA ETHICAL ASSESSMENT PROJECT MAY 2015 THE ISSUE Predicting future outcomes no matter the endeavor is compelling Big data is making predictions based on non-intuitive data relationships There

More information

Big Data how it changes the way you treat data

Big Data how it changes the way you treat data Big Data how it changes the way you treat data Oct. 2013 Chung-Min Chen Chief Scientist Info. Analysis Research & Services The views and opinions expressed in this presentation are those of the author

More information

Introduction to Data Mining

Introduction to Data Mining Introduction to Data Mining Jay Urbain Credits: Nazli Goharian & David Grossman @ IIT Outline Introduction Data Pre-processing Data Mining Algorithms Naïve Bayes Decision Tree Neural Network Association

More information

Masters in Information Technology

Masters in Information Technology Computer - Information Technology MSc & MPhil - 2015/6 - July 2015 Masters in Information Technology Programme Requirements Taught Element, and PG Diploma in Information Technology: 120 credits: IS5101

More information

Big Data overview. Livio Ventura. SICS Software week, Sept 23-25 Cloud and Big Data Day

Big Data overview. Livio Ventura. SICS Software week, Sept 23-25 Cloud and Big Data Day Big Data overview SICS Software week, Sept 23-25 Cloud and Big Data Day Livio Ventura Big Data European Industry Leader for Telco, Energy and Utilities and Digital Media Agenda some data on Data Big Data

More information

Chapter 6 - Enhancing Business Intelligence Using Information Systems

Chapter 6 - Enhancing Business Intelligence Using Information Systems Chapter 6 - Enhancing Business Intelligence Using Information Systems Managers need high-quality and timely information to support decision making Copyright 2014 Pearson Education, Inc. 1 Chapter 6 Learning

More information