Introduction to Big Data Science

Size: px
Start display at page:

Download "Introduction to Big Data Science"

Transcription

1 Introduction to Big Data Science 13 th Period Project: Situation Awareness and Statistical Analysis On Big Data Big Data Science 1

2 Contents What is Situation Awareness (SA)? 3 Levels for SA Role of Data Mining and Reasoning in SA Extracting Information from Big Data Entire Scenario of SA on Facebook Data Big Data Science 2

3 Awareness The goal of computational awareness: to realize awareness in computing machines Awareness is the ability to perceive, to feel, or to be conscious of events, objects or sensory patterns. Big Data Science 3

4 Situation Awareness Situation awareness is the perception of environmental elements with respect to time and/or space, the comprehension of their meaning, and the projection of their status in the near future after some variable has changed. (Mica Endsley, Wikipedia). Big Data Science 4

5 JDL: Data Fusion Levels A. Steinberg, et al., Rethinking the JDL Data Fusion Levels Big Data Science 5

6 Sources of SA Information M.R. Endsley, Theoretical Underpinnings of SA: A Critical Review Big Data Science 8

7 Mechanisms and Processes in SA M.R. Endsley, Theoretical Underpinnings of SA: A Critical Review Big Data Science 9

8 Provenance Endsley s Model Semantic Analysis thematic Spatio-Temporal trust Relate Situation Entities Identify Situation Entities Collect Relevant Data M. Kokar, et al., Ontology-based Situation Awareness* (Modified Figure by A. Sheth) Big Data Science 12

9 Three layers for situation awareness Big Data Science 13

10 A novel architecture for active situation awareness Image processing and pattern recognition, data mining, signal processing in computer technology can be applied to perception layer to recognize low level objects and data patterns. Situation awareness is inferring some conclusion from observation in the perception layer. Ontologybased rules are usually used for comprehension. The top layer is for projection, which anticipates future events and their implications. Big Data Science 14

11 A novel architecture for active situation awareness Projection recommendtoparticipate TheEvent(Building, Event) needreplyto (ITM) checkhisevent (ITM) Comprehension (Situation) givehottopic (ITM,ATopicHisBlog) hasevent (Building, Event) israre(event) saycelebration (ITM, myblog) Perception Stand (People, Longline) isat (People, Building) Wrote (ITM, myblog) needreplyto (ITM) World Facebook Twitter Google Web Data Service Big Data Science 15

12 Perceptions by mining SNS data Active Situation Awareness Ontology for Comprehension at Upper Layer Latent Query for SA (Time, Space, Theme) Document Processing Classification (TF-IDF) Event Information Extraction Perception Information Documents Twitter Facebook Data SNS, Web Data Services Big Data Science 16

13 Perception by mining SNS data Select data set to extract information to be used in comprehension layer. The information can be modeled by Web APIs to provide facts to rule engine. For example, we have analyzed the Facebook user s sentences by data mining technique to catch use s intension or changes in mind. There are various data and information set for each layer. Big Data Science 17

14 Ontology for Comprehension of the information Big Data Science 18

15 Comprehension of the information by inference of ontology and rule %% Cafeteria Event Inference %% Rules %%longlinestand(human) :- stand(human), long(human). mayhaveevent(place) :- longlinestand(human), areat(human, Place). hasevent(place,event) :- mayhaveevent(place), foundevent(place, Event). recommendtoparticipatetheevent(place, Event) :- hasevent(place,event), israre(event). %% Facts longlinestand(students). areat(students, cafeteria). foundevent(cafeteria, sinsobamatsuri). israre(sobamatsuri). Big Data Science 19

16 ASA System Architecture on SNS Smart Phone Inference Engine Facts RESTful Services for Perception FaceBook Service Rules Mapping Ontologies Domain Ontologies Twiter Service Web Data Service Big Data Science 20

17 Scenarios Scenario I A student in our university bought a lunch box because he saw a long waiting line in the university cafeteria. But he didn t know it was the waiting line for new soba festival in the cafeteria. If he got the information about the new soba festival from his smart phone when he was near to the cafeteria, he would have chosen the soba. Scenario II, III When I was in my office, a student came in. When I shake my smart phone, the phone tells me the followings about the student based on information on the Facebook: (Example) - The Opponent's Name: Leo Saito - He has interest to me - Saito has Events (Part Time Job, Date) - Saito has changed his topic from food to research Big Data Science 21

18 Mining SNS Data (By TF-IDF for Perception layer) Function: Category_calculate{//calculate category of a writing Input: word // set of words that are split Output: category //category of words set Data = learning data set for i = 1 to n {// n = number of word in words set calculate IDF i = log 2 (number of all document in Data / number of word i containing document in Data )} //IDF i = IDF value of word i for i = 1 to n {// n = number of word in words set for j = 1 to m { // m = number of data of Data set calculate TF ij =(frequency of word i in Data j / number of all word i in Data j ) calculate TFIDF ij = Tf ij * IDF i }} for j = 1 to m { // m = number of data of Data set calculate Sum_of_TFIDF j = sumof TFIDF 1j, TFIDF 2j,TFIDF nj if Max_Sum_of_TFIDF < Sum_of_TFIDF j { category=category of Data j }} return category } Function: determine the difference between the two categories{ Input: writing1, writing2 //writing is document set Output: true or false //If accordance -> true, Else -> false for i = i to n {//n = number of document in writing 1 Category_calculate(writing1 i ) } category_of_writing1 = most common category of document in writing1 for i = j to m {//m = number of document in writing 2 Category_calculate(writing2 j ) } category_of_writing2 = most common category of document in writing2 if category_of_writing1 = category_of_writing2 return false else return true } Big Data Science 22

19 Ontology for SA (Example 2) Big Data Science 23

20 Rules for SA (Example 2) 1) ITM wantsmyreply(itm) :- wrote(itm, myblog) and thereis(questionmark,hiswriting). enjoyme(itm) :- wrotenumbermorethan(itm, myblog, threshold). givehottopic(itm,atopichisblog) :- wrote(itm, ATopicHisBlog) and therearerepliesmorethan(atopichisblog, threshold). givegoodevaluation(itm, ATopicHisBlog) :- wrote(itm, ATopicHisBlog) and therearegoodrepliesmorethan(atopichisblog, threshold). saycelebration(itm, myblog) :- wrote(itm, myblog) and thereis(celebration, myblog). havenewevent(itm) :- wrote(itm, hiseventblog). * Example of Upper Level Factor or Situation needreplyto(itm) :- wantsmyreply(itm) and saycelebration(itm, myblog) adn enjoyme(itm). checkhisevent(itm) :- havenewevent(itm) and givehottopic(itm, ATopicHistBlog). 2) MC wantsmyreply(mc) :- wrote(mc, myblog) and thereis(questionmark,hiswriting). enjoyme(mc) :- wrotenumbermorethan(mc, myblog, threshold). givehottopic(mc,atopichisblog) :- wrote(mc, ATopicHisBlog) and therearerepliesmorethan(atopichisblog, threshold). givegoodevaluation(mc, ATopicHisBlog) :- wrote(mc, ATopicHisBlog) and therearegoodrepliesmorethan(atopichisblog, threshold). saycelebration(mc, myblog) :- wrote(mc, myblog) and thereis(celebration, myblog). havenewevent(mc) :- wrote(mc, hiseventblog). 3) IL hasnewevent(il) :- wrotesomeblogforevent(il) --> * large complex task * haschangedmind(il) :- wrotedifferentcontextinblog(il) --> * large complex task * Big Data Science 24

21 Running Example of Projection by ASA Demonstration Big Data Science 25

Data Mining Yelp Data - Predicting rating stars from review text

Data Mining Yelp Data - Predicting rating stars from review text Data Mining Yelp Data - Predicting rating stars from review text Rakesh Chada Stony Brook University rchada@cs.stonybrook.edu Chetan Naik Stony Brook University cnaik@cs.stonybrook.edu ABSTRACT The majority

More information

HOW TO DO A SMART DATA PROJECT

HOW TO DO A SMART DATA PROJECT April 2014 Smart Data Strategies HOW TO DO A SMART DATA PROJECT Guideline www.altiliagroup.com Summary ALTILIA s approach to Smart Data PROJECTS 3 1. BUSINESS USE CASE DEFINITION 4 2. PROJECT PLANNING

More information

ANALYTICS IN BIG DATA ERA

ANALYTICS IN BIG DATA ERA ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY, DISCOVER RELATIONSHIPS AND CLASSIFY HUGE AMOUNT OF DATA MAURIZIO SALUSTI SAS Copyr i g ht 2012, SAS Ins titut

More information

Information Retrieval Elasticsearch

Information Retrieval Elasticsearch Information Retrieval Elasticsearch IR Information retrieval (IR) is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches

More information

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS.

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. ALTILIA turns Big Data into Smart Data and enables businesses to

More information

Traffic Prediction and Analysis using a Big Data and Visualisation Approach

Traffic Prediction and Analysis using a Big Data and Visualisation Approach Traffic Prediction and Analysis using a Big Data and Visualisation Approach Declan McHugh 1 1 Department of Computer Science, Institute of Technology Blanchardstown March 10, 2015 Summary This abstract

More information

COMP9321 Web Application Engineering

COMP9321 Web Application Engineering COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 11 (Part II) http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411

More information

Jobsket ATS. Empowering your recruitment process

Jobsket ATS. Empowering your recruitment process Jobsket ATS Empowering your recruitment process WELCOME TO JOBSKET ATS Jobsket ATS is a recruitment and talent acquisition software package built on top of innovation. Our software improves recruitment

More information

TechWatch. Technology and Market Observation powered by SMILA

TechWatch. Technology and Market Observation powered by SMILA TechWatch Technology and Market Observation powered by SMILA PD Dr. Günter Neumann DFKI, Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, Juni 2011 Goal - Observation of Innovations and Trends»

More information

Domain Analytics. Jay Daley,.nz Registrar Conference, 2015

Domain Analytics. Jay Daley,.nz Registrar Conference, 2015 Domain Analytics Jay Daley,.nz Registrar Conference, 2015 Domain Analytics Explained Using data science to provide insight into domain name usage Value for registrars understanding customers Value for

More information

Geospatial Semantic Architecture Objectives to Support a Graduate Course on Ontology and Semantics

Geospatial Semantic Architecture Objectives to Support a Graduate Course on Ontology and Semantics Geospatial Semantic Architecture Objectives to Support a Graduate Course on Ontology and Semantics Dalia Varanka, Adjunct Professor Johns Hopkins University, Advanced Academic Programs October 29, 2013

More information

Deposit Identification Utility and Visualization Tool

Deposit Identification Utility and Visualization Tool Deposit Identification Utility and Visualization Tool Colorado School of Mines Field Session Summer 2014 David Alexander Jeremy Kerr Luke McPherson Introduction Newmont Mining Corporation was founded in

More information

An ontology-based approach for semantic ranking of the web search engines results

An ontology-based approach for semantic ranking of the web search engines results An ontology-based approach for semantic ranking of the web search engines results Editor(s): Name Surname, University, Country Solicited review(s): Name Surname, University, Country Open review(s): Name

More information

IT services for analyses of various data samples

IT services for analyses of various data samples IT services for analyses of various data samples Ján Paralič, František Babič, Martin Sarnovský, Peter Butka, Cecília Havrilová, Miroslava Muchová, Michal Puheim, Martin Mikula, Gabriel Tutoky Technical

More information

Big Data to Decision. Thomas E. Potok, PhD Group Leader Computational Data Analytics Group Oak Ridge National Laboratory

Big Data to Decision. Thomas E. Potok, PhD Group Leader Computational Data Analytics Group Oak Ridge National Laboratory Big Data to Decision Thomas E. Potok, PhD Group Leader Computational Data Analytics Group Oak Ridge National Laboratory Computational Data Analytics Group Research 10 years in data mining and machine learning

More information

Some Research Challenges for Big Data Analytics of Intelligent Security

Some Research Challenges for Big Data Analytics of Intelligent Security Some Research Challenges for Big Data Analytics of Intelligent Security Yuh-Jong Hu hu at cs.nccu.edu.tw Emerging Network Technology (ENT) Lab. Department of Computer Science National Chengchi University,

More information

Large-Scale Data Sets Clustering Based on MapReduce and Hadoop

Large-Scale Data Sets Clustering Based on MapReduce and Hadoop Journal of Computational Information Systems 7: 16 (2011) 5956-5963 Available at http://www.jofcis.com Large-Scale Data Sets Clustering Based on MapReduce and Hadoop Ping ZHOU, Jingsheng LEI, Wenjun YE

More information

Artificial Intelligence and Robotics @ Politecnico di Milano. Presented by Matteo Matteucci

Artificial Intelligence and Robotics @ Politecnico di Milano. Presented by Matteo Matteucci 1 Artificial Intelligence and Robotics @ Politecnico di Milano Presented by Matteo Matteucci What is Artificial Intelligence «The field of theory & development of computer systems able to perform tasks

More information

The Scientific Data Mining Process

The Scientific Data Mining Process Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In

More information

Provider-Independent Social Identity. Management for Personal and. Professional Applications

Provider-Independent Social Identity. Management for Personal and. Professional Applications Provider-Independent Social Identity Management for Personal and Professional Applications Dissertation zur Erlangung des Grades eines Doktors der Wirtschaftswissenschaften eingereicht an der Fakultät

More information

Term extraction for user profiling: evaluation by the user

Term extraction for user profiling: evaluation by the user Term extraction for user profiling: evaluation by the user Suzan Verberne 1, Maya Sappelli 1,2, Wessel Kraaij 1,2 1 Institute for Computing and Information Sciences, Radboud University Nijmegen 2 TNO,

More information

Big Data and Semantic Web in Manufacturing. Nitesh Khilwani, PhD Chief Engineer, Samsung Research Institute Noida, India

Big Data and Semantic Web in Manufacturing. Nitesh Khilwani, PhD Chief Engineer, Samsung Research Institute Noida, India Big Data and Semantic Web in Manufacturing Nitesh Khilwani, PhD Chief Engineer, Samsung Research Institute Noida, India Outline Big data in Manufacturing Big data Analytics Semantic web technologies Case

More information

. g .,, . . , Applicability of

More information

Network Big Data: Facing and Tackling the Complexities Xiaolong Jin

Network Big Data: Facing and Tackling the Complexities Xiaolong Jin Network Big Data: Facing and Tackling the Complexities Xiaolong Jin CAS Key Laboratory of Network Data Science & Technology Institute of Computing Technology Chinese Academy of Sciences (CAS) 2015-08-10

More information

Big Data and Analytics: Challenges and Opportunities

Big Data and Analytics: Challenges and Opportunities Big Data and Analytics: Challenges and Opportunities Dr. Amin Beheshti Lecturer and Senior Research Associate University of New South Wales, Australia (Service Oriented Computing Group, CSE) Talk: Sharif

More information

Big Data Collection Study for Providing Efficient Information

Big Data Collection Study for Providing Efficient Information , pp. 41-50 http://dx.doi.org/10.14257/ijseia.2015.9.12.03 Big Data Collection Study for Providing Efficient Information Jun-soo Yun, Jin-tae Park, Hyun-seo Hwang and Il-young Moon Computer Science and

More information

Search Engines. Stephen Shaw 18th of February, 2014. Netsoc

Search Engines. Stephen Shaw <stesh@netsoc.tcd.ie> 18th of February, 2014. Netsoc Search Engines Stephen Shaw Netsoc 18th of February, 2014 Me M.Sc. Artificial Intelligence, University of Edinburgh Would recommend B.A. (Mod.) Computer Science, Linguistics, French,

More information

New Web tool to create educational and adaptive courses in an E-Learning platform based fusion of Web resources

New Web tool to create educational and adaptive courses in an E-Learning platform based fusion of Web resources New Web tool to create educational and adaptive courses in an E-Learning platform based fusion of Web resources Mohammed Chaoui 1, Mohamed Tayeb Laskri 2 1,2 Badji Mokhtar University Annaba, Algeria 1

More information

Attribution. Modified from Stuart Russell s slides (Berkeley) Parts of the slides are inspired by Dan Klein s lecture material for CS 188 (Berkeley)

Attribution. Modified from Stuart Russell s slides (Berkeley) Parts of the slides are inspired by Dan Klein s lecture material for CS 188 (Berkeley) Machine Learning 1 Attribution Modified from Stuart Russell s slides (Berkeley) Parts of the slides are inspired by Dan Klein s lecture material for CS 188 (Berkeley) 2 Outline Inductive learning Decision

More information

Big Data & Security. Aljosa Pasic 12/02/2015

Big Data & Security. Aljosa Pasic 12/02/2015 Big Data & Security Aljosa Pasic 12/02/2015 Welcome to Madrid!!! Big Data AND security: what is there on our minds? Big Data tools and technologies Big Data T&T chain and security/privacy concern mappings

More information

Cloud Computing and the Future of Internet Services. Wei-Ying Ma Principal Researcher, Research Area Manager Microsoft Research Asia

Cloud Computing and the Future of Internet Services. Wei-Ying Ma Principal Researcher, Research Area Manager Microsoft Research Asia Cloud Computing and the Future of Internet Services Wei-Ying Ma Principal Researcher, Research Area Manager Microsoft Research Asia Computing as Utility Grid Computing Web Services in the Cloud What is

More information

Utilizing Social Media Data for Enhancing Decision Making during Emergencies

Utilizing Social Media Data for Enhancing Decision Making during Emergencies Utilizing Social Media Data for Enhancing Decision Making during Emergencies Ioannis Kotsiopoulos European Dynamics S.A., Marousi, Greece ioannis.kotsiopoulos@eurodyn.com Lemi Baruh College of Social Sciences

More information

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 5, Sep-Oct 2015

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 5, Sep-Oct 2015 RESEARCH ARTICLE Multi Document Utility Presentation Using Sentiment Analysis Mayur S. Dhote [1], Prof. S. S. Sonawane [2] Department of Computer Science and Engineering PICT, Savitribai Phule Pune University

More information

Finding Advertising Keywords on Web Pages. Contextual Ads 101

Finding Advertising Keywords on Web Pages. Contextual Ads 101 Finding Advertising Keywords on Web Pages Scott Wen-tau Yih Joshua Goodman Microsoft Research Vitor R. Carvalho Carnegie Mellon University Contextual Ads 101 Publisher s website Digital Camera Review The

More information

IMAV: An Intelligent Multi-Agent Model Based on Cloud Computing for Resource Virtualization

IMAV: An Intelligent Multi-Agent Model Based on Cloud Computing for Resource Virtualization 2011 International Conference on Information and Electronics Engineering IPCSIT vol.6 (2011) (2011) IACSIT Press, Singapore IMAV: An Intelligent Multi-Agent Model Based on Cloud Computing for Resource

More information

Industry 4.0 and Big Data

Industry 4.0 and Big Data Industry 4.0 and Big Data Marek Obitko, mobitko@ra.rockwell.com Senior Research Engineer 03/25/2015 PUBLIC PUBLIC - 5058-CO900H 2 Background Joint work with Czech Institute of Informatics, Robotics and

More information

iservdb The database closest to you IDEAS Institute

iservdb The database closest to you IDEAS Institute iservdb The database closest to you IDEAS Institute 1 Overview 2 Long-term Anticipation iservdb is a relational database SQL compliance and a general purpose database Data is reliable and consistency iservdb

More information

Assessing Data Mining: The State of the Practice

Assessing Data Mining: The State of the Practice Assessing Data Mining: The State of the Practice 2003 Herbert A. Edelstein Two Crows Corporation 10500 Falls Road Potomac, Maryland 20854 www.twocrows.com (301) 983-3555 Objectives Separate myth from reality

More information

Oracle Big Data Spatial & Graph Social Network Analysis - Case Study

Oracle Big Data Spatial & Graph Social Network Analysis - Case Study Oracle Big Data Spatial & Graph Social Network Analysis - Case Study Mark Rittman, CTO, Rittman Mead OTN EMEA Tour, May 2016 info@rittmanmead.com www.rittmanmead.com @rittmanmead About the Speaker Mark

More information

PREDICTING MARKET VOLATILITY FEDERAL RESERVE BOARD MEETING MINUTES FROM

PREDICTING MARKET VOLATILITY FEDERAL RESERVE BOARD MEETING MINUTES FROM PREDICTING MARKET VOLATILITY FROM FEDERAL RESERVE BOARD MEETING MINUTES Reza Bosagh Zadeh and Andreas Zollmann Lab Advisers: Noah Smith and Bryan Routledge GOALS Make Money! Not really. Find interesting

More information

WEGOV ANALYSIS TOOLS TO CONNECT POLICY MAKERS WITH CITIZENS ONLINE

WEGOV ANALYSIS TOOLS TO CONNECT POLICY MAKERS WITH CITIZENS ONLINE WEGOV ANALYSIS TOOLS TO CONNECT POLICY MAKERS WITH CITIZENS ONLINE Timo Wandhöfer, GESIS Leibniz Institute for the Social Sciences, Knowledge Technologies for the Social Sciences, Unter Sachsenhausen 6-8,

More information

Finding Negative Key Phrases for Internet Advertising Campaigns using Wikipedia

Finding Negative Key Phrases for Internet Advertising Campaigns using Wikipedia Finding Negative Key Phrases for Internet Advertising Campaigns using Wikipedia Martin Scaiano University of Ottawa mscai056@uottawa.ca Diana Inkpen University of Ottawa diana@site.uottawa.com Abstract

More information

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage If every image made and every word written from the earliest stirring of civilization

More information

Clustering Technique in Data Mining for Text Documents

Clustering Technique in Data Mining for Text Documents Clustering Technique in Data Mining for Text Documents Ms.J.Sathya Priya Assistant Professor Dept Of Information Technology. Velammal Engineering College. Chennai. Ms.S.Priyadharshini Assistant Professor

More information

The key to knowing the best price is to fully understand consumer behavior.

The key to knowing the best price is to fully understand consumer behavior. A price optimization tool designed for small to mid-size companies to optimize infrastructure and determine the perfect price point per item in any given week DEBORAH WEINSWIG Executive Director- Head,

More information

Customer Relationship Management using Adaptive Resonance Theory

Customer Relationship Management using Adaptive Resonance Theory Customer Relationship Management using Adaptive Resonance Theory Manjari Anand M.Tech.Scholar Zubair Khan Associate Professor Ravi S. Shukla Associate Professor ABSTRACT CRM is a kind of implemented model

More information

Big Data Analytics and Healthcare

Big Data Analytics and Healthcare Big Data Analytics and Healthcare Anup Kumar, Professor and Director of MINDS Lab Computer Engineering and Computer Science Department University of Louisville Road Map Introduction Data Sources Structured

More information

CAS CS 565, Data Mining

CAS CS 565, Data Mining CAS CS 565, Data Mining Course logistics Course webpage: http://www.cs.bu.edu/~evimaria/cs565-10.html Schedule: Mon Wed, 4-5:30 Instructor: Evimaria Terzi, evimaria@cs.bu.edu Office hours: Mon 2:30-4pm,

More information

Computer Programming for the Social Sciences

Computer Programming for the Social Sciences Department of Social and Political Sciences Computer Programming for the Social Sciences This two day workshop will teach beginner level, practical computer programming skills for use in social science

More information

Enhancing the relativity between Content, Title and Meta Tags Based on Term Frequency in Lexical and Semantic Aspects

Enhancing the relativity between Content, Title and Meta Tags Based on Term Frequency in Lexical and Semantic Aspects Enhancing the relativity between Content, Title and Meta Tags Based on Term Frequency in Lexical and Semantic Aspects Mohammad Farahmand, Abu Bakar MD Sultan, Masrah Azrifah Azmi Murad, Fatimah Sidi me@shahroozfarahmand.com

More information

bigdata Managing Scale in Ontological Systems

bigdata Managing Scale in Ontological Systems Managing Scale in Ontological Systems 1 This presentation offers a brief look scale in ontological (semantic) systems, tradeoffs in expressivity and data scale, and both information and systems architectural

More information

Wikipedia and Web document based Query Translation and Expansion for Cross-language IR

Wikipedia and Web document based Query Translation and Expansion for Cross-language IR Wikipedia and Web document based Query Translation and Expansion for Cross-language IR Ling-Xiang Tang 1, Andrew Trotman 2, Shlomo Geva 1, Yue Xu 1 1Faculty of Science and Technology, Queensland University

More information

Ontology Summit 2014 Session 05 Track D: Tackling the Variety Problem in Big Data I

Ontology Summit 2014 Session 05 Track D: Tackling the Variety Problem in Big Data I Ontology Summit 2014 Session 05 Track D: Tackling the Variety Problem in Big Data I Ken Baclawski Anne Thessen Track D Co-Champions February 13, 2014 1 Session Outline Ken Baclawski - Introduction Eric

More information

Distributed Computing and Big Data: Hadoop and MapReduce

Distributed Computing and Big Data: Hadoop and MapReduce Distributed Computing and Big Data: Hadoop and MapReduce Bill Keenan, Director Terry Heinze, Architect Thomson Reuters Research & Development Agenda R&D Overview Hadoop and MapReduce Overview Use Case:

More information

Crowdsourcing in Enterprise Environments

Crowdsourcing in Enterprise Environments Crowdsourcing in Enterprise Environments Dr. ir. Alessandro Bozzon Delft University of Technology Web Information Systems Delft Social Data Science Lab Kick-off KIVI Leerstoel Big Data Science Den Haag

More information

Research on News Video Multi-topic Extraction and Summarization

Research on News Video Multi-topic Extraction and Summarization International Journal of New Technology and Research (IJNTR) ISSN:2454-4116, Volume-2, Issue-3, March 2016 Pages 37-39 Research on News Video Multi-topic Extraction and Summarization Di Li, Hua Huo Abstract

More information

Statistics for BIG data

Statistics for BIG data Statistics for BIG data Statistics for Big Data: Are Statisticians Ready? Dennis Lin Department of Statistics The Pennsylvania State University John Jordan and Dennis K.J. Lin (ICSA-Bulletine 2014) Before

More information

HEALTH INFORMATION MANAGEMENT ON SEMANTIC WEB :(SEMANTIC HIM)

HEALTH INFORMATION MANAGEMENT ON SEMANTIC WEB :(SEMANTIC HIM) HEALTH INFORMATION MANAGEMENT ON SEMANTIC WEB :(SEMANTIC HIM) Nasim Khozoie Department of Computer Engineering,yasuj branch, Islamic Azad University, yasuj, Iran n_khozooyi2003@yahoo.com ABSTRACT Information

More information

PSG College of Technology, Coimbatore-641 004 Department of Computer & Information Sciences BSc (CT) G1 & G2 Sixth Semester PROJECT DETAILS.

PSG College of Technology, Coimbatore-641 004 Department of Computer & Information Sciences BSc (CT) G1 & G2 Sixth Semester PROJECT DETAILS. PSG College of Technology, Coimbatore-641 004 Department of Computer & Information Sciences BSc (CT) G1 & G2 Sixth Semester PROJECT DETAILS Project Project Title Area of Abstract No Specialization 1. Software

More information

Ontology Summit 2014 Track D: Tackling the Variety Problem in Big Data Summary

Ontology Summit 2014 Track D: Tackling the Variety Problem in Big Data Summary Ontology Summit 2014 Track D: Tackling the Variety Problem in Big Data Summary Ken Baclawski Anne Thessen Track D Co-Champions April 28, 2014 1 The Potential of Big Data Could address important social

More information

Mining event log patterns in HPC systems

Mining event log patterns in HPC systems Mining event log patterns in HPC systems Ana Gainaru joint work with Franck Cappello and Bill Kramer HPC Resilience Summit 2010: Workshop on Resilience for Exascale HPC HPC Resilience Third Workshop Summit

More information

Data, Data Everywhere

Data, Data Everywhere Dr. Willa Pickering Lockheed Martin enior Fellow March 2012 Data, Data Everywhere Big Data what is it Protecting Data in Cloud how do we handle it Data Analysis are we prepared to use it Willa Pickering

More information

Recommender Systems: Content-based, Knowledge-based, Hybrid. Radek Pelánek

Recommender Systems: Content-based, Knowledge-based, Hybrid. Radek Pelánek Recommender Systems: Content-based, Knowledge-based, Hybrid Radek Pelánek 2015 Today lecture, basic principles: content-based knowledge-based hybrid, choice of approach,... critiquing, explanations,...

More information

Maximize Revenues on your Customer Loyalty Program using Predictive Analytics

Maximize Revenues on your Customer Loyalty Program using Predictive Analytics Maximize Revenues on your Customer Loyalty Program using Predictive Analytics 27 th Feb 14 Free Webinar by Before we begin... www Q & A? Your Speakers @parikh_shachi Technical Analyst @tatvic Loves js

More information

A Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks

A Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks A Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks Text Analytics World, Boston, 2013 Lars Hard, CTO Agenda Difficult text analytics tasks Feature extraction Bio-inspired

More information

Semantic Search in E-Discovery. David Graus & Zhaochun Ren

Semantic Search in E-Discovery. David Graus & Zhaochun Ren Semantic Search in E-Discovery David Graus & Zhaochun Ren This talk Introduction David Graus! Understanding e-mail traffic David Graus! Topic discovery & tracking in social media Zhaochun Ren 2 Intro Semantic

More information

SEMANTICS ENABLED PROACTIVE AND TARGETED DISSEMINATION OF NEW MEDICAL KNOWLEDGE

SEMANTICS ENABLED PROACTIVE AND TARGETED DISSEMINATION OF NEW MEDICAL KNOWLEDGE SEMANTICS ENABLED PROACTIVE AND TARGETED DISSEMINATION OF NEW MEDICAL KNOWLEDGE Lakshmish Ramaswamy & I. Budak Arpinar Dept. of Computer Science, University of Georgia laks@cs.uga.edu, budak@cs.uga.edu

More information

Supervised Learning Evaluation (via Sentiment Analysis)!

Supervised Learning Evaluation (via Sentiment Analysis)! Supervised Learning Evaluation (via Sentiment Analysis)! Why Analyze Sentiment? Sentiment Analysis (Opinion Mining) Automatically label documents with their sentiment Toward a topic Aggregated over documents

More information

Exploring People in Social Networking Sites: A Comprehensive Analysis of Social Networking Sites

Exploring People in Social Networking Sites: A Comprehensive Analysis of Social Networking Sites Exploring People in Social Networking Sites: A Comprehensive Analysis of Social Networking Sites Abstract Saleh Albelwi Ph.D Candidate in Computer Science School of Engineering University of Bridgeport

More information

FUZZY CLUSTERING ANALYSIS OF DATA MINING: APPLICATION TO AN ACCIDENT MINING SYSTEM

FUZZY CLUSTERING ANALYSIS OF DATA MINING: APPLICATION TO AN ACCIDENT MINING SYSTEM International Journal of Innovative Computing, Information and Control ICIC International c 0 ISSN 34-48 Volume 8, Number 8, August 0 pp. 4 FUZZY CLUSTERING ANALYSIS OF DATA MINING: APPLICATION TO AN ACCIDENT

More information

USING COMPLEX EVENT PROCESSING TO MANAGE PATTERNS IN DISTRIBUTION NETWORKS

USING COMPLEX EVENT PROCESSING TO MANAGE PATTERNS IN DISTRIBUTION NETWORKS USING COMPLEX EVENT PROCESSING TO MANAGE PATTERNS IN DISTRIBUTION NETWORKS Foued BAROUNI Eaton Canada FouedBarouni@eaton.com Bernard MOULIN Laval University Canada Bernard.Moulin@ift.ulaval.ca ABSTRACT

More information

PerCuro-A Semantic Approach to Drug Discovery. Final Project Report submitted by Meenakshi Nagarajan Karthik Gomadam Hongyu Yang

PerCuro-A Semantic Approach to Drug Discovery. Final Project Report submitted by Meenakshi Nagarajan Karthik Gomadam Hongyu Yang PerCuro-A Semantic Approach to Drug Discovery Final Project Report submitted by Meenakshi Nagarajan Karthik Gomadam Hongyu Yang Towards the fulfillment of the course Semantic Web CSCI 8350 Fall 2003 Under

More information

Search Engine Optimisation Managed Service

Search Engine Optimisation Managed Service Search Engine Optimisation Managed Service SEO Managed Service Search Engine Optimisation Managed Service Every day over 350 million searches are performed across the internet so it s imperative that your

More information

Security Issues for the Semantic Web

Security Issues for the Semantic Web Security Issues for the Semantic Web Dr. Bhavani Thuraisingham Program Director Data and Applications Security The National Science Foundation Arlington, VA On leave from The MITRE Corporation Bedford,

More information

Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project

Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project Ahmet Suerdem Istanbul Bilgi University; LSE Methodology Dept. Science in the media project is funded

More information

Incorporating Window-Based Passage-Level Evidence in Document Retrieval

Incorporating Window-Based Passage-Level Evidence in Document Retrieval Incorporating -Based Passage-Level Evidence in Document Retrieval Wensi Xi, Richard Xu-Rong, Christopher S.G. Khoo Center for Advanced Information Systems School of Applied Science Nanyang Technological

More information

Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia

Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia As of today, the issue of Big Data processing is still of high importance. Data flow is increasingly growing. Processing methods

More information

Profit from Big Data flow. Hospital Revenue Leakage: Minimizing missing charges in hospital systems

Profit from Big Data flow. Hospital Revenue Leakage: Minimizing missing charges in hospital systems Profit from Big Data flow Hospital Revenue Leakage: Minimizing missing charges in hospital systems Hospital Revenue Leakage White Paper 2 Tapping the hidden assets in hospitals data Missed charges on patient

More information

A.I. Tech Company profile A.I. Tech designs and develops intelligent audio and video analysis systems; We help operators to identify and give a meanin

A.I. Tech Company profile A.I. Tech designs and develops intelligent audio and video analysis systems; We help operators to identify and give a meanin EUCISE 2020 Industry Day Brussels 23.Sept.2015 Pierluigi Ritrovato A.I. Tech Artificial Intelligence Tech Technologies nologies and Solutions A spinspin-off company of the University of Salerno The Vision

More information

KNOWLEDGENT WHITE PAPER. Big Data Enabling Better Pharmacovigilance

KNOWLEDGENT WHITE PAPER. Big Data Enabling Better Pharmacovigilance Big Data Enabling Better Pharmacovigilance INTRODUCTION Biopharmaceutical companies are seeing a surge in the amount of data generated and made available to identify better targets, better design clinical

More information

Intelligent Tools For A Productive Radiologist Workflow: How Machine Learning Enriches Hanging Protocols

Intelligent Tools For A Productive Radiologist Workflow: How Machine Learning Enriches Hanging Protocols GE Healthcare Intelligent Tools For A Productive Radiologist Workflow: How Machine Learning Enriches Hanging Protocols Authors: Tianyi Wang Information Scientist Machine Learning Lab Software Science &

More information

Lead Generation Lessons From 4,000 Businesses. study based on real data from 4,000 businesses worldwide

Lead Generation Lessons From 4,000 Businesses. study based on real data from 4,000 businesses worldwide Lead Generation Lessons From 4,000 Businesses A study based on real data from 4,000 businesses worldwide Real Data from 4,000 Businesses This study is based on data from HubSpot s 4,000 customers. We analyzed

More information

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot www.etidaho.com (208) 327-0768 Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot 3 Days About this Course This course is designed for the end users and analysts that

More information

Qi Liu Rutgers Business School ISACA New York 2013

Qi Liu Rutgers Business School ISACA New York 2013 Qi Liu Rutgers Business School ISACA New York 2013 1 What is Audit Analytics The use of data analysis technology in Auditing. Audit analytics is the process of identifying, gathering, validating, analyzing,

More information

Sensors talk and humans sense Part II

Sensors talk and humans sense Part II Sensors talk and humans sense Part II Athena Vakali Palic, 6 th September 2013 OSWINDS group Department of Informatics Aristotle University of Thessaloniki http://oswinds.csd.auth.gr SEN2SOC Architecture

More information

THE SEMANTIC WEB AND IT`S APPLICATIONS

THE SEMANTIC WEB AND IT`S APPLICATIONS 15-16 September 2011, BULGARIA 1 Proceedings of the International Conference on Information Technologies (InfoTech-2011) 15-16 September 2011, Bulgaria THE SEMANTIC WEB AND IT`S APPLICATIONS Dimitar Vuldzhev

More information

Safewhere*Identify 3.4. Release Notes

Safewhere*Identify 3.4. Release Notes Safewhere*Identify 3.4 Release Notes Safewhere*identify is a new kind of user identification and administration service providing for externalized and seamless authentication and authorization across organizations.

More information

Enabling Self Organising Logistics on the Web of Things

Enabling Self Organising Logistics on the Web of Things Enabling Self Organising Logistics on the Web of Things Monika Solanki, Laura Daniele, Christopher Brewster Aston Business School, Aston University, Birmingham, UK TNO Netherlands Organization for Applied

More information

Chapter 7. Using Hadoop Cluster and MapReduce

Chapter 7. Using Hadoop Cluster and MapReduce Chapter 7 Using Hadoop Cluster and MapReduce Modeling and Prototyping of RMS for QoS Oriented Grid Page 152 7. Using Hadoop Cluster and MapReduce for Big Data Problems The size of the databases used in

More information

Table of Contents. Chapter No. 1 Introduction 1. iii. xiv. xviii. xix. Page No.

Table of Contents. Chapter No. 1 Introduction 1. iii. xiv. xviii. xix. Page No. Table of Contents Title Declaration by the Candidate Certificate of Supervisor Acknowledgement Abstract List of Figures List of Tables List of Abbreviations Chapter Chapter No. 1 Introduction 1 ii iii

More information

Towards Effective Recommendation of Social Data across Social Networking Sites

Towards Effective Recommendation of Social Data across Social Networking Sites Towards Effective Recommendation of Social Data across Social Networking Sites Yuan Wang 1,JieZhang 2, and Julita Vassileva 1 1 Department of Computer Science, University of Saskatchewan, Canada {yuw193,jiv}@cs.usask.ca

More information

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data

More information

Design and Development of Electronic Prescription and Patient Information Systems for Developing World By

Design and Development of Electronic Prescription and Patient Information Systems for Developing World By Design and Development of Electronic Prescription and Patient Information Systems for Developing World By Dr Boniface Ekechukwu* and Chidi Obi **Dr Arinze Nweze* *Department of Computer Science, Nnamdi

More information

Semantic Web in 10 years: Semantics with a purpose

Semantic Web in 10 years: Semantics with a purpose Semantic Web in 10 years: Semantics with a purpose [Position paper for the ISWC2012 Workshop on What will the Semantic Web look like 10 years from now? ] Marko Grobelnik, Dunja Mladenić, Blaž Fortuna J.

More information

Ontology based ranking of documents using Graph Databases: a Big Data Approach

Ontology based ranking of documents using Graph Databases: a Big Data Approach Ontology based ranking of documents using Graph Databases: a Big Data Approach A.M.Abirami Dept. of Information Technology Thiagarajar College of Engineering Madurai, Tamil Nadu, India Dr.A.Askarunisa

More information

Global Harmonization Through Collaboration. The Luminary System. Vendor Brief

Global Harmonization Through Collaboration. The Luminary System. Vendor Brief Global Harmonization Through Collaboration The Luminary System Vendor Brief Presented By: Edward Swing Date: August 28, 2012 Luminary is Entity & Concept Extraction from unstructured text with Verification

More information

Big Data Big Privacy. Setting the scene. Big Data; Big Privacy 29 April 2013 Privacy Awareness Week 2013 Launch.

Big Data Big Privacy. Setting the scene. Big Data; Big Privacy 29 April 2013 Privacy Awareness Week 2013 Launch. Big Data Big Privacy Privacy Awareness Week SPEAKING NOTES Stephen Wilson Lockstep Group Setting the scene Practical experience shows a gap in the understanding that technologists as a class have regarding

More information

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 Yannis Stavrakas Vassilis Plachouras IMIS / RC ATHENA Athens, Greece {yannis, vplachouras}@imis.athena-innovation.gr Abstract.

More information

Deep learning applications and challenges in big data analytics

Deep learning applications and challenges in big data analytics Najafabadi et al. Journal of Big Data (2015) 2:1 DOI 10.1186/s40537-014-0007-7 RESEARCH Open Access Deep learning applications and challenges in big data analytics Maryam M Najafabadi 1, Flavio Villanustre

More information