Watson in Space: Advanced Decision Support Systems for NASA exploiting IBM's Deep QA Analytics
|
|
- April Williams
- 7 years ago
- Views:
Transcription
1 Watson in Space: Advanced Decision Support Systems for NASA exploiting IBM's Deep QA Analytics Paul Giangarra IBM Distinguished Engineer This work has been done in collaboration with Doug Stanley (NIA Vice-President of Research and Program Development)
2 Agenda Motivation and Definitions Systems of Systems FDIR (and ADIR) Decision Support Systems (structured and unstructured) Building on Record, Retrieve, Analyze Pattern COTS based plug and play LCS IBM s Watson technologies Bringing it all together to build Advanced Decision Support Systems 2
3 Systems of Systems Most new spacecraft are Systems of Systems Often the systems are built by different vendors Integration is usually done by the prime vendor (or NASA) Assertion A large unsolved problem is how to do complete Anomaly/Failure Isolation in large complex Systems of Systems 3
4 A Short History Diversion On July 20, 1969, Neil Armstrong and Buzz Aldrin had entered the Lunar Module they named 'Eagle' and were descending to the surface. They were about 6,000 feet above the surface and the descent engine was halfway through its final 12 minute burn that would land them safely on the moon, when a yellow caution light lit up on the computer control panel. It was a 1202 error, indicating a memory overload, and the astronauts asked Mission Control for instructions. M.I.T. engineer, George Silver, who was usually at the office at Cape Kennedy. George had been involved in and witnessed many pre flight tests. I asked him in frustration if he had ever seen the Apollo Guidance Computer run slowly and under what conditions. To my surprise and rather matter of fact, he said he had. He called it "cycle stealing" and he said it can occur when the I/O system keeps looking for data. He had seen it when the Rendezvous Radar Switch was on (in the AUTO position) and the computer was looking for radar data. He asked "the Switch isn't on, is it?" "Why would it be on for Descent, it's meant for Ascent?" 4
5 Background: Operations and Why the Problem Gets Harder Mission Duration: Near Earth Objects Cruise time: 90 days Mission durations: ~ 6 months Communication delay: minutes Communications blackouts: zero (assuming you pay for DSN coverage) Mission Duration: Mars Cruise time: 9 months Mission durations: ~ 3 years Communications delay: 6 minutes to 50 minutes Communications blackouts: weeks at a time every 780 days From the NASA Exploration Technology Development Program Automation for Operations (A4O) Transition Review 5
6 Background: Operations Mission Operations State of practice : Many tools, tools often modified, new tools must be added, lack of tool interoperability Need: Flexible, evolvable and sustainable mission operations tools Crewed Spacecraft Operations State of practice : Crew relies on ground to support and control operations Time delays reduce crew flexibility and efficiency Need: Crews able to operate systems more independently Uncrewed Spacecraft Operations State of practice: Requires direct human command and monitoring Time delays reduce flexibility and efficiency, large staff requirements Need: Safe, efficient and effective uncrewed operations From the NASA Exploration Technology Development Program Automation for Operations (A4O) Transition Review
7 The Core Pattern: A/F DIR (Anomaly/Failure Detection, Isolation, Recovery) Fully autonomous A/FDIR is at the core of fully autonomous operations A/F Detection is fairly well understood and generally performed by computers A/F Isolation is still not fully autonomous, there are many cases where we fall back to documentation, human memory, and other unstructured information A/F Recovery is only attainable after A/F Isolation is correct When we can fully automate A/FDIR we will have built HAL 7
8 A/FDIR Detection Houston we have a problem how often have we heard that? Detection can be at the sub system level or system of systems level Detection can be performed by: Hardware Software Programming (totally usually C/C++, Java, and assembler) Complex Event Detection via rules based Middleware (used for detecting problems with state and often over a long duration ) Information streaming and analysis platforms (used for detecting problems with little state and one or more high volume input streams Critical aspect of A/FD: Detection involves determining when something needs to be done, not what to do 8
9 A/FDIR Isolation Isolation is the toughest problem When humans are in the loop they need decision support Without humans computers have to attempt to do it alone Isolation can be at the sub system level or system of systems level however Often a problem with a subsystem is not indicative of the full problem Recovery actions must understand the effect on the system of systems Can often have significant time constraints Can involve understanding both structured and unstructured information 9
10 A/FDIR Isolation (2) Isolation can be performed by: Hardware (e.g. PLMs) Software Programming (totally usually C/C++, Java, and assembler) Rules based Middleware (used for decision support, single state in, single response out, however it can involve a hierarchical decision process) When all else fails RTxM (Read The [pick your word] Manual) Critical aspect of A/FD: Detection involves determining what to do based on facts collected by A/FD and other data available to the Decision Support System 10
11 A/FDIR Recovery The ultimate goal, recover from the A/F detected, gets more complex when humans are involved When humans are in the loop they need decision support systems to provide good advice for recovery alternatives, but recovery is often executed by the humans Without humans involved computers have to attempt to do it alone Computers may also need to attempt recovery when they are confident they know the solution (what) and there is not enough time for humans to respond (e.g. time critical problems) Recovery can be at the sub system level or system of systems level however Recovery actions must understand the effect on the system of systems Can often have significant time constraints Can be pre substantiated by techniques such as predictive analytics 11
12 A/FDIR Technological View A/F Detection tells you when you need to do something Technologies involved include streaming analytics, event correlation, complex event processing, record and retrieve A/F Isolation tells you what happened Technologies involved include finite state machines, rules based decision making tools, descriptive analytics, Deep QA with Natural Language Processing A/F Recovery tells you what to do next Technologies involved include predictive and prescriptive analytics Detect Decide Act 12
13 Advanced Decision Support Systems Involve Operational Decision Management Focuses on the automation and governance of frequently occurring, repeatable decisions that control critical business systems Analytical Decision Management Focuses on the development and deployment of decision services bringing intelligence and predictive insight into repeatable decisions while maximizing outcomes Enabled by: Business Rule Management with Business Event Processing Decision Management Enhanced by: Predictive Analytics with Optimization Deep QA. Closely integrated with: Analytical Decision Management Business Process Management Closely integrated with: Operational Decision Management Business Intelligence 13
14 Structured Decision Support Structured Decision Support: Can reliably be fully automated Code, state machine steps Rules Supported by modeling (predictive and prescriptive) Structured decision support can provide recommendations and decisions, as well as providing impact and quality analytics of each in a set of possible courses of action Utilize unstructured decision support for additional information. Possibly compare results of unstructured support to results from structured decision results. Know when unstructured decision support needs to be invoked (when all else fails..)
15 Unstructured Decision Support Unstructured Decision Support: Can consume, process, and interpret problem descriptions in addition to the structured input available Utilize advanced NLP (Natural Language Processing) techniques to understand unstructured information Will utilize known considerations and conclusions in the decision Can ingest, understand, and exploit more types of data Can quickly and efficiently utilize a large corpus of unstructured information Can analyze the original questions and take the users through a dialogue of follow up questions before providing a final set of suggested answers 1
16 NASA 21st Century Launch Complex PoC Photos taken by Paul Giangarra
17 Record, Retrieve, Analyze, & Visualize Pattern Decision Support Systems Reports developed by SMEs Visualization and Drill Down Rules developed by SMEs Analytics Framework Real-time Enterprise Service Bus Inform/Act Data Persistence The Core Pattern Sensors COTS Developed on COTS existing 19
18 The Value to NASA Computer Scientists can focus on what they do best Architect, install, configure and run the infrastructure Develop the needed missing parts (not available in the COTS components) Other Scientists and Engineers can focus on what they do best (and build the rules and visual components based on the COTS tools provided in the solution) COTS based infrastructure is usually easier to build, run, and maintain, especially if chosen components are designed for industrial strength environments The COTS based products chosen are designed with built in scalability, reliability, business continuity, and more Rules are easier to produce than code, less error prone, and more flexible Faster turnaround of extensions, changes, modifications
19 An IBM Grand Challenge Build a system that rivals a human s ability to answer questions posed in natural language with speed, accuracy and confidence 28
20 Grand Challenges Advance the Science of Computing Chess: Deep Blue 1997 Limited number of moves and states Explicit, unambiguous mathematical rules Human Language: Watson 2011 Ambiguous, contextual and implicit Grounded in human understanding Infinite expressions with same meaning 29
21 Jeopardy! Questions covers a broad range of topics History, literature, politics, arts, science etc Fast responses, with accuracy and confidence Word plays, subtle meaning, ironies, riddles 3
22 Technical Challenges Massive data volumes and collection rates Stresses scaling limits of current systems ingest, storage Degrades accessibility, awareness, timely use Unstructured nature precludes using traditional data discovery and exploration Adding structure during ingestion at high speed Possibly degraded, obfuscated, fragmented Relevance determination to avoid information overload Method of specifying, defining Improve with experience Analyst and mission are at the center Leverage, amplify human analyst experience, insight Augment or replace those tasks better done algorithmically System as apprentice learns from analyst actions, improves with time
23 WATSON Technology Three pieces of WATSON technology Natural language processing Assembly of information and making it storable Searching and ranking of results from the data searches Understands the questions, takes the set of information that you ve provided it, and ranks the results according to the problem. It is very specific to a problem set. For this presentation, the problem set is extended operations for space exploration.
24 Unstructured data is complex Where was Einstein born? Person Born In A. Einstein Ulm One day, from among his city views of Ulm, Otto chose a watercolor to send to Albert Einstein as a remembrance of Einstein s birthplace. Structured Unstructured 33
25 Some Key Definitions What is Text Analytics? Text Analytics describes a set of linguistic, statistical, and machine learning techniques that allow text to be analyzed and key information extracted for business integration. What is Content Analytics? Content Analytics (Text Analytics + Mining) refers to the text analytics process plus the ability to visually identify and explore trends, patterns, and statistically relevant features found in various types of content spread across various content sources.
26 Watson Took Content Analytics a Huge Step Forward Content Analytics Provides a robust data ingest, search, and visualization capability Sitting on UIMA will handle any unstructured data for which there are annotators to examine, classify, and extract information Primarily driven by the user making decisions about what to look at, where to go next in the analysis DeepQA the Watson technology Also focuses on unstructured data However, represents a breakthrough in AI technology, by answering very open ended questions Evaluates evidence obtained via text analytics to mimic the human thought process
27 How Does IBM Content Analytics Work? Based on Unstructured Information Management Architecture Claimant: Soft Tissue Injury Extracted Concept Person Injury Body Part Location Noun Verb Noun Phrase Prep Phrase John sprained his ankle in the john... Identify Language Tokenization Word Analytics Named Entity Extraction Multi-word Analytics Automatic Classifier Plug-in Custom Analytics Enhanced Metadata Analytics Index Corpus Analyzed Documents with identified concepts Information Sources UIMA Annotators UIMA is an open, industrial-strength, scalable and extensible platform for creating, integrating and deploying unstructured information management solutions from combinations of semantic analysis and search components. Although UIMA originated at IBM, it is now an OASIS industry standard and an Open Source project which is currently incubating at the Apache Software Foundation.
28 Five Dimensions of Complexity Broad/Open Data Domain Complex Language Accuracy Confidence High Precision High Speed EU, The European Union Each year the EU selects capitals of culture; one of the 2010 cities was this Turkish "meeting place of cultures" Istanbul
29 What Computers Find Easier (and Hard) ln((12,546,798 * π) ^ 2) / 34, = Select Payment where Owner= David Jones and Type(Product)= Laptop, Owner David Jones Serial Number AK Invoice # Vendor Payment INV10895 MyBuy $ Serial Number Type Invoice # AK LapTop INV10895 David Jones David Jones = Dave Jones David Jones 39 IBM Confidential
30 The Big Idea Evidence Based Reasoning over Natural Language Content Deep Analysis of clues/questions AND content Search for many possible answers based on different interpretations of question Find, analyze and score EVIDENCE from many different sources (not just one document) for each answer using many advanced NLP and reasoning algorithms Combine evidence and compute a confidence value for each possibility using statistical machine learning Ranks based on confidence And for Jeopardy: If top is above a threshold buzz in else keep quiet
31 Informed Decision Making Decision Maker Has Question Distills to 2 3 Keywords Reads Documents, Finds Answers Finds & Analyzes Evidence Decision Maker Asks NL Question Considers Answer & Evidence Search Engine Finds Documents containing Keywords Delivers Documents based on Popularity Expert Understands Question Produces Possible Answers & Evidence Analyzes Evidence, Computes Confidence Delivers Response, Evidence & Confidence
32 IBM DeepQA and FDIR: How Watson Helps With Failure Isolation FD(IR) A Failure is Detected, Failure Isolation starts with Structured Methods, When they are unsuccessful isolating the failure, a question is generated and passed to Watson Evidence Sources 4 Learned Models help combine and weigh the evidence Models Models Analyze Question / Failure Information Generate Hypotheses Score Hypotheses and Evidence Merge & Rank Final Confidence 5 Answer with Confidence Answer Sources
33 Building an Advance Decision Support System Build on and utilize existing computer based A/F Detection systems Pass all relevant information collected when an Anomaly/Failure is detected to existing and new A/F Isolation Structured Decision Support Systems Use NLP and Deep QA technologies to create a corpus of Knowledge focused on Space Exploration Mission Operations problems Add Unstructured Decision support based on this Corpus when the Structured decisions support needs assistance Build a smaller Unstructured Decision Support system with a smaller (subset) Corpus of Knowledge for crewed vehicles that can deal with questions that need immediate advice in particular situations where the communications latency between the CV and mission control is long
34 45 IBM and NIA Proprietary Information 2011, 2012 IBM Corporation
IBM Watson : Beyond playing Jeopardy!
IBM Watson : Beyond playing Jeopardy! Katharine Frase, VP Industries Research, IBM with thanks to: David Ferrucci, Principal Investigator, DeepQA Team @ IBM Research April 24, 2012 Want to Play Chess or
More informationWATSON. Michael Dundek Industry Architect. Best Student Recognition Event July 6-8, 2011 EMEA IBM Innovation Center La Gaude, France
WATSON Michael Dundek Industry Architect Best Student Recognition Event July 6-8, 2011 EMEA IBM Innovation Center La Gaude, France Want to Play Chess or Just Chat? Chess A finite, mathematically well-defined
More informationMAN VS. MACHINE. How IBM Built a Jeopardy! Champion. 15.071x The Analytics Edge
MAN VS. MACHINE How IBM Built a Jeopardy! Champion 15.071x The Analytics Edge A Grand Challenge In 2004, IBM Vice President Charles Lickel and coworkers were having dinner at a restaurant All of a sudden,
More informationPutting IBM Watson to Work In Healthcare
Martin S. Kohn, MD, MS, FACEP, FACPE Chief Medical Scientist, Care Delivery Systems IBM Research marty.kohn@us.ibm.com Putting IBM Watson to Work In Healthcare 2 SB 1275 Medical data in an electronic or
More informationThe Future of Business Analytics is Now! 2013 IBM Corporation
The Future of Business Analytics is Now! 1 The pressures on organizations are at a point where analytics has evolved from a business initiative to a BUSINESS IMPERATIVE More organization are using analytics
More informationWhat you can accomplish with IBMContent Analytics
What you can accomplish with IBMContent Analytics An Enterprise Content Management solution What is IBM Content Analytics? Alex On February 14-16, IBM s Watson computing system made its television debut
More informationUnlocking Big Data: The Power of Cognitive Computing. James Kobielus, IBM
Unlocking Big Data: The Power of Cognitive Computing James Kobielus, IBM James Kobielus IBM's big data evangelist IBM senior program director for product marketing in big data analytics Editor-in-chief
More informationAuto-Classification for Document Archiving and Records Declaration
Auto-Classification for Document Archiving and Records Declaration Josemina Magdalen, Architect, IBM November 15, 2013 Agenda IBM / ECM/ Content Classification for Document Archiving and Records Management
More informationHow Big Data and Artificial Intelligence Change the Game for. presented by Jamie Bisker Senior Analyst, P&C Insurance Aite Group
How Big Data and Artificial Intelligence Change the Game for Insurance Professionals presented by Jamie Bisker Senior Analyst, P&C Insurance Aite Group Innovation Provocateur November 2014 Agenda Opening
More informationBMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation
BMW11: Dealing with the Massive Data Generated by Many-Core Systems Dr Don Grice IBM Systems and Technology Group Title: Dealing with the Massive Data Generated by Many Core Systems. Abstract: Multi-core
More informationICT Perspectives on Big Data: Well Sorted Materials
ICT Perspectives on Big Data: Well Sorted Materials 3 March 2015 Contents Introduction 1 Dendrogram 2 Tree Map 3 Heat Map 4 Raw Group Data 5 For an online, interactive version of the visualisations in
More informationData Analytics in Health Care
Data Analytics in Health Care ONUP 2016 April 4, 2016 Presented by: Dennis Giokas, CTO, Innovation Ecosystem Group A lot of data, but limited information 2 Data collection might be the single greatest
More informationBIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON
BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing
More informationText Analytics. A business guide
Text Analytics A business guide February 2014 Contents 3 The Business Value of Text Analytics 4 What is Text Analytics? 6 Text Analytics Methods 8 Unstructured Meets Structured Data 9 Business Application
More informationIBM Content Analytics with Enterprise Search, Version 3.0
IBM Content Analytics with Enterprise Search, Version 3.0 Highlights Enables greater accuracy and control over information with sophisticated natural language processing capabilities to deliver the right
More informationFogbeam Vision Series - The Modern Intranet
Fogbeam Labs Cut Through The Information Fog http://www.fogbeam.com Fogbeam Vision Series - The Modern Intranet Where It All Started Intranets began to appear as a venue for collaboration and knowledge
More informationVIEWPOINT. High Performance Analytics. Industry Context and Trends
VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations
More informationMeeting the challenges of today s oil and gas exploration and production industry.
Meeting the challenges of today s oil and gas exploration and production industry. Leveraging innovative technology to improve production and lower costs Executive Brief Executive overview The deep waters
More informationManjula Ambur NASA Langley Research Center April 2014
Manjula Ambur NASA Langley Research Center April 2014 Outline What is Big Data Vision and Roadmap Key Capabilities Impetus for Watson Technologies Content Analytics Use Potential use cases What is Big
More informationUnisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise
Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise Introducing Unisys All in One software based weather platform designed to reduce server space, streamline operations, consolidate
More informationData Center Fabrics and Their Role in Managing the Big Data Trend
Data Center Fabrics and Their Role in Managing the Big Data Trend The emergence of Big Data as a critical technology initiative is one of the driving factors forcing IT decision-makers to explore new alternatives
More informationAnother Giant Leap. for Mankind. Lesson Development
Lesson Development Apollo capsule (Image: NASA) Earth (Image: NASA) Instructional Objectives Students will decompose a geometric shape into smaller parts; apply the appropriate formulas for various geometric
More informationFrom Lab to Factory: The Big Data Management Workbook
Executive Summary From Lab to Factory: The Big Data Management Workbook How to Operationalize Big Data Experiments in a Repeatable Way and Avoid Failures Executive Summary Businesses looking to uncover
More informationDecision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010
Decision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010 Ernst van Waning Senior Sales Engineer May 28, 2010 Agenda SPSS, an IBM Company SPSS Statistics User-driven product
More informationA Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks
A Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks Text Analytics World, Boston, 2013 Lars Hard, CTO Agenda Difficult text analytics tasks Feature extraction Bio-inspired
More informationAugmented Search for Software Testing
Augmented Search for Software Testing For Testers, Developers, and QA Managers New frontier in big log data analysis and application intelligence Business white paper May 2015 During software testing cycles,
More informationNew Broadband and Dynamic Infrastructures for the Internet of the Future
New Broadband and Dynamic Infrastructures for the Internet of the Future Margarete Donovang-Kuhlisch, Government Industry Technical Leader, Europe mdk@de.ibm.com Agenda Challenges for the Future Intelligent
More informationMachine Data Analytics with Sumo Logic
Machine Data Analytics with Sumo Logic A Sumo Logic White Paper Introduction Today, organizations generate more data in ten minutes than they did during the entire year in 2003. This exponential growth
More informationBIG DATA & DATA SCIENCE
BIG DATA & DATA SCIENCE ACADEMY PROGRAMS IN-COMPANY TRAINING PORTFOLIO 2 TRAINING PORTFOLIO 2016 Synergic Academy Solutions BIG DATA FOR LEADING BUSINESS Big data promises a significant shift in the way
More informationDr. John E. Kelly III Senior Vice President, Director of Research. Differentiating IBM: Research
Dr. John E. Kelly III Senior Vice President, Director of Research Differentiating IBM: Research IBM Research Priorities Impact on IBM and the Marketplace Globalization and Leverage Balanced Research Agenda
More informationCognitive z. Mathew Thoennes IBM Research System z Research June 13, 2016
Cognitive z Mathew Thoennes IBM Research System z Research June 13, 2016 Agenda What is Cognitive? Watson Explorer Overview Demo What is cognitive? Cognitive analytics - A set of technologies and processes
More informationDatalogix. Using IBM Netezza data warehouse appliances to drive online sales with offline data. Overview. IBM Software Information Management
Datalogix Using IBM Netezza data warehouse appliances to drive online sales with offline data Overview The need Infrastructure could not support the growing online data volumes and analysis required The
More informationKnowledge Discovery from patents using KMX Text Analytics
Knowledge Discovery from patents using KMX Text Analytics Dr. Anton Heijs anton.heijs@treparel.com Treparel Abstract In this white paper we discuss how the KMX technology of Treparel can help searchers
More informationIBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!
The Bloor Group IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS VENDOR PROFILE The IBM Big Data Landscape IBM can legitimately claim to have been involved in Big Data and to have a much broader
More informationNavigating Big Data business analytics
mwd a d v i s o r s Navigating Big Data business analytics Helena Schwenk A special report prepared for Actuate May 2013 This report is the third in a series and focuses principally on explaining what
More informationManaging Variability in Software Architectures 1 Felix Bachmann*
Managing Variability in Software Architectures Felix Bachmann* Carnegie Bosch Institute Carnegie Mellon University Pittsburgh, Pa 523, USA fb@sei.cmu.edu Len Bass Software Engineering Institute Carnegie
More informationHarnessing the power of advanced analytics with IBM Netezza
IBM Software Information Management White Paper Harnessing the power of advanced analytics with IBM Netezza How an appliance approach simplifies the use of advanced analytics Harnessing the power of advanced
More informationMultichannel Customer Listening and Social Media Analytics
( Multichannel Customer Listening and Social Media Analytics KANA Experience Analytics Lite is a multichannel customer listening and social media analytics solution that delivers sentiment, meaning and
More informationTurnkey Hardware, Software and Cash Flow / Operational Analytics Framework
Turnkey Hardware, Software and Cash Flow / Operational Analytics Framework With relevant, up to date cash flow and operations optimization reporting at your fingertips, you re positioned to take advantage
More informationLuncheon Webinar Series May 13, 2013
Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration
More informationBig Data & Analytics for Semiconductor Manufacturing
Big Data & Analytics for Semiconductor Manufacturing 半 導 体 生 産 におけるビッグデータ 活 用 Ryuichiro Hattori 服 部 隆 一 郎 Intelligent SCM and MFG solution Leader Global CoC (Center of Competence) Electronics team General
More informationENHANCING INTELLIGENCE SUCCESS: DATA CHARACTERIZATION Francine Forney, Senior Management Consultant, Fuel Consulting, LLC May 2013
ENHANCING INTELLIGENCE SUCCESS: DATA CHARACTERIZATION, Fuel Consulting, LLC May 2013 DATA AND ANALYSIS INTERACTION Understanding the content, accuracy, source, and completeness of data is critical to the
More informationPALANTIR CYBER An End-to-End Cyber Intelligence Platform for Analysis & Knowledge Management
PALANTIR CYBER An End-to-End Cyber Intelligence Platform for Analysis & Knowledge Management INTRODUCTION Traditional perimeter defense solutions fail against sophisticated adversaries who target their
More information» A Hardware & Software Overview. Eli M. Dow <emdow@us.ibm.com:>
» A Hardware & Software Overview Eli M. Dow Overview:» Hardware» Software» Questions 2011 IBM Corporation Early implementations of Watson ran on a single processor where it took 2 hours
More informationExperience studies data management How to generate valuable analytics with improved data processes
www.pwc.com/us/insurance Experience studies data management How to generate valuable analytics with improved data processes An approach to managing data for experience studies October 2015 Table of contents
More informationAugmented Search for IT Data Analytics. New frontier in big log data analysis and application intelligence
Augmented Search for IT Data Analytics New frontier in big log data analysis and application intelligence Business white paper May 2015 IT data is a general name to log data, IT metrics, application data,
More informationFive Best Practices for Maximizing Big Data ROI
E-PAPER FEBRUARY 2014 Five Best Practices for Maximizing Big Data ROI Lessons from early adopters show how IT can deliver better business results at less cost. TW_1401138 Organizations of all kinds have
More informationIBM Announces Eight Universities Contributing to the Watson Computing System's Development
IBM Announces Eight Universities Contributing to the Watson Computing System's Development Press release Related XML feeds Contact(s) information Related resources ARMONK, N.Y. - 11 Feb 2011: IBM (NYSE:
More informationIBM Big Data in Government
IBM Big in Government Turning big data into smarter decisions Deepak Mohapatra Sr. Consultant Government IBM Software Group dmohapatra@us.ibm.com The Big Paradigm Shift 2 Big Creates A Challenge And an
More informationHow To Handle Big Data With A Data Scientist
III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution
More informationBuilding Confidence in Big Data Innovations in Information Integration & Governance for Big Data
Building Confidence in Big Data Innovations in Information Integration & Governance for Big Data IBM Software Group Important Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL
More informationDelivering Smart Answers!
Companion for SharePoint Topic Analyst Companion for SharePoint All Your Information Enterprise-ready Enrich SharePoint, your central place for document and workflow management, not only with an improved
More informationBig Data and Healthcare Payers WHITE PAPER
Knowledgent White Paper Series Big Data and Healthcare Payers WHITE PAPER Summary With the implementation of the Affordable Care Act, the transition to a more member-centric relationship model, and other
More informationIntegrating a Big Data Platform into Government:
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
More informationText Mining - Scope and Applications
Journal of Computer Science and Applications. ISSN 2231-1270 Volume 5, Number 2 (2013), pp. 51-55 International Research Publication House http://www.irphouse.com Text Mining - Scope and Applications Miss
More informationSoftware Certification and Software Certificate Management Systems
Software Certification and Software Certificate Management Systems (Position Paper) Ewen Denney and Bernd Fischer USRA/RIACS, NASA Ames Research Center, Moffett Field, CA 94035, USA {edenney,fisch}@email.arc.nasa.gov
More informationBoarding to Big data
Database Systems Journal vol. VI, no. 4/2015 11 Boarding to Big data Oana Claudia BRATOSIN University of Economic Studies, Bucharest, Romania oc.bratosin@gmail.com Today Big data is an emerging topic,
More informationVon Social Media zum Social Business Ein Megatrend für die Geschäftswelt
Stephan Schneider Executive Technology Briefer 07/11/2013 Von Social Media zum Social Business Ein Megatrend für die Geschäftswelt Our experiences are changing in the new Social world How I Buy Interacting
More informationHiTech. White Paper. A Next Generation Search System for Today's Digital Enterprises
HiTech White Paper A Next Generation Search System for Today's Digital Enterprises About the Author Ajay Parashar Ajay Parashar is a Solution Architect with the HiTech business unit at Tata Consultancy
More informationOne thing everyone seems to agree with is that Big Data reflects the geometric growth of captured data and our intent to take advantage of it.
1. CONTEXT Everywhere you turn these days, you will hear three buzzwords: SaaS (Software as a Service), cloud computing and Big Data. The first is a business model, the second a capacity model. The last
More informationStorage Validation at GE
Storage Validation at GE Storage infrastructure performance validation speeds innovation and reduces technology risk December 2014 2014 Load DynamiX. All rights reserved. Table of Contents Abstract...
More informationETPL Extract, Transform, Predict and Load
ETPL Extract, Transform, Predict and Load An Oracle White Paper March 2006 ETPL Extract, Transform, Predict and Load. Executive summary... 2 Why Extract, transform, predict and load?... 4 Basic requirements
More informationA Hurwitz white paper. Inventing the Future. Judith Hurwitz President and CEO. Sponsored by Hitachi
Judith Hurwitz President and CEO Sponsored by Hitachi Introduction Only a few years ago, the greatest concern for businesses was being able to link traditional IT with the requirements of business units.
More informationAugmented Search for Web Applications. New frontier in big log data analysis and application intelligence
Augmented Search for Web Applications New frontier in big log data analysis and application intelligence Business white paper May 2015 Web applications are the most common business applications today.
More informationlocuz.com Big Data Services
locuz.com Big Data Services Big Data At Locuz, we help the enterprise move from being a data-limited to a data-driven one, thereby enabling smarter, faster decisions that result in better business outcome.
More informationBIG DATA AND THE ENTERPRISE DATA WAREHOUSE WORKSHOP
BIG DATA AND THE ENTERPRISE DATA WAREHOUSE WORKSHOP Business Analytics for All Amsterdam - 2015 Value of Big Data is Being Recognized Executives beginning to see the path from data insights to revenue
More informationData Discovery, Analytics, and the Enterprise Data Hub
Data Discovery, Analytics, and the Enterprise Data Hub Version: 101 Table of Contents Summary 3 Used Data and Limitations of Legacy Analytic Architecture 3 The Meaning of Data Discovery & Analytics 4 Machine
More informationNiara Security Analytics. Overview. Automatically detect attacks on the inside using machine learning
Niara Security Analytics Automatically detect attacks on the inside using machine learning Automatically detect attacks on the inside Supercharge analysts capabilities Enhance existing security investments
More informationInformation Visualization WS 2013/14 11 Visual Analytics
1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and
More informationInternational Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop
ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com
More informationIn-Database Analytics
Embedding Analytics in Decision Management Systems In-database analytics offer a powerful tool for embedding advanced analytics in a critical component of IT infrastructure. James Taylor CEO CONTENTS Introducing
More informationIBM Content Analytics adds value to Cognos BI
IBM Software IBM Industry Solutions IBM Content Analytics adds value to Cognos BI 2 IBM Content Analytics adds value to Cognos BI Analyzing unstructured information It is generally accepted that about
More informationHadoop for Enterprises:
Hadoop for Enterprises: Overcoming the Major Challenges Introduction to Big Data Big Data are information assets that are high volume, velocity, and variety. Big Data demands cost-effective, innovative
More informationSIMPLE MACHINE HEURISTIC INTELLIGENT AGENT FRAMEWORK
SIMPLE MACHINE HEURISTIC INTELLIGENT AGENT FRAMEWORK Simple Machine Heuristic (SMH) Intelligent Agent (IA) Framework Tuesday, November 20, 2011 Randall Mora, David Harris, Wyn Hack Avum, Inc. Outline Solution
More informationWho needs humans to run computers? Role of Big Data and Analytics in running Tomorrow s Computers illustrated with Today s Examples
15 April 2015, COST ACROSS Workshop, Würzburg Who needs humans to run computers? Role of Big Data and Analytics in running Tomorrow s Computers illustrated with Today s Examples Maris van Sprang, 2015
More informationData warehouse and Business Intelligence Collateral
Data warehouse and Business Intelligence Collateral Page 1 of 12 DATA WAREHOUSE AND BUSINESS INTELLIGENCE COLLATERAL Brains for the corporate brawn: In the current scenario of the business world, the competition
More informationDatabricks. A Primer
Databricks A Primer Who is Databricks? Databricks was founded by the team behind Apache Spark, the most active open source project in the big data ecosystem today. Our mission at Databricks is to dramatically
More informationOvercoming the Technical and Policy Constraints That Limit Large-Scale Data Integration
Overcoming the Technical and Policy Constraints That Limit Large-Scale Data Integration Revised Proposal from The National Academies Summary An NRC-appointed committee will plan and organize a cross-disciplinary
More informationSaturn V Straw Rocket
Saturn V Straw Rocket Saturn V Rocket Activity Background Information As part of our NASA Tram Tour, you have the opportunity to view a Saturn V Rocket at our Rocket Park. This particular rocket was slated
More informationSocial Media Implementations
SEM Experience Analytics Social Media Implementations SEM Experience Analytics delivers real sentiment, meaning and trends within social media for many of the world s leading consumer brand companies.
More informationData Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems
More informationMicrosoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com;
Microsoft Big Data Solutions Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Why/What is Big Data and Why Microsoft? Options of storage and big data processing in Microsoft Azure. Real Impact of Big
More informationWatson. An analytical computing system that specializes in natural human language and provides specific answers to complex questions at rapid speeds
Watson An analytical computing system that specializes in natural human language and provides specific answers to complex questions at rapid speeds I.B.M. OHJ-2556 Artificial Intelligence Guest lecturing
More informationMachina Research. Where is the value in IoT? IoT data and analytics may have an answer. Emil Berthelsen, Principal Analyst April 28, 2016
Machina Research Where is the value in IoT? IoT data and analytics may have an answer Emil Berthelsen, Principal Analyst April 28, 2016 About Machina Research Machina Research is the world s leading provider
More informationcan you effectively plan for the migration and management of systems and applications on Vblock Platforms?
SOLUTION BRIEF CA Capacity Management and Reporting Suite for Vblock Platforms can you effectively plan for the migration and management of systems and applications on Vblock Platforms? agility made possible
More informationSentiment Analysis on Big Data
SPAN White Paper!? Sentiment Analysis on Big Data Machine Learning Approach Several sources on the web provide deep insight about people s opinions on the products and services of various companies. Social
More informationSIEM 2.0: AN IANS INTERACTIVE PHONE CONFERENCE INTEGRATING FIVE KEY REQUIREMENTS MISSING IN 1ST GEN SOLUTIONS SUMMARY OF FINDINGS
SIEM 2.0: INTEGRATING FIVE KEY REQUIREMENTS MISSING IN 1ST GEN SOLUTIONS AN IANS INTERACTIVE PHONE CONFERENCE SUMMARY OF FINDINGS OCTOBER 2009 Chris Peterson, LogRhythm CTO, Founder Chris brings a unique
More informationA Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data
White Paper A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data Contents Executive Summary....2 Introduction....3 Too much data, not enough information....3 Only
More informationUNIVERSITY OF INFINITE AMBITIONS. MASTER OF SCIENCE COMPUTER SCIENCE DATA SCIENCE AND SMART SERVICES
UNIVERSITY OF INFINITE AMBITIONS. MASTER OF SCIENCE COMPUTER SCIENCE DATA SCIENCE AND SMART SERVICES MASTER S PROGRAMME COMPUTER SCIENCE - DATA SCIENCE AND SMART SERVICES (DS3) This is a specialization
More informationHow In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time
SCALEOUT SOFTWARE How In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time by Dr. William Bain and Dr. Mikhail Sobolev, ScaleOut Software, Inc. 2012 ScaleOut Software, Inc. 12/27/2012 T wenty-first
More informationANALYTICS STRATEGY: creating a roadmap for success
ANALYTICS STRATEGY: creating a roadmap for success Companies in the capital and commodity markets are looking at analytics for opportunities to improve revenue and cost savings. Yet, many firms are struggling
More informationHow to Run a Successful Big Data POC in 6 Weeks
Executive Summary How to Run a Successful Big Data POC in 6 Weeks A Practical Workbook to Deploy Your First Proof of Concept and Avoid Early Failure Executive Summary As big data technologies move into
More informationBig Data Integration: A Buyer's Guide
SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology
More informationMobile Real-Time Bidding and Predictive
Mobile Real-Time Bidding and Predictive Targeting AdTheorent s Real-Time Learning Machine : An Intelligent Solution FOR Mobile Advertising Marketing and media companies must move beyond basic data analysis
More informationBBBT Podcast Transcript
BBBT Podcast Transcript About the BBBT Vendor: The Boulder Brain Trust, or BBBT, was founded in 2006 by Claudia Imhoff. Its mission is to leverage business intelligence for industry vendors, for its members,
More informationInteroperability, Standards and Open Advancement
Interoperability, Standards and Open Eric Nyberg 1 Open Shared resources & annotation schemas Shared component APIs Shared datasets (corpora, test sets) Shared software (open source) Shared configurations
More informationMaster big data to optimize the oil and gas lifecycle
Viewpoint paper Master big data to optimize the oil and gas lifecycle Information management and analytics (IM&A) helps move decisions from reactive to predictive Table of contents 4 Getting a handle on
More informationThe EMSX Platform. A Modular, Scalable, Efficient, Adaptable Platform to Manage Multi-technology Networks. A White Paper.
The EMSX Platform A Modular, Scalable, Efficient, Adaptable Platform to Manage Multi-technology Networks A White Paper November 2002 Abstract: The EMSX Platform is a set of components that together provide
More informationA Characterization Taxonomy for Integrated Management of Modeling and Simulation Tools
A Characterization Taxonomy for Integrated Management of Modeling and Simulation Tools Bobby Hartway AEgis Technologies Group 631 Discovery Drive Huntsville, AL 35806 256-922-0802 bhartway@aegistg.com
More information