The Challenge of Handling Large Data Sets within your Measurement System

Transcription

1

2 The Challenge of Handling Large Data Sets within your Measurement System The Often Overlooked Big Data Aaron Edgcumbe Marketing Engineer Northern Europe, Automated Test National Instruments

3 Introduction to NI We provide graphical software with modular hardware to build measurement and control systems. Low-Cost Modular Measurement and Control Hardware Productive Software Development Tools Highly Integrated Systems Platforms From Sensor to Data Data Analysis, Processing Software Data Acq. & Control DAQ and Control HW Sensors 4

4 Escalating Complexity Over Time 5

5 6

6 Why Big Data? IBM Offers some insight 1minute worth of data million s 2 million Google searches 1.3 million video views on YouTube Mobile phones one manufacturer 3 TB of data a day just testing phones in production line. From dawn of time to 2008 collected. 5 Exabytes of data (5 billion Gigabytes) In 2012 collected 2.7 petabytes (2700 billion Gigabytes). 90% of all data ever collected has been in the last 2 years (IBM) 90% of pictures ever taken were taken in last 12 months c.12bn devices connected to internet vs c.1m in 2004, vs c.1000 in 1984 The annual growth rate of data is c.60% 8

7 Why? 9

8 Science, Discovery and Innovation... Thousand years ago Experimental Science Description of natural phenomena Last few hundred years Theoretical Science Newtons Laws, Maxwell s Equations Last few decades Computational Science Simulation of complex phenomena Today Data-intensive Science Unify theory, experiment & simulation 10

9 Big Data Characterized Variety Mix of structure and format Another V NI is seeing... Volume Large amounts Visibility Access from disparate geographic locations Velocity High speed, high sample rates Value Importance of analysis, which was previously limited by technology 11

10 15

11 Smart Tools Intelligent Communication Industrial Robots Smart Inspection Mobile Manipulator 16

12 Airbus Technology Store Vision Smart Filter Intelligent Input/Output Motion Industrial SOM sbriosmart CompactRIO PXI Mobile Tools Communication Robots Inspection Manipulator IP and Algorithm Library NI Hardware 17

13 Big Analog Data End-To-End Solution Architecture Sensors/Actuators Data Acquisition and Analysis Systems (Test, Monitoring, Logging, Control) NI Hardware and FPGA Firmware The Edge IT Infrastructure (Big Data Analytics, Mining) Edge IT (Local, Remote, Cloud) Corporate/ Federated IT NI Software Acquire Data Flow: Real-Time In Motion Early Life At Rest Archive Analyze Present Engineering, Scientific, and Business Analytics Visualization System Management/RASM 1 1 RASM:Reliability,Availability,Serviceability,Manageability Deployment, Health, Monitoring, and Serviceability 18

14 Example Big Analog Data Solution Architecture Product Manufacturing Test IT Infrastructures The Edge Data Acquisition and Analysis Systems Sensors Visibility Access from disparate geographic locations This annihilates former time and place dependencies Images Courtesy of Adventure Technologies, Agarwal, Kulak, Weir 21

15 The Internet of Things and Big Analog Data Solutions Commercial Smart factory Physical assets Transportation Electronic devices Vending machines Home appliances Automobiles Consumer Three supply side benefits of perpetual connectivity to product and consumer Monitor Continuous knowledge of the condition and usage of product in the market Maintain Convenient upgrades, patches, fixes and predictive failure analysis Motivate Compel consumer to purchase up-sells, accessories, etc. 25

16 Big Analog Data Solutions Mapping to The Internet of Things: Commercial Sensors/Actuators Data Acquisition and Analysis Systems IT Infrastructure (Analytics, Data Buses, Archieve) Smart factory Edge IT (Local, Remote, Cloud) Corporate/ Federated IT Physical assets Transportation Electronic devices Vending machines Home appliances Automobiles Consumer Acquire Data Flow: Real-Time In Motion Early Life At Rest Archive 26

17 Manufacturing and Big Analog Data Solutions Complex Data Acquisition, Control, and Global Supply Chain Communications Smart Factories and IoT drive efficiencies by immediate and perpetual visibility into manufacturing operations: This cuts out middle men in the system This annihilates former time and place dependencies Production Machines Smart-Grid Heavy Equipment Test Cells Hardware in the Loop (HIL) Big Physics Metal Fabrication Test and Measurements 28

18 Considerations: Enabling Technology Vectors Data Management capture, filing, transmission, retrieval, aging, data formats, visualization Systems Management deployment, configuration, health monitoring, security, RASM, remote access Data Analytics algorithms, prognostics, alarming, distributed intelligence

19 Considerations: Customer Value Data Management capture, filing, transmission, retrieval, aging, data formats, visualization Systems Management deployment, configuration, health monitoring, security, RASM, remote access Data Analytics algorithms, prognostics, alarming, distributed intelligence Robust, end-to-end test and validation (V&V) Reduces customer s Integration Risk Decreases customer s Time to Value

20 Big Analog Data Sources Big Analog Data Sources are Everywhere the oldest, fastest, and biggest of all the other Big Data combined 33

21 Discover more about the data challenge we face at: /biganalogdata Find out more about National Instruments at: Booth 8E050