jbeam A CEA-based enterprisewide reporting solution, even for big datasets Dr.-Ing. Bernhard SünderS AMS GmbH, Floeha, Germany AMS North America Inc., USA Bernhard.Suender@AMSonline.de
What is jbeam?- Data Processing Offline Data Evaluation jbeam Reports Online Monitoring Acquisition Modules Server Application Data management Server Import Analyze Visualize Interactive & local: Desktop Global: Web-Service Screen Printouts Page 2
Use Cases Interactive test data Analysis (e.g. Offline data) Automatic Reporting Process Monitoring (10 Hz) Fast data acquisition Front end of test data Management Systems Statistical Process Control Many more Processing of big data sets Page 3
What is a big dataset? Automotive Area Use case: Engine test 2 Byte/value, 100 channels, 1000 Hz, 2h: 1,440,000,000 Byte = 1.44 GByte Use case: Gearshift Analysis Runtime: > 1 year Data volume: Terabyte Others: CERN (Geneva): > 1 Peta-Byte Page 4
Prefixes & Zeros Keep in mind: 1 kbyte 1,000 kilo 1 MByte 1,000,000 Mega 1 GByte 1,000,000,000 Giga 1 TByte 1,000,000,000,000 Tera 1 PByte 1,000,000,000,000,000 Peta = 1 Quadrillion Page 5
Solution 1: 64 Bit Systems PC with Windows64 or Linux64 Workstation with HP-UX or Solaris Buy 128 GB of RAM... and use jbeam It is so simple because jbeam can run 32 bit and 64 bit (as every Java based SW) Page 6
Solution 2: File based channel Use your existing PC with Windows32: Having only 512 MB of RAM and big data sets? use jbeam Content of data channels are stored in temporary files on your hard disk. Access of data is slightly slower depending on hardware >50%. Page 7
Lower Resolution For floating point data: 64 Bit / 8 Byte data length high precision native CPU format 32 Bit / 4 Byte data length low precision less memory required, only 50% Page 8
User Selectable Page 9
Solution 3: Client-Server Having big data sets on your server database? use? Page 10
Solution 4: Client-Server Having big data sets on your server database? use 2 jbeams One jbeam instance on server can serve multiple jbeams on client side. Client jbeam will control server jbeam and will receive statistical data or parts on request. Page 11
Desktop or Library Desktop Application Desktop Wrapper Class Library jbeam Customized Application Business Logic User specific Application Class Library jbeam One basic tool for company wide solutions Page 12
Flexibility - Extensibility Server Client Flexibility by using Java Extensibility by ASAM*-CEA *) ASAM: Association for Standardization of Automation and Measuring Systems Page 13
jbeam Application Models J2SE Application J2EE Application 1 J2EE Application 2 jb high Desktop Application Thick Client medium Application Client Applet or JWS jb Low Thin Client Webbrowser: Dynamic HTML Pages Client Tier User interactivity Client Machine CEA-Component JSP Pages Web Tier Server Machine jb Enterprise Beans jb Enterprise Beans Business Tier Database Database Database EIS Tier Database Server Machine Page 14
System Overview Server 2. Look for stored data 3. Provides test data Layouts jbeam class library User Application 4.b CEA compatible Control (User appl. spec. Component) controls jbeam - Import - Analysis (e.g. Statistics over several tests) - Visualisation - Export 4.a Provides the data or pathes to the data. Controls jbeam over API 1. Request data set 5. Test protocol (static or interactive) Client Page 15
Test Protocol static or dynamic jbeam class library 5. Test protocol Embedded in HTML Client Static display Semi interactive display Interactive display Static HTML page incl. SVG, Jpg or PDF jbeam protocol on client: - move cursors or sliders - zoom in and zoom out - pre-defined export (Buttons) jbeam protocol on client: - new calculations - new graphics - Exports End User functionality End User functionality Master User functionality Page 16
Use Case engine data information system at VW Server ODS 3. imports the engine data for analysis jbeam class library Server Application (Business Layer) 2. controls jbeam over API - Import: Data-files and predefined layouts-files - Analysis: Characteristic values - Visualisation: engine characteristic maps - Export: as html page incl. PDF or jpg 1. Request data set 5. Test protocol embedded in HTML 4. Provides test protocol incl. multilingual layouts as PDF or SVG Thin Client Layouts jbeam Desktop Page 17
Usecase - testxplorer + jbeam testxplorer delivers test data from test floor and/or from database jbeam calculates and shows the result in a static or dynamic Htmlpage Page 18
Usecase - testxplorer + jbeam Server-based Analysis: - choosing channels - choosing mathematic analysis - visualizing channels / results - validation of data - create reports - import / export - Video-matching Page 19
Use Case GM Brake Test System Project Objectives Reduce time to perform processes associated with Brake performance testing Integration of disparate systems Enable data sharing between data producers and data consumers Re-use of legacy MATLAB data processing code Automation of data analysis and visualization Challenges Data Processing Integration between Windows-based MATLAB and Java-based Web application Definition and registration of COM objects from web application Visualization / Reporting Interfaces Managing customer-defined templates Integration with pre-defined templates Integration with external systems for Test Request and Instrumentation details Page 20
Use Case GM Brake Test System Brake Test System (BTS): Java-based Web and Swing application MATLAB code compiled into COM component CEA Bus used as a container for raw, processed, and business data, including MATLAB output. Customized CEA component to: Generate custom reports Provide data analysis and visualization features Multiple Technologies Leveraged ASAM CEA Implementation Java Web Start to download CEA component on client Use of Java to Com bridge to invoke COM Components from Java technologie Page 21
More than just data storage All components of a system must be able to handle big data channels Channels: Usage of offsetx and deltax save explicit time channels Calculations: Are optimized to run on 64 Bit systems in very fast mode Support of file based channels for input and output Graphic Elements Spreadsheet Line plot Channel selectors Zoom with tracking window Page 22
Visualisation Support Spreadsheet display of numerous and long channels. Fully transparent for the user. Page 23
Line chart complete & zomed All > 20,000,000 values in one plot without waiting time Tracking window, Value under cursor, Reference/delta axis, Page 24
Referencing channels Test Name Channel Name Select from List Input channel selector dialog With user definable filters to find the requested channel even from thousands of channels Page 25
Global Focus - Multiplatform Windows 98, NT4, 2000, XP Vista compatable (eben 64 bit) Linux (even 64 bit) Solaris (64 bit) Macintosh OS-X VMS-Alpha HP-UX Page 26
Who is using jbeam? Strategic Solutions GM Global Product Development (5000 licenses) GM Powertrain (Engine test labs) VW (GOE / GOT, service departments) Daimler AG (Truck) System Integrators WiPro (Indian System Integrator) Kratzer Automation (Data Lifetime Management) T-Systems (D & US) rd elektronic (for GM) Bosch Rexroth (internally) Desktop Solutions VW, AUDI, Daimler, GM, Opel, BMW, EDAG, Benteler, Bosch, Grammer, Knorr Bremse, Norma Rasmussen, Universities, Vattenfall,... Page 27
jbeam Visualization Samples of typical use cases. Page 28
Interactive Desktop runjbeam_demo_142_03.bat Page 29
Protocols Page 30
jbeam Vibration - FFT Mouse controlled xy-cursor defines a cross-section, section, which is displayed in line charts. Page 31
jbeam Visual Crash Analysis Synchronized display of numerical and video data. Page 32
Interactive Energy Calculation Page 33
Counting Methods Different Rainflow Methods Level Crossing Range Pair Interactive Cuts Page 34
Material Deformation Page 35
Flow fields Page 36
Interactive 3D-Graphs Page 37
Online Monitoring Page 38
Conclusion jbeam is the right tool to handle Excel-sized or even real big data sets. jbeam is extendable by using application specific ASAM CEA components. jbeam client/server systems serve as distributed solutions, even multi cluster apps in the future. jbeam is the best basic technology fully scalable from small desktop application up to Tera-Byte enterprise solutions. Page 39
jbeam is developed and distributed by: Gesellschaft für angewandte Meß- und Systemtechnik mbh Heinrich-Heine-Str. 5 09557 Flöha Germany www.amsonline.de +49 (3726) 7881-0 NorthAmerica Inc. 1771 Harmon Road Auburn Hills, 48326-MI USA www.jbeam.com +1 (248) 219-5256 Visit us at booth 14044 Page 40