jbeam A CEA-based enterprisewide reporting solution, even for big datasets

Transcription

1 jbeam A CEA-based enterprisewide reporting solution, even for big datasets Dr.-Ing. Bernhard SünderS AMS GmbH, Floeha, Germany AMS North America Inc., USA [email protected]

2 What is jbeam?- Data Processing Offline Data Evaluation jbeam Reports Online Monitoring Acquisition Modules Server Application Data management Server Import Analyze Visualize Interactive & local: Desktop Global: Web-Service Screen Printouts Page 2

3 Use Cases Interactive test data Analysis (e.g. Offline data) Automatic Reporting Process Monitoring (10 Hz) Fast data acquisition Front end of test data Management Systems Statistical Process Control Many more Processing of big data sets Page 3

4 What is a big dataset? Automotive Area Use case: Engine test 2 Byte/value, 100 channels, 1000 Hz, 2h: 1,440,000,000 Byte = 1.44 GByte Use case: Gearshift Analysis Runtime: > 1 year Data volume: Terabyte Others: CERN (Geneva): > 1 Peta-Byte Page 4

5 Prefixes & Zeros Keep in mind: 1 kbyte 1,000 kilo 1 MByte 1,000,000 Mega 1 GByte 1,000,000,000 Giga 1 TByte 1,000,000,000,000 Tera 1 PByte 1,000,000,000,000,000 Peta = 1 Quadrillion Page 5

6 Solution 1: 64 Bit Systems PC with Windows64 or Linux64 Workstation with HP-UX or Solaris Buy 128 GB of RAM... and use jbeam It is so simple because jbeam can run 32 bit and 64 bit (as every Java based SW) Page 6

7 Solution 2: File based channel Use your existing PC with Windows32: Having only 512 MB of RAM and big data sets? use jbeam Content of data channels are stored in temporary files on your hard disk. Access of data is slightly slower depending on hardware >50%. Page 7

8 Lower Resolution For floating point data: 64 Bit / 8 Byte data length high precision native CPU format 32 Bit / 4 Byte data length low precision less memory required, only 50% Page 8

9 User Selectable Page 9

10 Solution 3: Client-Server Having big data sets on your server database? use? Page 10

11 Solution 4: Client-Server Having big data sets on your server database? use 2 jbeams One jbeam instance on server can serve multiple jbeams on client side. Client jbeam will control server jbeam and will receive statistical data or parts on request. Page 11

12 Desktop or Library Desktop Application Desktop Wrapper Class Library jbeam Customized Application Business Logic User specific Application Class Library jbeam One basic tool for company wide solutions Page 12

13 Flexibility - Extensibility Server Client Flexibility by using Java Extensibility by ASAM*-CEA *) ASAM: Association for Standardization of Automation and Measuring Systems Page 13

14 jbeam Application Models J2SE Application J2EE Application 1 J2EE Application 2 jb high Desktop Application Thick Client medium Application Client Applet or JWS jb Low Thin Client Webbrowser: Dynamic HTML Pages Client Tier User interactivity Client Machine CEA-Component JSP Pages Web Tier Server Machine jb Enterprise Beans jb Enterprise Beans Business Tier Database Database Database EIS Tier Database Server Machine Page 14

15 System Overview Server 2. Look for stored data 3. Provides test data Layouts jbeam class library User Application 4.b CEA compatible Control (User appl. spec. Component) controls jbeam - Import - Analysis (e.g. Statistics over several tests) - Visualisation - Export 4.a Provides the data or pathes to the data. Controls jbeam over API 1. Request data set 5. Test protocol (static or interactive) Client Page 15

16 Test Protocol static or dynamic jbeam class library 5. Test protocol Embedded in HTML Client Static display Semi interactive display Interactive display Static HTML page incl. SVG, Jpg or PDF jbeam protocol on client: - move cursors or sliders - zoom in and zoom out - pre-defined export (Buttons) jbeam protocol on client: - new calculations - new graphics - Exports End User functionality End User functionality Master User functionality Page 16

17 Use Case engine data information system at VW Server ODS 3. imports the engine data for analysis jbeam class library Server Application (Business Layer) 2. controls jbeam over API - Import: Data-files and predefined layouts-files - Analysis: Characteristic values - Visualisation: engine characteristic maps - Export: as html page incl. PDF or jpg 1. Request data set 5. Test protocol embedded in HTML 4. Provides test protocol incl. multilingual layouts as PDF or SVG Thin Client Layouts jbeam Desktop Page 17

18 Usecase - testxplorer + jbeam testxplorer delivers test data from test floor and/or from database jbeam calculates and shows the result in a static or dynamic Htmlpage Page 18

19 Usecase - testxplorer + jbeam Server-based Analysis: - choosing channels - choosing mathematic analysis - visualizing channels / results - validation of data - create reports - import / export - Video-matching Page 19

20 Use Case GM Brake Test System Project Objectives Reduce time to perform processes associated with Brake performance testing Integration of disparate systems Enable data sharing between data producers and data consumers Re-use of legacy MATLAB data processing code Automation of data analysis and visualization Challenges Data Processing Integration between Windows-based MATLAB and Java-based Web application Definition and registration of COM objects from web application Visualization / Reporting Interfaces Managing customer-defined templates Integration with pre-defined templates Integration with external systems for Test Request and Instrumentation details Page 20

21 Use Case GM Brake Test System Brake Test System (BTS): Java-based Web and Swing application MATLAB code compiled into COM component CEA Bus used as a container for raw, processed, and business data, including MATLAB output. Customized CEA component to: Generate custom reports Provide data analysis and visualization features Multiple Technologies Leveraged ASAM CEA Implementation Java Web Start to download CEA component on client Use of Java to Com bridge to invoke COM Components from Java technologie Page 21

22 More than just data storage All components of a system must be able to handle big data channels Channels: Usage of offsetx and deltax save explicit time channels Calculations: Are optimized to run on 64 Bit systems in very fast mode Support of file based channels for input and output Graphic Elements Spreadsheet Line plot Channel selectors Zoom with tracking window Page 22

23 Visualisation Support Spreadsheet display of numerous and long channels. Fully transparent for the user. Page 23

24 Line chart complete & zomed All > 20,000,000 values in one plot without waiting time Tracking window, Value under cursor, Reference/delta axis, Page 24

25 Referencing channels Test Name Channel Name Select from List Input channel selector dialog With user definable filters to find the requested channel even from thousands of channels Page 25

26 Global Focus - Multiplatform Windows 98, NT4, 2000, XP Vista compatable (eben 64 bit) Linux (even 64 bit) Solaris (64 bit) Macintosh OS-X VMS-Alpha HP-UX Page 26

27 Who is using jbeam? Strategic Solutions GM Global Product Development (5000 licenses) GM Powertrain (Engine test labs) VW (GOE / GOT, service departments) Daimler AG (Truck) System Integrators WiPro (Indian System Integrator) Kratzer Automation (Data Lifetime Management) T-Systems (D & US) rd elektronic (for GM) Bosch Rexroth (internally) Desktop Solutions VW, AUDI, Daimler, GM, Opel, BMW, EDAG, Benteler, Bosch, Grammer, Knorr Bremse, Norma Rasmussen, Universities, Vattenfall,... Page 27

28 jbeam Visualization Samples of typical use cases. Page 28

29 Interactive Desktop runjbeam_demo_142_03.bat Page 29

30 Protocols Page 30

31 jbeam Vibration - FFT Mouse controlled xy-cursor defines a cross-section, section, which is displayed in line charts. Page 31

32 jbeam Visual Crash Analysis Synchronized display of numerical and video data. Page 32

33 Interactive Energy Calculation Page 33

34 Counting Methods Different Rainflow Methods Level Crossing Range Pair Interactive Cuts Page 34

35 Material Deformation Page 35

36 Flow fields Page 36

37 Interactive 3D-Graphs Page 37

38 Online Monitoring Page 38

39 Conclusion jbeam is the right tool to handle Excel-sized or even real big data sets. jbeam is extendable by using application specific ASAM CEA components. jbeam client/server systems serve as distributed solutions, even multi cluster apps in the future. jbeam is the best basic technology fully scalable from small desktop application up to Tera-Byte enterprise solutions. Page 39

40 jbeam is developed and distributed by: Gesellschaft für angewandte Meß- und Systemtechnik mbh Heinrich-Heine-Str Flöha Germany (3726) NorthAmerica Inc Harmon Road Auburn Hills, MI USA +1 (248) Visit us at booth Page 40