Analysis and Visualization of Monitoring Data in 3D

Similar documents
Tool-Supported Application Performance Problem Detection and Diagnosis. André van Hoorn.

ExplorViz: Visual Runtime Behavior Analysis of Enterprise Application Landscapes

INSTITUT FÜR INFORMATIK

Capturing provenance information with a workflow monitoring extension for the Kieker framework

INSTITUT FÜR INFORMATIK

Scalable and Live Trace Processing with Kieker Utilizing Cloud Computing

VISUALIZATION APPROACH FOR SOFTWARE PROJECTS

Open-Source-Software als Katalysator im Technologietransfer am Beispiel des Monitoring-Frameworks

Performance Benchmarking of Application Monitoring Frameworks

A Comparison of the Influence of Different Multi-Core Processors on the Runtime Overhead for Application-Level Monitoring

A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring

KPDAYS 13 Symposium on Software Performance: Joint Kieker/Palladio Days Karlsruhe, Germany, November 27 29, 2013 Proceedings

Continuous Integration in Kieker

Eclipse A Case Study in Software Visualization Based on Static Analysis

Self Adaptive Software System Monitoring for Performance Anomaly Localization

Microservices for Scalability

Application Performance Monitoring: Trade-Off between Overhead Reduction and Maintainability

Software Visualization

SERVICE LEVEL AGREEMENT XML SCHEMA FOR SOFTWARE QUALITY ASSURANCE

Continuous Monitoring of Software Services: Design and Application of the Kieker Framework

Towards Adaptive Monitoring of Java EE Applications

Towards a Performance Model Management Repository for Component-based Enterprise Applications

Industrial Adoption of Automatically Extracted GUI Models for Testing

What Questions Developers Ask During Software Evolution? An Academic Perspective

Integrating Service Oriented MSR Framework and Google Chart Tools for Visualizing Software Evolution

EvoSpaces: 3D Visualization of Software Architecture

Hora: Online Failure Prediction Framework for Component-based Software Systems Based on Kieker and Palladio

Application Performance Monitoring: Trade-Off between Overhead Reduction and Maintainability

A Survey Paper on Software Architecture Visualization

Understanding Software Static and Dynamic Aspects

Tool Support for Inspecting the Code Quality of HPC Applications

Bachelor Degree in Informatics Engineering Master courses

Survey on Models to Investigate Data Center Performance and QoS in Cloud Computing Infrastructure

Visualization of bioinformatics workflows for ease of understanding and design activities

Towards Performance Awareness in Java EE Development Environments

Automatic Extraction of Probabilistic Workload Specifications for Load Testing Session-Based Application Systems

Software Visualization Tools for Component Reuse

SPEC Research Group. Sam Kounev. SPEC 2015 Annual Meeting. Austin, TX, February 5, 2015

Development of a Concurrent and Distributed Analysis Framework for Kieker

EvolTrack: A Plug-in-Based Infrastructure for Visualizing Software Evolution

µfup: A Software Development Process for Embedded Systems

Available online at ScienceDirect. Florian Himmler*, Michael Amberg

Performance Monitoring of Database Operations

Integrating the Palladio-Bench into the Software Development Process of a SOA Project

Online Performance Anomaly Detection with

Instrumentation Software Profiling

WoPeD - An Educational Tool for Workflow Nets

Web Application Architectures

Visualizing Software Architecture Evolution using Change-sets

INSTITUT FÜR INFORMATIK

Unified Batch & Stream Processing Platform

Towards Studying the Performance Effects of Design Patterns for Service Oriented Architecture

An Agent-Based Serviceware Framework for Ubiquitous Context-Aware Services

How To Write The Ceres Software Development Guidelines

Efficient Monitoring of OSGi Applications

Performance Monitoring of Database Operations

Performance Tools for Parallel Java Environments

Curriculum Vitae. Zhenchang Xing

A PRODUCT METRICS TOOL INTEGRATED INTO

Social Networking and Collaborative Software Development

Component visualization methods for large legacy software in C/C++

REQUIREMENTS FOR THE WORKFLOW-BASED SUPPORT OF RELEASE MANAGEMENT PROCESSES IN THE AUTOMOTIVE SECTOR

Concern Highlight: A Tool for Concern Exploration and Visualization

Traceability Method for Software Engineering Documentation

An Aspect-Oriented Product Line Framework to Support the Development of Software Product Lines of Web Applications

A Thread Monitoring System for Multithreaded Java Programs

Evaluation of Alternative Instrumentation Frameworks

A Visualization Approach for Bug Reports in Software Systems

Comprehending Software Architecture using a Single-View Visualization

Replication on Virtual Machines

A distributed system is defined as

Utilizing PCM for Online Capacity Management of Component-Based Software Systems

GECO: Automatic Generator-Composition for (Aspect-oriented) DSLs

An Eclipse Plug-In for Visualizing Java Code Dependencies on Relational Databases

IMPROVING JAVA SOFTWARE THROUGH PACKAGE STRUCTURE ANALYSIS

Software Visualization

Designing Software Cockpits for Coordinating Distributed Software Development

A FRAMEWORK FOR MANAGING RUNTIME ENVIRONMENT OF JAVA APPLICATIONS

Verifying Business Processes Extracted from E-Commerce Systems Using Dynamic Analysis

Scalable and Live Trace Processing in the Cloud

ProGUM-Web: Tool Support for Model-Based Development of Web Applications

Coordinated Visualization of Aspect-Oriented Programs

Software Construction

COMPUTER AUTOMATION OF BUSINESS PROCESSES T. Stoilov, K. Stoilova

Certifying Energy Efficiency of Android Applications

SaaS Analytics. Analyzing usage data to improve software. Bart Schaap Tim Castelein February 10, 2014

NVIDIA Tools For Profiling And Monitoring. David Goodwin

Scalable stochastic tracing of distributed data management events

Linking BPMN, ArchiMate, and BWW: Perfect Match for Complete and Lawful Business Process Models?

Monitoring of Perl-based webapplications using Kieker

Frysk The Systems Monitoring and Debugging Tool. Andrew Cagney

Self-Adaptive Performance Monitoring for Component-Based Software Systems. Jens Ehlers

Control 2004, University of Bath, UK, September 2004

RETRATOS: Requirement Traceability Tool Support

KIEKER: CONTINUOUS MONITORING AND ON DEMAND VISUALIZATION OF JAVA SOFTWARE BEHAVIOR

Self-Aware Software and Systems Engineering: A Vision and Research Roadmap

A Survey Study on Monitoring Service for Grid

A Visualization System and Monitoring Tool to Measure Concurrency in MPICH Programs

Impact Analysis for Supporting the Co-Evolution of Business Processes and Supporting Software Systems

Enterprise Integration: operational models of business processes and workflow systems *

Transcription:

30.11.2012 Analysis and Visualization of Monitoring Data in 3D KoSSE-Symposium Application Performance Management Kieker Days 2012 Jan Waller Kiel University, Department of Computer Science, Software Engineering Group Kieker Project 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 1

Outline 3D Visualization Approaches for Software Systems Monitoring Concurrency Event-based Monitoring Java Thread vs. Hardware Thread Java Monitors (e.g., synchronized) Approaches in the Kieker Context Bachelor Thesis, Christian Wulf (2010) Diploma Thesis, Björn Konarski (2012) Master Thesis, Philipp Döhring (2012) 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 2

An (incomplete) overview on several different 3D VISUALIZATION APPROACHES 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 3

Solar Metric Visualization Hamish Graham, Hong Yul Yang, Rebecca Berrigan. A Solar System Metaphor for 3D Visualisation of Object Oriented Software Metrics. In Proceeding of the 2004 Australasian symposium on Information Visualisation (APVis '04), pp. 53-59, ACM, 2004. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 4

3D Landscape Alexandru Telea, Lucian Voinea. A Framework for Interactive Visualization of Component-Based Software. In Proceedings of the 30th Euromicro Conference, pp. 567-574, IEEE Computer Science, 2004. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 5

Vizz3D Welf Löwe, Thomas Panas. Rapid Construction of Software Comprehension Tools. In International Journal of Software Engineering and Knowledge Engineering, 15:6, pp. 995-1025, World Scientific, 2005. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 6

TraceCrawler Orla Greevy, Michele Lanza, Christoph Wysseier. Visualizing live software systems in 3D. In Proceedings of the 2006 ACM symposium on Software visualization (SoftVis 2006)., pp. 47-56, ACM 2006. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 7

Codecity Richard Wettel, Michele Lanza. Visualizing Software Systems as Cities. In Proceedings of the 4th IEEE International Workshop on Visualizing Software For Understanding and Analysis (VISSOFT 2007), pp. 92-99, IEEE Computer Society Press, 2007. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 8

UML-City Christian F. J. Lange, Michel R. V. Chaudron. Interactive Views to Improve the Comprehension of UML Models - An Experimental Validation. In Proceedings of the 15th International Conference on Program Comprehension (ICPC 07), pp. 221 230. IEEE Computer Society Press, 2007. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 9

Vizz3D Cities Thomas Panas, Thomas Epperly, Daniel Quinlan, Andreas Sæbjørnsen, Richard Vuduc. Communicating Software Architecture using a Unified Single-View Visualization. In Proceedings of the 12th IEEE International Conference on Engineering Complex Computer Systems, pp. 217-228, IEEE Computer Society Press, 2007. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 10

EvoSpaces Philippe Dugerdil, Sazzadul Alam. Execution Trace Visualization in a 3D Space. In Proceedings of the 5th International Conference on Information Technology: New Generations (ITNG 2008), pp. 38-43, IEEE Computer Society Press, 2008. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 11

VizzJava City & VizzAspectJ City Sassi Bentrad, Djamel Meslati. 2D and 3D Visualization of AspectJ Programs. In Proceedings of the 10th International Symposium on Programming and Systems (ISPS), pp. 183-190, IEEE Computer Society Press, 2011. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 12

ScyscrapAR Rodrigo Souza, Bruno Silva, Thiago Mendes, Manoel Mendonça. SkyscrapAR: An Augmented Reality Visualization for Software Evolution. In II Brazilian Workshop on Software Visualization (WBVS 2012), pp. 17-24, SBC, 2012. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 13

CodeTrees Ugo Erra, Giuseppe Scanniello. Towards the Visualization of Software Systems as 3D Forests: the CodeTrees Environment. In Proceedings of the 27th Annual ACM Symposium on Applied Computing (SAC 2012), pp. 981-988, ACM, 2012. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 14

An Overview on Further 3D Software Visualizations Alfredo R. Teyseyre, Marcelo R. Campo. An Overview of 3D Software Visualization. In IEEE Transactions on Visualization and Computer Graphics, pp. 87-105, IEEE Computer Society, 2008. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 15

An (incomplete) overview on aspects of MONITORING CONCURRENCY 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 16

Event-based Monitoring (kieker.*.flow.* packages) Replaces OER Modular Extensible Sub-Traces split event join event Annotations e.g., object-ids 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 17

Java Threads vs. Hardware Threads The CPUID x86 processor instruction Query information on processor Get currently executing (logical) core Java Native Interface (JNI) required System specific library required Additional overhead for JNI calls Specific event-based records inserted into trace periodically polled 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 18

Java Monitors (e.g., synchronized) Java Monitor Mutual exclusion of access 3 states for each call: request / entry / exit Instrumentation using AspectJ Support with -Xjoinpoints:synchronization Probes: @Before("lock()") @After("lock()") @Before( unlock()") Corresponding event-based records Preliminary limited support: wait / notify 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 19

Runtime Visualization of Static and Dynamic Architectural Views of a Software System to identify Performance Problems BACHELOR THESIS CHRISTIAN WULF (2010) 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 20

DyVis Features Combination of Codecity and TraceCrawler Static imported as KDM-Model Dynamic imported from Kieker log 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 21

DyVis Christian Wulf. Runtime Visualization of Static and Dynamic Architectural Views of a Software System to identify Performance Problems. Bachelor thesis, Kiel University, Kiel, Germany, 2010. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 22

Ein 3D-Ansatz zur Visualisierung der Kernauslastung in Multiprozessorsystemen DIPLOMA THESIS BJÖRN KONARSKI (2012) 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 23

ProCity Features Visualization of CPU-Core usage Thread assignment 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 24

ProCity Björn Konarski. Ein 3D-Ansatz zur Visualisierung der Kernauslastung in Multiprozessorsystemen. Diploma thesis, Kiel University, Kiel, Germany, 2012. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 25

Visualisierung von Synchronisationspunkten in Kombination mit der Statik und Dynamik eines Softwaresystems MASTER THESIS PHILIPP DÖHRING (2012) 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 26

SynchroVis Features Continuation of the DyVis approach Operates on event-based records Visualization of concurrency/synchronization 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 27

SynchroVis Features (cont.) Threads Monitor Wait/Notify 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 28

SynchroVis Philipp Döhring. Visualisierung von Synchronisationspunkten in Kombination mit der Statik und Dynamik eines Softwaresystems. Master thesis, Kiel University, Kiel, Germany, 2012. 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 29

Conclusions Existing 3D Visualization Approaches Kieker Monitoring Concurrency Approaches Three Kieker 3D Visualization Approaches Upcoming Further visualizations Further work on monitoring concurrency 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 30

http://kieker-monitoring.net Kieker is distributed as open-source software (Apache License, V. 2.0) Kieker is distributed as part of SPEC RG's repository of peerreviewed tools for quantitative system evaluation and analysis. http://research.spec.org/projects/tools.html Further Reading A. van Hoorn, J. Waller, W. Hasselbring. Kieker: A Framework for Application Performance Monitoring and Dynamic Software Analysis. Proc. 3rd ACM/SPEC Int. Conf. Perform. Eng. (ICPE '12), ACM, 2012 A. van Hoorn, M. Rohr, W. Hasselbring, J. Waller, J. Ehlers, S. Frey, and D. Kieselhorst. Continuous Monitoring of Software Services: Design and Application of the Kieker Framework. Technical report TR-0921, Department of Computer Science, University of Kiel, Germany, 2009 30.11.2012 Jan Waller Analysis and Visualization of Monitoring Data in 3D Kieker Days 2012 31