3D Approach to the Visualization of Parallel Applications and Grid Monitoring Information

Size: px
Start display at page:

Download "3D Approach to the Visualization of Parallel Applications and Grid Monitoring Information"

Transcription

1 3D Approach to the Visualization of Parallel Applications and Grid Monitoring Information Lucas Mello Schnorr, Guillaume Huard, Philippe Olivier Alexandre Navaux Instituto de Informática Universidade Federal do Rio Grande do Sul CEP Porto Alegre - RS - Brazil {lmschnorr,navaux}@inf.ufrgs.br Laboratoire LIG - MOAIS INRIA Project ENSIMAG - 51 avenue Jean Kuntzmann Montbonnot Saint Martin - France Guillaume.Huard@imag.fr Abstract Parallel computing is increasingly used to provide more performance to applications that need tremendous computational power. The main characteristics of distributed parallel machines are heterogeneity, dynamism and size. They influence directly the way the application and platform monitoring tasks are performed, especially when analyzing a large quantity of information collected in a topologically complex machine. This paper describes our efforts to provide parallel programmers and Grid users a new way to visualize monitoring data. Using a three dimensional representation and information visualization techniques, we aim at bringing rich topological information to the rendered scene. It results in an immersive and human readable representation of complex monitoring data, suited to Grid environments. We first review known techniques in information visualization context, especially those that address the case of hierarchical information, and we discuss about their use in our context. Then, we propose a new 3D approach that combines the classical space-time visualization of application traces with the representation of the underlying architecture topology. Finally, we present experimental results obtained throught the visualization of parallel applications in our prototype. I. INTRODUCTION Parallel and distributed computing systems are used today to offer applications more computational power. One example is grid infrastructures, also known as virtual organizations [8]. The main characteristics of these systems are their heterogeneity (from the resources interconnection to the software organization), their dynamism and scale (the number of resources may vary through time and possibly become large) and their topological complexity (interconnection organization). Dealing with parallel applications in these systems involves many tasks such as deployment, security and resources management. One of these tasks, the resources and application monitoring, is especially useful to the system administration (platform state information), grid middleware (resources and application management), application debugging (deadlocks detection) and performance tuning (bottlenecks identification). The data monitored in these cases can range from details about applications to network and resources metrics. The analysis of all this information is often complex, partially due to the large number of resources that can be involved in the monitoring task and partially due to the topological complexity, dynamism and heterogeneity of platforms such as Grids. One way to ease the analysis of this complex information is to use elaborated visualization techniques, that can help the analyst to find patterns in the monitoring data. The visualization is already widely used in existing architectures: for instance, in clusters, where data is simpler (uniform, low scale), to visualize the behavior of parallel applications or the platform load state. Nevertheless, the information presentation is often based on two dimensional Gantt Charts in which the platform topology is not particularly outlined. When dealing with Grids, this is not sufficient as the platform might have a deep hierarchical organization, strong resources heterogeneity or a larger number of different metrics to monitor. The question we try to address is how to organize this information in space in order to obtain an understandable and significant visualization. A large number of visualization techniques were developed during the last 20 years to analyze information extracted from databases, statistical studies and other areas involving large data sets. Some of these efforts were applied in Grid computing through the use of visualization tools such as Paradyn [1], Pajé [5] and the work of Reed [24]. Our approach to deal with visualization of Grid environments and applications involves both the use of information visualization techniques and topological information. This paper presents a different way to visualize the monitoring data collected in Grid environments. It makes use of a three dimensional view to combine related data: the hardware resources and the application activity. Moreover, this approach can be applied to any pair of related information streams and remains as generic as possible. In this approach, two axis are used to represent the Grid resources and outline their topology while the third axis is used to represent the evolution of time. Application activity information is thus injected into this 3D representation. The benefits brought by this approach over classical Gantt charts is that a two dimensional space is available to build a representation of the platform topology. The paper is organized as follows: section II presents known information visualization techniques and discusses about their use in Grid environments. Section III describes in details our 3D approach to visualize Grid and parallel applications monitoring data. Section IV shows the results of our 3D Visualization tool, named Triva. Section V presents related work and, finally, section VI gives a summary of our achievements and future works.

2 II. INFORMATION VISUALIZATION ELEMENTS APPLIED TO PARALLEL MACHINES Two dimensional display of node-link diagrams, depicted in figure 2(a), is the usual way to visualize hierarchical information [19]. The nodes are connected to others by links and can be labeled with additional information. In order to better explain hierarchical visualizations, we will take Grid 5000 [3] as our main heterogeneous platform example. Grid 5000 is a nation-wide interconnection of clusters of workstations geographically spread over France totalizing 5000 processors cores. The interconnection is mainly made of three different kinds of networks (local ethernet, local high performance such as myrinet, and optical fiber backbone). Figure 1 presents a platform overview, showing the fiber backbone interconnection between the geographical locations taking part of the project. Because each cluster that belongs to Grid 5000 is an homogeneous group of resources, we name this kind of Grid a Lightweight grid (limited heterogeneity, strong hierarchy). Fig. 1. Grid 5000 network organization using the fiber backbone. As we can see in figure 2(a), we can use a node-link diagram to represent the hierarchy induced by the Grid 5000 backbone when taking Grenoble as root of the tree. This figure gives a pretty good picture of inter-sites network distance and site connectivity (Paris and Lyon have both a large arity). Nevertheless, we can notice that parts of this figure are empty (top left and top right) and that sites relative size cannot be represented intuitively(labeling is not visually sound). A. Treemap Representations The treemap technique is a solution that provides a better exploitation of the screen space [13]. Instead of drawing nodes and links between them, it exploits the whole screen space using a recursive space-division algorithm. This algorithm starts at the root of the hierarchy, divides the available space among the direct children of the current node and applies itself recursively to the space part given to each child. Examples of treemaps utilization include network monitoring with security purposes [17], grid resource monitoring (a) Fig. 2. (a) Hierarchy visualization of Grid 5000 network organization from the Grenoble point-of-view (b) Treemap associated with that point-of-view. data visualization [21] and visual analysis of stock market [25]. These multiple applications of the treemap technique demonstrate its potential. We could apply directly the treemap technique on the Grid 5000 hierarchy presented in figure 2(a) resulting in the treemap presented in figure 2(b). Nevertheless, in this figure, although the drawing space is fully utilized, the relative size of different sites is completely irrelevant and the hierarchical structure is less obvious. When using treemaps to visualize the platform such as Grid 5000, one should take advantage of the representation to outline relevant platforms characteristics. Thus, if we organize the platform hierarchical structure into Grid (the whole platform), Sites (each geographical organization), Clusters (each homogeneous group of workstation) and Nodes (each workstation), we outline its geographical organization. Additionally using the number of nodes to determine rectangles size, we end up with the treemap presented in figure 3 to represent Grid In this figure, the platform hierarchy appears less clearly than in figure 2(a). But taking advantage of bold and dashed line, we can still emphasize the hierarchy levels: we can notice that Rennes hosts 4 clusters of respective size 64, 32, 99 and 66, that Orsay hosts 3 clusters of respective size 126, 186 and 30, and so on. Furthermore, because of rectangles dimensions we can intuitively visualize the relative size of the different components of the platform thus gaining quantitative information about the platform. B. Interaction Mechanisms When using a graphical visualization, users are interested in interaction mechanisms, like zooming, animations and online information updates. These facilities improve the user perception of specific parts of the information, enabling him to analyze deeply its application and platform behavior. Zooming, for instance, could be applied on the example of figure 3 by choosing one of the sites. After this operation, the chosen site would occupy the whole screen and sub parts of the site would then have enough room to display additional information. The graphical animation together with online updating can also be applied by dynamically change the graphical visualization. Resizing rectangles and changing their colors to reflect platform state are some examples. In this case, changes are caused by continuous information updates coming from the monitoring system. Another type of graphical interaction (b)

3 number of links. The figure 4(b) presents an example of this approach. (a) (b) Fig. 3. Logical Hierarchical Definition of Grid 5000 based in the number of nodes, and a division in Grid - Sites - Cluster - Nodes. mechanism is constituted by distortion techniques [4], which magnify only specific parts of the representation. The fish-eye technique [22] is a good example of such technique. It helps the user to obtain details about a picture area without losing its context (as opposed to a simple zoom). C. Parallel Applications Visualization Most of these visualization techniques present the data from a resources point of view. In the Grid 5000 example from figure 3, the visualization contains the node count for each site. Of course it would be interesting for the user to combine resources visualization with application information such as the number of threads running on each site, node, or even more precisely on each core. This combined approach still needs resources as basis in order to ease the understanding of the relationship between resources events (load, contention, under utilization and others) and application execution. The use of treemap could constitute this basis (as they are often used to inform the user about resources in use [7]). We could also combine this idea with the techniques of software calls visualization presented by Holten [12] and adapted to Grid contexts: the parallel application communications would thus be visualized on top of a treemap (figure 4(a)). Processes in each site would be represented by circles inside the rectangles while communications between them by edges (possibly directed). Notice that this kind of representation should also be designed to operate nicely with interaction mechanisms (for instance when zooming toward a single process or when updating the number of processes executing within a node). Of course, rectangular treemaps should not be considered as the only way to represent resources information. For instance, if communications between processes is as important as cluster size, it is possible to use a circle as base space for resources and dedicate the interior part of this circle to represent communication streams between machines. The approach was used by Holten [12] to show links bundles made of a large Fig. 4. Figures extracted from [12]. Examples that can be used in Grid context showing communications and processes: (a) treemap based and (b) circles based. III. THE 3D APPROACH Many tools exist today to perform the analysis and performance tuning of parallel applications. Examples of these tools are Pajé [5], JaViz [15], Vampir [18] and others. They all represent information using a 2D visualization, like a Gantt chart [16]. One of the axis represents the organization of the resources, hierarchically or not, and the other represents the time. All the visual objects which are part of the application visualization are drawn according to these axis. When analyzing parallel applications on the grid, developers usually need additional information about the network topology in order to better understand the behavior of their application. With this kind of additional information together with a mapping between the application s processes and the execution resources, developers can visualize the location of communications in the network infrastructure. This allows them to quickly correlate performance issues to possible architectural peculiarities and to fix the appropriate part of their application. Unfortunately, Gantt-based visualizations are not satisfying when network interconnections and communication patterns use a complex topology (more complex than a simple chain or tree). This is because the drawing of all the resources is made on a linear space, which is the main drawback of all usual tools: as the architecture gets larger and more complex, highlighting its topology becomes impractical. And even if some sort of simple topology organization can be represented using the vertical axis, labeling the platform representation with additional characteristics like throughput and latency usually degrades the readability of the whole picture. The 3D approach addresses this lack of support for topology-enhanced visualization of Grid applications. It draws the same information as Gantt-based approach, but two dimensions are available to represent resources. The next subsections present the general view, the conceptual model and the implementation of our approach.

4 A. General View Figure 5 shows a general view of the three dimensional scene visualization. In this model, the vertical axis is used to represent time. Different scales can be used in order to represent a larger view of the execution or to focus on some peculiar time interval. The two remaining dimensions are used to the monitored entities and will be referred as the visualization base. the start of a process, a state change to blocked, the reception of a communication and so on. The visual objects are generic and independent of the application being analyzed. There are two classes of visual objects according to their relation to time. Time dependent objects are shown along the vertical axis of the 3D visualization and have a start and end timestamp. Examples of timed visual objects are states and links. The other class is composed of objects that are not related to time which match the entities monitored. For instance, in the case of a parallel application, these entities might be processes and their threads. The component A generates in its output a set of visual objects that contain time-related events and the entities monitored. These events are similar to the generic objects defined in the Pajé language [5]. Monitoring Data Event Flow A B C Entities Monitored and Links D Node Position 3D Visualization Fig. 6. Model used in order to create the three dimensional visualization. Fig. 5. The three dimensional approach with the topology represented This placement of monitored entities on the base can be tailored to various situations. For instance, when monitoring a parallel application, various process can be grouped according their location in processors or nodes. This would emphasize the load balance in the platform and enable the developer to check the matching between communications and physical links. Another possibility would be to group them according to the overall volume of their communication. This would lay the stress on application s communication patterns. The developer can then identify communication intensive parts of the application that could be distributed on distinct nodes. This is the main advantage of using three dimensions for monitoring data visualization: the developer can easily visually analyze the interactions among application processes as well as the matching of the application with the platform. B. Model Figure 6 shows the overall view of the model used to reconstruct a three dimensional visualization of some monitoring data. It is composed of four modules, each of them responsible of the raw data transformation into visual objects. The first module, represented in the figure 6 by the component A, is in charge of the data translation. It receives the monitoring data and translate it into internal generic visual objects. This monitoring data is a flow of events regarding the parallel application (possibly completed with additional quantitative information). These events might be for instance The second part of the model is represented in the figure 6 by the component B. Given some global visualization information (time scale, area visualized), it splits the set of visual objects into a flow of visual objects that should be drawn and the scene topological information. The scene topological information is constituted of a set of monitored entities (for instance the processes of a parallel application or the nodes of the platform) and relationships among them. These relationships are deduced from the links between monitored entities (which can be communications, physical links, for example). This topological information will be used to compute the rendering of the visualization base by components D and C. The component D is in charge of computing the layout of the monitored entities on the base of the three dimensional scene. Figure 7 depicts the details of this component. It receives as input a set of monitored entities and the relationships among them. Given this entities graph, it computes the best place for each entity (which can be threads, processes, machines, for example) into the visualization base. This determination of entities position can be made according to various objectives such as minimizing the number of links that cross each other or mapping the entities position into a platform treemap. Its output is thus the set of monitoring entities completed with their 2D position. The last component of figure 6 takes both the flow of visual objects and the layout of monitored entities to compute the 3D layout of the rendered scene. This last part is dependent on the visualization platform and should take advantage of its 3D acceleration capabilities. C. Implementation A 3D visualization prototype called Triva has been developed in order to validate and assess the advantages of the three

5 Monitored Entities T X R Y S Relations D Node Position Y T R KAAPI Events DIMVisual Pajé Simulator T Y T R Y R S Extractor Fig. 7. Detail over the component D, responsible to calculate the node position for the monitored entities. Graphviz 3D Visualization dimensional approach proposed in the paper. Triva stands for Three dimensional Interactive Visualization Analysis and is currently in use to visualize parallel applications we develop on Grid Figure 8 depicts its internal design. It makes use of existing components such as DIMVisual [23], Pajé [5] and Graphviz [9] and combine them to form a complete 3D visualization tool for applications traces. The prototype has been primarily developed to visualize trace files generated by the KAAPI parallel programming library [10]. The module DIMVisual in figure 8 translates KAAPI events into Pajé format. DIMVisual is a modulebased unification tool for multiple trace inputs that can be easily adapted to any kind of trace format. Another DIMVivual module is able to translate MPI trace files. Since the Pajé format is generic [5], this makes the prototype independent of the specific trace format generated by the parallel application (the DIMVisual module is the only trace-dependent part). The events flow generated by the DIMVisual module is fetched to the Pajé Simulator. This simulator transforms the events into an internal hierarchical structure that stores visual objects. The simulator keeps track of visual objects creation or modification to notify the visualization module. Each time it receives a new notification, the visualization module queries the simulator for a new set of objects that should be rendered. The query response passes through an extractor module which splits the answer into a set of relevant objects and their topological information. The topological information is processed using the Graphviz library [6] in order to find a suitable layout for entities. Graphviz is a graph drawing library which implements complex algorithms to avoid crossed links. It is able to take some constraints into account (such as nodes grouping into some drawing area) and propose several drawing algorithms that optimize various criteria. The final positioning computed by Graphviz is then sent to the visualizer to render the complete 3D scene. The visualizer component uses Ogre3D [14] as scene rendering and graphical objects management library. The component takes into account the information generated by the Graphviz module to place the visual objects relative to the base of the three dimensional visualization. The vertical coordinates are completed using objects timing information and scene time scale. The resulting visualization is presented in figures 12, 13, 14 and 15. Fig. 8. Visualizer Prototype implementation components of the 3D visualization tool. IV. EXPERIMENTAL RESULTS The results shown in this section are screenshots of our prototype in action when visualizing traces collected from an application running on Grid5000. A Pajé [5] screenshot is also given as a comparison to emphasize the difference between the 3D approach and Gantt charts. Two actual parallel applications have been used to generate the visualized data. The first application is a very basic MPI application example used to outline the benefit of the 3D approach over traditional visualization systems, such as Gantt Charts. The second application is a Fibonacci solver developed using the KAAPI library [10]. Both applications have been traced with instrumented versions of the communication libraries. In the specific case of the Fibonacci application, the traces have been collected using built-in trace levels offered by the KAAPI library. These tracing facilities are very convenient to extract more or less detailed views from any KAAPI application execution. Finally, for the sake of demonstrating our prototype capabilities, we automatically generated peculiar synthetic traces (noticeable topologies, larger size). These traces provide an overview of the behavior of our prototype when tracing an application specifically designed for a lightweight grid. For these last round of experiments we did not use KAAPI which is currently not able to handle hierarchical platforms nicely. The first experiment compares the Gantt Chart visualization with the three dimensional approach. The application considered is a five processes MPI token ring executed with an instrumented version of the library that is capable of registering events. Figure 9 shows the visualization of the program behavior using a Gantt Chart generated by the Pajé visualization tool. Communications are represented by arrows and the different rectangles with various gray tones show the different states of each process. Using our 3D prototype, we first visualized the same traces using a linear layout. As we can see in figure 10, the traditional 2D approach is obviously a subset of the visualizations we can obtain with the 3D approach. Indeed, in this figure, we have just plunged the 2D view into a 3D space. A significant advantage of the 3D approach is related to the

6 Fig. 9. Gantt-chart visualization with Pajé. Fig. 11. Top view of a MPI application with 5 processes, the ring communication pattern can be easily seen. Fig D Triva visualization of the same trace shown in figure 9. visualization of communications: they can be represented more cleanly and their topology is outlined. Using traditional two dimensional visualization systems, communications, usually represented as arrows, often cross over other visual elements. For instance, in figure 9, due to the ring constituted by the communications made by the application, some arrows cross the state line of all processes. When dealing with a large amount of data, the visual perception of such communication patterns can become tedious. This is not the case when using cleverly the 3D approach. Figure 11 shows the same application trace along with a proper choice of elements layout and camera position. In this figure, no communication link cross over another visual element, and the communication pattern appears clearly. Figure 12 shows the visualization of a parallel application developed with the KAAPI parallel programming library. This application is composed by 20 nodes, divided among 4 sites. The lines connecting the processes represent successful work stealing requests (work stealing and the associated traces is provided by the library). We can notice that the application pass through an inter-site work stealing phase at the beginning and at the end of its execution. In the middle of the execution, the work stealing remains local (which is rather good). This Fig. 12. Work stealing visualization of a Fibonacci parallel application with 20 processes in two sites of a Grid. example shows that the visualization can help in the process of refining work stealing algorithms. The parallel application analysis can be increasingly more complex when communications follow more elaborated patterns. Some parallel applications use different communication algorithms in different levels of the parallel architecture (shared memory, inter-process communication, TCP communications,...). This happens often in Grid architectures when the algorithm communicates both internally in virtual organizations and between two or more administrative domains. Figure 13 shows a simple synthetic parallel application composed of 12 processes being executed in three different administrative domains. The processes are grouped geographically according to their domain and communications between domains pass through a front-end node. A similar situation is presented in figures 14 and 15, but with different communication patterns. For instance, figure 14 is a visualization of a parallel application involving 50 processes, divided equally among 5 different

7 sites. The visualization clearly shows the ring communication pattern inside each site and a star communication among processes that work as front-ends. The visualization can help, in this case, to detect possible bottlenecks caused by a specific communication pattern. Our rendering model has been designed to render interactive traces: evolution of the application can be monitored in real time. In its current state, our prototype, only handles post mortem traces. Nevertheless, the rendering process iterates through time (at selectable pace) and it is possible to pause the events processing in order to analyze the application state at some peculiar point of the execution. The user can also select a time slice and the prototype reconstructs the visualization eliminating irrelevant objects. there is a processes that acts as an application s front-end for that site; the second level relates to front-ends communications between the application s master processes. The 3D visualization provides a clear view of these two levels and enables the developer to identify communication or load unbalances. This problem detection is eased by the combined rendering of processes topology and their state evolution through time. Fig. 15. Visualization of an application with 600 processes, divided in 6 sites with 100 processes each. Fig. 13. Visualization of an application executing in 3 different sites, using 4 nodes per site. Fig. 14. Visualization of an application composed by 50 processes, executing in 5 sites with 10 processes each. Figure 15 shows a larger scale master-slave parallel application, composed of 600 nodes divided equally in 6 sites. In this application, there are two levels of communication: the first level relates to communications inside each site where V. RELATED WORK Several visualization tools have been developed to support performance analysis of parallel applications. Some of them already makes use of three dimensional rendering. Open- Mosix [2], for example, offers a 3D visualization tool called 3dmosmon that shows resources usage. The base is used to place the monitored resources and the vertical axis represents the metric currently being analyzed. The vertical size of each visual object corresponds to the value of the metric for that object. GridPP Real Time Monitor [11] is another example of similar three dimensional graphical visualization tool that shows the resources distributed in a globe. The resources are placed in the visualization base following their geographical location. Both approaches differ from ours because their 3D visualization does not use the vertical axis to represent the application evolution along time. Furthermore they do not enable user to visually relate application behavior with platform topology. Nevertheless, notice that the regional or global map in GridPP can also be applied to our prototype by replacing the Graphviz module by a component that returns fixed locations in the visualization base. Virtue [24] is another tool that offers the user an immersive three dimensional visualization. This tool connects to Autopilot [20] to receive its monitoring data and helps the performance analysis by trying to enhance rendering with human sensory capabilities. It offers three types of 3D visualization: wide-area geographic display, which is very similar to the one present in GridPP, where nodes are placed following their geographic location; time-tunnel display which shows a

8 visualization inside a cylinder where the internal part of the cylinder is used to represent processors state evolution over time and chords illustrate cross-process interactions; and callgraph display, which show in a 3D space what functions were executed and the call procedures between them. The timetunnel display is similar to our approach, since it has one axis to represent time. However, the other two dimensions of this display are not used to show configurable topological information, as we do in our approach, showing instead the processes organized in a (still linear) circular view. Paradyn [1] is a performance visualization tool that has a 3D-Trace/Space/Time diagram. The visualization is able to show processes stack traces of a parallel job in order to detect odd behaviors. This visualization has three data dimensions: trace, space and time but the resources are still represented in a linear space and visualized using 2D graphics. VI. CONCLUSION This paper presented new ideas to draw complex information gathered by grid monitoring tools. The objective of this work is to organize the drawing of information in a way that highlight main parallel applications and Grids characteristics. Some of these characteristics that are of particular importance are hierarchical organization, complex topology and heterogeneity. To achieve our goal, we first reviewed techniques used in the field of information visualization. We focused especially on techniques used to visualize hierarchical information and relations between hierarchically organized entities. Theses techniques are mainly constituted of treemaps and its variants. Our main proposition is to plunge the classical Gantt chart space time visualization into a 3D space. One of the three dimensional space axis is used to represent the time flow. The other dimensions are then available for resources representation, using treemaps or graph topology. The events (processes start, communications and termination) are placed in this 3D space: at the time they occur and on the appropriate place on the resources space. Moving into this 3D representation enables the user to actually see parts of the grid that cause trouble related to the application execution flow. Other works related to Grid monitoring information visualization either use some basic treemaps without plugging them into a 3D space, do not perform space-time visualization or use classical 2D Gantt charts. Our approach is the first, to our knowledge, to combine in a 3D space Gantt charts like visualization with topological space representation. Future work consists in improvements of the basis of the 3D visualization prototype with treemaps and network organization, and additions of advanced user interaction mechanisms. REFERENCES [1] D. C. Arnold, D. H. Ahn, B. R. de Supinski, G. L. Lee, B. P. Miller, and M. Schulz, Stack trace analysis for large scale debugging, in IPDPS 2007: Proceedings of the 2007 International Parallel and Distributed Processing Symposium. Los Alamitos, CA, USA: IEEE Computer Society, 2007, p. 64. [2] J. Cache, The 3dmosmon, [Online]. Available: [3] F. Capello, B. Plateau, T. Priol, D. Vandromme, F. Cappello, M. Dayde, F. Desprez, E. Jeannot, Y. Jegou, S. Lanteri, N. Melab, R. Namyst, M. Quinson, O. Richard, and P. V.-B. Primet, Grid5000, February 2007, Last accessed February, 26, [4] M. Carpendale, D. Cowperthwaite, and F. Fracchia, Extending Distortion Viewing from 2D to 3D, IEEE Computer Graphics and Applications, vol. 17, no. 4, pp , [5] J. de Kergommeaux, B. Stein, and P. Bernard, Paje, an interactive visualization tool for tuning multi-threaded parallel applications, Parallel Computing, vol. 26, no. 10, pp , [6] J. Ellson, E. Gansner, L. Koutsofios, N. S. C., and G. Woodhull, Graphviz Open Source Graph Drawing Tools. Springer Berlin / Heidelberg, 2002, vol. 2265/2002, pp [7] J. Fekete, D. Wang, N. Dang, A. Aris, and C. Plaisant, Overlaying Graph Links on Treemaps, in Proceedings of IEEE Information Visualization Symposium Posters Compendium, [8] I. Foster, C. Kesselman, and S. Tuecke, The Anatomy of the Grid: Enabling Scalable Virtual Organizations, International Journal of High Performance Computing Applications, vol. 15, no. 3, pp , [9] E. R. Gansner and S. C. North, An open graph visualization system and its applications to software engineering, Software Practice and Experience, vol. 30, no. 11, pp , [Online]. Available: citeseer.ist.psu.edu/gansner99open.html [10] T. Gautier, X. Besseron, and L. Pigeon, Kaapi: A thread scheduling runtime system for data flow computations on cluster of multi-processors, in PASCO 07: Proceedings of the 2007 international workshop on Parallel symbolic computation. New York, NY, USA: ACM, 2007, pp [11] GridPP, Gridpp real time monitor, [Online]. Available: [12] D. Holten, Hierarchical edge bundles: visualization of adjacency relations in hierarchical data. IEEE Trans Vis Comput Graph, vol. 12, no. 5, pp , [13] B. Johnson and B. Shneiderman, Tree-Maps: a space-filling approach to the visualization of hierarchical information structures. IEEE Computer Society Press Los Alamitos, CA, USA, [14] G. Junker, Pro OGRE 3D Programming (Pro). Berkely, CA, USA: Apress, [15] I. Kazi, D. Jose, B. Ben-Hamida, C. Hescott, C. Kwok, J. Konstan, D. Lilja, and P. Yew, JaViz: A client/server Java profiling tool, IBM Systems Journal, vol. 39, no. 1, pp , [16] A. Malony, D. Hammerslag, and D. Jablonowski, Traceview: a trace visualization tool, Software, IEEE, vol. 8, no. 5, pp , [17] S. Mansmann, F.; Vinnik, Interactive exploration of data traffic with hierarchical network maps, IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 6, pp , Nov-Dec [18] W. Nagel, A. Arnold, M. Weber, H. Hoppe, and K. Solchenbach, VAM- PIR: Visualization and Analysis of MPI Resources, Supercomputer, vol. 12, no. 1, pp , [19] G. Nagy and S. Seth, Hierarchical representation of optically scanned documents, in Proceedings of International Conference on Pattern Recognition, vol. 1, 1984, pp [20] R. L. Ribler, J. S. Vetter, H. Simitci, and D. A. Reed, Autopilot: Adaptive control of distributed applications, in HPDC 98: Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing. Washington, DC, USA: IEEE Computer Society, 1998, p [21] S. Saengsuwarn and V. Pai, Coviz - visualization of planetlab project, February 2007, Last accessed February, 20, [22] M. Sarkar and M. H. Brown, Graphical fisheye views, Commun. ACM, vol. 37, no. 12, pp , [23] L. M. Schnorr, P. O. A. Navaux, and B. de Oliveira Stein, Dimvisual: Data integration model for visualization of parallel programs behavior, in CCGRID 06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID 06). Washington, DC, USA: IEEE Computer Society, 2006, pp [24] E. Shaffer, D. A. Reed, S. Whitmore, and B. Schaeffer, Virtue: Performance visualization of parallel and distributed applications, Computer, vol. 32, no. 12, pp , [25] M. Wattenberg, Visualizing the stock market, in CHI 99: CHI 99 extended abstracts on Human factors in computing systems. New York, NY, USA: ACM Press, 1999, pp

Ressources management and runtime environments in the exascale computing era

Ressources management and runtime environments in the exascale computing era Ressources management and runtime environments in the exascale computing era Guillaume Huard MOAIS and MESCAL INRIA Projects CNRS LIG Laboratory Grenoble University, France Guillaume Huard MOAIS and MESCAL

More information

Pajé: An Extensible Environment for Visualizing Multi-threaded Programs Executions

Pajé: An Extensible Environment for Visualizing Multi-threaded Programs Executions Pajé: An Extensible Environment for Visualizing Multi-threaded Programs Executions Jacques Chassin de Kergommeaux 1 and Benhur de Oliveira Stein 2 1 ID-IMAG, ENSIMAG - antenne de Montbonnot, ZIRST, 51,

More information

HierarchyMap: A Novel Approach to Treemap Visualization of Hierarchical Data

HierarchyMap: A Novel Approach to Treemap Visualization of Hierarchical Data P a g e 77 Vol. 9 Issue 5 (Ver 2.0), January 2010 Global Journal of Computer Science and Technology HierarchyMap: A Novel Approach to Treemap Visualization of Hierarchical Data Abstract- The HierarchyMap

More information

Integration of the OCM-G Monitoring System into the MonALISA Infrastructure

Integration of the OCM-G Monitoring System into the MonALISA Infrastructure Integration of the OCM-G Monitoring System into the MonALISA Infrastructure W lodzimierz Funika, Bartosz Jakubowski, and Jakub Jaroszewski Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059,

More information

Treemaps for Search-Tree Visualization

Treemaps for Search-Tree Visualization Treemaps for Search-Tree Visualization Rémi Coulom July, 2002 Abstract Large Alpha-Beta search trees generated by game-playing programs are hard to represent graphically. This paper describes how treemaps

More information

JRastro: A Trace Agent for Debugging Multithreaded and Distributed Java Programs

JRastro: A Trace Agent for Debugging Multithreaded and Distributed Java Programs JRastro: A Trace Agent for Debugging Multithreaded and Distributed Java Programs Gabriela Jacques da Silva 1, Lucas Mello Schnorr 1, Benhur de Oliveira Stein 1 1 Laboratório de Sistemas de Computação Universidade

More information

Component visualization methods for large legacy software in C/C++

Component visualization methods for large legacy software in C/C++ Annales Mathematicae et Informaticae 44 (2015) pp. 23 33 http://ami.ektf.hu Component visualization methods for large legacy software in C/C++ Máté Cserép a, Dániel Krupp b a Eötvös Loránd University mcserep@caesar.elte.hu

More information

Voronoi Treemaps in D3

Voronoi Treemaps in D3 Voronoi Treemaps in D3 Peter Henry University of Washington phenry@gmail.com Paul Vines University of Washington paul.l.vines@gmail.com ABSTRACT Voronoi treemaps are an alternative to traditional rectangular

More information

Graph/Network Visualization

Graph/Network Visualization Graph/Network Visualization Data model: graph structures (relations, knowledge) and networks. Applications: Telecommunication systems, Internet and WWW, Retailers distribution networks knowledge representation

More information

Visual Support for Analyzing Network Traffic and Intrusion Detection Events using TreeMap and Graph Representations

Visual Support for Analyzing Network Traffic and Intrusion Detection Events using TreeMap and Graph Representations Visual Support for Analyzing Network Traffic and Intrusion Detection Events using TreeMap and Graph Representations Florian Mansmann 1 Fabian Fischer 1 Daniel A. Keim 1 Stephen C. North 2 1 University

More information

Hierarchy and Tree Visualization

Hierarchy and Tree Visualization Hierarchy and Tree Visualization Definition Hierarchies An ordering of groups in which larger groups encompass sets of smaller groups. Data repository in which cases are related to subcases Hierarchical

More information

Hierarchical Data Visualization. Ai Nakatani IAT 814 February 21, 2007

Hierarchical Data Visualization. Ai Nakatani IAT 814 February 21, 2007 Hierarchical Data Visualization Ai Nakatani IAT 814 February 21, 2007 Introduction Hierarchical Data Directory structure Genealogy trees Biological taxonomy Business structure Project structure Challenges

More information

Space-filling Techniques in Visualizing Output from Computer Based Economic Models

Space-filling Techniques in Visualizing Output from Computer Based Economic Models Space-filling Techniques in Visualizing Output from Computer Based Economic Models Richard Webber a, Ric D. Herbert b and Wei Jiang bc a National ICT Australia Limited, Locked Bag 9013, Alexandria, NSW

More information

Distributed Dynamic Load Balancing for Iterative-Stencil Applications

Distributed Dynamic Load Balancing for Iterative-Stencil Applications Distributed Dynamic Load Balancing for Iterative-Stencil Applications G. Dethier 1, P. Marchot 2 and P.A. de Marneffe 1 1 EECS Department, University of Liege, Belgium 2 Chemical Engineering Department,

More information

Flauncher and DVMS Deploying and Scheduling Thousands of Virtual Machines on Hundreds of Nodes Distributed Geographically

Flauncher and DVMS Deploying and Scheduling Thousands of Virtual Machines on Hundreds of Nodes Distributed Geographically Flauncher and Deploying and Scheduling Thousands of Virtual Machines on Hundreds of Nodes Distributed Geographically Daniel Balouek, Adrien Lèbre, Flavien Quesnel To cite this version: Daniel Balouek,

More information

Hierarchical Data Visualization

Hierarchical Data Visualization Hierarchical Data Visualization 1 Hierarchical Data Hierarchical data emphasize the subordinate or membership relations between data items. Organizational Chart Classifications / Taxonomies (Species and

More information

Performance Monitoring and Visualization of Large-Sized and Multi- Threaded Applications with the Pajé Framework

Performance Monitoring and Visualization of Large-Sized and Multi- Threaded Applications with the Pajé Framework Performance Monitoring and Visualization of Large-Sized and Multi- Threaded Applications with the Pajé Framework Mehdi Kessis France Télécom R&D {Mehdi.kessis}@rd.francetelecom.com Jean-Marc Vincent Laboratoire

More information

NakeDB: Database Schema Visualization

NakeDB: Database Schema Visualization NAKEDB: DATABASE SCHEMA VISUALIZATION, APRIL 2008 1 NakeDB: Database Schema Visualization Luis Miguel Cortés-Peña, Yi Han, Neil Pradhan, Romain Rigaux Abstract Current database schema visualization tools

More information

A Survey Study on Monitoring Service for Grid

A Survey Study on Monitoring Service for Grid A Survey Study on Monitoring Service for Grid Erkang You erkyou@indiana.edu ABSTRACT Grid is a distributed system that integrates heterogeneous systems into a single transparent computer, aiming to provide

More information

Performance Visualization for Large-Scale Computing Systems: A Literature Review

Performance Visualization for Large-Scale Computing Systems: A Literature Review Performance Visualization for Large-Scale Computing Systems: A Literature Review Qin Gao 1, Xuhui Zhang 1, Pei-Luen Patrick Rau 1, Anthony A. Maciejewski 2, and Howard Jay Siegel 2,3 1 Department of Industrial

More information

What is Visualization? Information Visualization An Overview. Information Visualization. Definitions

What is Visualization? Information Visualization An Overview. Information Visualization. Definitions What is Visualization? Information Visualization An Overview Jonathan I. Maletic, Ph.D. Computer Science Kent State University Visualize/Visualization: To form a mental image or vision of [some

More information

Visualization methods for patent data

Visualization methods for patent data Visualization methods for patent data Treparel 2013 Dr. Anton Heijs (CTO & Founder) Delft, The Netherlands Introduction Treparel can provide advanced visualizations for patent data. This document describes

More information

Online Performance Observation of Large-Scale Parallel Applications

Online Performance Observation of Large-Scale Parallel Applications 1 Online Observation of Large-Scale Parallel Applications Allen D. Malony and Sameer Shende and Robert Bell {malony,sameer,bertie}@cs.uoregon.edu Department of Computer and Information Science University

More information

Clustering & Visualization

Clustering & Visualization Chapter 5 Clustering & Visualization Clustering in high-dimensional databases is an important problem and there are a number of different clustering paradigms which are applicable to high-dimensional data.

More information

VisCG: Creating an Eclipse Call Graph Visualization Plug-in. Kenta Hasui, Undergraduate Student at Vassar College Class of 2015

VisCG: Creating an Eclipse Call Graph Visualization Plug-in. Kenta Hasui, Undergraduate Student at Vassar College Class of 2015 VisCG: Creating an Eclipse Call Graph Visualization Plug-in Kenta Hasui, Undergraduate Student at Vassar College Class of 2015 Abstract Call graphs are a useful tool for understanding software; however,

More information

TEXT-FILLED STACKED AREA GRAPHS Martin Kraus

TEXT-FILLED STACKED AREA GRAPHS Martin Kraus Martin Kraus Text can add a significant amount of detail and value to an information visualization. In particular, it can integrate more of the data that a visualization is based on, and it can also integrate

More information

Visualization of Software Metrics Marlena Compton Software Metrics SWE 6763 April 22, 2009

Visualization of Software Metrics Marlena Compton Software Metrics SWE 6763 April 22, 2009 Visualization of Software Metrics Marlena Compton Software Metrics SWE 6763 April 22, 2009 Abstract Visualizations are increasingly used to assess the quality of source code. One of the most well developed

More information

FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data

FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data Miguel Liroz-Gistau, Reza Akbarinia, Patrick Valduriez To cite this version: Miguel Liroz-Gistau, Reza Akbarinia, Patrick Valduriez. FP-Hadoop:

More information

Topic Maps Visualization

Topic Maps Visualization Topic Maps Visualization Bénédicte Le Grand, Laboratoire d'informatique de Paris 6 Introduction Topic maps provide a bridge between the domains of knowledge representation and information management. Topics

More information

Text Mining Approach for Big Data Analysis Using Clustering and Classification Methodologies

Text Mining Approach for Big Data Analysis Using Clustering and Classification Methodologies Text Mining Approach for Big Data Analysis Using Clustering and Classification Methodologies Somesh S Chavadi 1, Dr. Asha T 2 1 PG Student, 2 Professor, Department of Computer Science and Engineering,

More information

Remote Graphical Visualization of Large Interactive Spatial Data

Remote Graphical Visualization of Large Interactive Spatial Data Remote Graphical Visualization of Large Interactive Spatial Data ComplexHPC Spring School 2011 International ComplexHPC Challenge Cristinel Mihai Mocan Computer Science Department Technical University

More information

Visualization Techniques in Data Mining

Visualization Techniques in Data Mining Tecniche di Apprendimento Automatico per Applicazioni di Data Mining Visualization Techniques in Data Mining Prof. Pier Luca Lanzi Laurea in Ingegneria Informatica Politecnico di Milano Polo di Milano

More information

Scalable monitoring and configuration tools for grids and clusters

Scalable monitoring and configuration tools for grids and clusters Scalable monitoring and configuration tools for grids and clusters Philippe Augerat 1, Cyrill Martin 2, Benhur Stein 3 1 INPG, ID laboratory, Grenoble 2 BULL, INRIA, ID laboratory, Grenoble 3 UFSM, Santa-Maria,

More information

End-user Tools for Application Performance Analysis Using Hardware Counters

End-user Tools for Application Performance Analysis Using Hardware Counters 1 End-user Tools for Application Performance Analysis Using Hardware Counters K. London, J. Dongarra, S. Moore, P. Mucci, K. Seymour, T. Spencer Abstract One purpose of the end-user tools described in

More information

Distributed communication-aware load balancing with TreeMatch in Charm++

Distributed communication-aware load balancing with TreeMatch in Charm++ Distributed communication-aware load balancing with TreeMatch in Charm++ The 9th Scheduling for Large Scale Systems Workshop, Lyon, France Emmanuel Jeannot Guillaume Mercier Francois Tessier In collaboration

More information

Scalability and Classifications

Scalability and Classifications Scalability and Classifications 1 Types of Parallel Computers MIMD and SIMD classifications shared and distributed memory multicomputers distributed shared memory computers 2 Network Topologies static

More information

LaPIe: Collective Communications adapted to Grid Environments

LaPIe: Collective Communications adapted to Grid Environments LaPIe: Collective Communications adapted to Grid Environments Luiz Angelo Barchet-Estefanel Thesis Supervisor: M Denis TRYSTRAM Co-Supervisor: M Grégory MOUNIE ID-IMAG Laboratory Grenoble - France LaPIe:

More information

Centralized Systems. A Centralized Computer System. Chapter 18: Database System Architectures

Centralized Systems. A Centralized Computer System. Chapter 18: Database System Architectures Chapter 18: Database System Architectures Centralized Systems! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types! Run on a single computer system and do

More information

VISUALIZING HIERARCHICAL DATA. Graham Wills SPSS Inc., http://willsfamily.org/gwills

VISUALIZING HIERARCHICAL DATA. Graham Wills SPSS Inc., http://willsfamily.org/gwills VISUALIZING HIERARCHICAL DATA Graham Wills SPSS Inc., http://willsfamily.org/gwills SYNONYMS Hierarchical Graph Layout, Visualizing Trees, Tree Drawing, Information Visualization on Hierarchies; Hierarchical

More information

Operating System Multilevel Load Balancing

Operating System Multilevel Load Balancing Operating System Multilevel Load Balancing M. Corrêa, A. Zorzo Faculty of Informatics - PUCRS Porto Alegre, Brazil {mcorrea, zorzo}@inf.pucrs.br R. Scheer HP Brazil R&D Porto Alegre, Brazil roque.scheer@hp.com

More information

Chapter 18: Database System Architectures. Centralized Systems

Chapter 18: Database System Architectures. Centralized Systems Chapter 18: Database System Architectures! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types 18.1 Centralized Systems! Run on a single computer system and

More information

System Interconnect Architectures. Goals and Analysis. Network Properties and Routing. Terminology - 2. Terminology - 1

System Interconnect Architectures. Goals and Analysis. Network Properties and Routing. Terminology - 2. Terminology - 1 System Interconnect Architectures CSCI 8150 Advanced Computer Architecture Hwang, Chapter 2 Program and Network Properties 2.4 System Interconnect Architectures Direct networks for static connections Indirect

More information

Agenda. TreeMaps. What is a Treemap? Basics

Agenda. TreeMaps. What is a Treemap? Basics Agenda TreeMaps What is a Treemap? Treemap Basics Original Treemap Algorithm (Slice-and-dice layout) Issues for Treemaps Cushion Treemaps Squarified Treemaps Ordered Treemaps Quantum Treemaps Other Treemaps

More information

Chapter 15: Distributed Structures. Topology

Chapter 15: Distributed Structures. Topology 1 1 Chapter 15: Distributed Structures Topology Network Types Operating System Concepts 15.1 Topology Sites in the system can be physically connected in a variety of ways; they are compared with respect

More information

Tree Visualization with Tree-Maps: 2-d Space-Filling Approach

Tree Visualization with Tree-Maps: 2-d Space-Filling Approach I THE INTERACTION TECHNIQUE NOTEBOOK I Tree Visualization with Tree-Maps: 2-d Space-Filling Approach Ben Shneiderman University of Maryland Introduction. The traditional approach to representing tree structures

More information

How To Visualize Performance Data In A Computer Program

How To Visualize Performance Data In A Computer Program Performance Visualization Tools 1 Performance Visualization Tools Lecture Outline : Following Topics will be discussed Characteristics of Performance Visualization technique Commercial and Public Domain

More information

Visualizing Large Graphs with Compound-Fisheye Views and Treemaps

Visualizing Large Graphs with Compound-Fisheye Views and Treemaps Visualizing Large Graphs with Compound-Fisheye Views and Treemaps James Abello 1, Stephen G. Kobourov 2, and Roman Yusufov 2 1 DIMACS Center Rutgers University {abello}@dimacs.rutgers.edu 2 Department

More information

Parallel Ray Tracing using MPI: A Dynamic Load-balancing Approach

Parallel Ray Tracing using MPI: A Dynamic Load-balancing Approach Parallel Ray Tracing using MPI: A Dynamic Load-balancing Approach S. M. Ashraful Kadir 1 and Tazrian Khan 2 1 Scientific Computing, Royal Institute of Technology (KTH), Stockholm, Sweden smakadir@csc.kth.se,

More information

MapCenter: An Open Grid Status Visualization Tool

MapCenter: An Open Grid Status Visualization Tool MapCenter: An Open Grid Status Visualization Tool Franck Bonnassieux Robert Harakaly Pascale Primet UREC CNRS UREC CNRS RESO INRIA ENS Lyon, France ENS Lyon, France ENS Lyon, France franck.bonnassieux@ens-lyon.fr

More information

Cellular Computing on a Linux Cluster

Cellular Computing on a Linux Cluster Cellular Computing on a Linux Cluster Alexei Agueev, Bernd Däne, Wolfgang Fengler TU Ilmenau, Department of Computer Architecture Topics 1. Cellular Computing 2. The Experiment 3. Experimental Results

More information

The Complete Performance Solution for Microsoft SQL Server

The Complete Performance Solution for Microsoft SQL Server The Complete Performance Solution for Microsoft SQL Server Powerful SSAS Performance Dashboard Innovative Workload and Bottleneck Profiling Capture of all Heavy MDX, XMLA and DMX Aggregation, Partition,

More information

Performance Monitoring of Parallel Scientific Applications

Performance Monitoring of Parallel Scientific Applications Performance Monitoring of Parallel Scientific Applications Abstract. David Skinner National Energy Research Scientific Computing Center Lawrence Berkeley National Laboratory This paper introduces an infrastructure

More information

Big Data: Rethinking Text Visualization

Big Data: Rethinking Text Visualization Big Data: Rethinking Text Visualization Dr. Anton Heijs anton.heijs@treparel.com Treparel April 8, 2013 Abstract In this white paper we discuss text visualization approaches and how these are important

More information

A Simultaneous Solution for General Linear Equations on a Ring or Hierarchical Cluster

A Simultaneous Solution for General Linear Equations on a Ring or Hierarchical Cluster Acta Technica Jaurinensis Vol. 3. No. 1. 010 A Simultaneous Solution for General Linear Equations on a Ring or Hierarchical Cluster G. Molnárka, N. Varjasi Széchenyi István University Győr, Hungary, H-906

More information

Towards Analytical Data Management for Numerical Simulations

Towards Analytical Data Management for Numerical Simulations Towards Analytical Data Management for Numerical Simulations Ramon G. Costa, Fábio Porto, Bruno Schulze {ramongc, fporto, schulze}@lncc.br National Laboratory for Scientific Computing - RJ, Brazil Abstract.

More information

RETRATOS: Requirement Traceability Tool Support

RETRATOS: Requirement Traceability Tool Support RETRATOS: Requirement Traceability Tool Support Gilberto Cysneiros Filho 1, Maria Lencastre 2, Adriana Rodrigues 2, Carla Schuenemann 3 1 Universidade Federal Rural de Pernambuco, Recife, Brazil g.cysneiros@gmail.com

More information

A Pattern-Based Approach to. Automated Application Performance Analysis

A Pattern-Based Approach to. Automated Application Performance Analysis A Pattern-Based Approach to Automated Application Performance Analysis Nikhil Bhatia, Shirley Moore, Felix Wolf, and Jack Dongarra Innovative Computing Laboratory University of Tennessee (bhatia, shirley,

More information

Process Modelling from Insurance Event Log

Process Modelling from Insurance Event Log Process Modelling from Insurance Event Log P.V. Kumaraguru Research scholar, Dr.M.G.R Educational and Research Institute University Chennai- 600 095 India Dr. S.P. Rajagopalan Professor Emeritus, Dr. M.G.R

More information

MapReduce on GPUs. Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu

MapReduce on GPUs. Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu 1 MapReduce on GPUs Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu 2 MapReduce MAP Shuffle Reduce 3 Hadoop Open-source MapReduce framework from Apache, written in Java Used by Yahoo!, Facebook, Ebay,

More information

Agenda. Distributed System Structures. Why Distributed Systems? Motivation

Agenda. Distributed System Structures. Why Distributed Systems? Motivation Agenda Distributed System Structures CSCI 444/544 Operating Systems Fall 2008 Motivation Network structure Fundamental network services Sockets and ports Client/server model Remote Procedure Call (RPC)

More information

A Cloud Monitoring Framework for Self-Configured Monitoring Slices Based on Multiple Tools

A Cloud Monitoring Framework for Self-Configured Monitoring Slices Based on Multiple Tools A Cloud Monitoring Framework for Self-Configured Monitoring Slices Based on Multiple Tools Márcio Barbosa de Carvalho, Rafael Pereira Esteves, Guilherme da Cunha Rodrigues, Lisandro Zambenedetti Granville,

More information

Software Life-Cycle Management

Software Life-Cycle Management Ingo Arnold Department Computer Science University of Basel Theory Software Life-Cycle Management Architecture Styles Overview An Architecture Style expresses a fundamental structural organization schema

More information

DATA LAYOUT AND LEVEL-OF-DETAIL CONTROL FOR FLOOD DATA VISUALIZATION

DATA LAYOUT AND LEVEL-OF-DETAIL CONTROL FOR FLOOD DATA VISUALIZATION DATA LAYOUT AND LEVEL-OF-DETAIL CONTROL FOR FLOOD DATA VISUALIZATION Sayaka Yagi Takayuki Itoh Ochanomizu University Mayumi Kurokawa Yuuichi Izu Takahisa Yoneyama Takashi Kohara Toshiba Corporation ABSTRACT

More information

BSC vision on Big Data and extreme scale computing

BSC vision on Big Data and extreme scale computing BSC vision on Big Data and extreme scale computing Jesus Labarta, Eduard Ayguade,, Fabrizio Gagliardi, Rosa M. Badia, Toni Cortes, Jordi Torres, Adrian Cristal, Osman Unsal, David Carrera, Yolanda Becerra,

More information

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Sébastien Badia, Alexandra Carpen-Amarie, Adrien Lèbre, Lucas Nussbaum Grid 5000 S. Badia, A. Carpen-Amarie, A. Lèbre, L. Nussbaum

More information

VISUALIZATION TECHNIQUES OF COMPONENTS FOR LARGE LEGACY C/C++ SOFTWARE

VISUALIZATION TECHNIQUES OF COMPONENTS FOR LARGE LEGACY C/C++ SOFTWARE STUDIA UNIV. BABEŞ BOLYAI, INFORMATICA, Volume LIX, Special Issue 1, 2014 10th Joint Conference on Mathematics and Computer Science, Cluj-Napoca, May 21-25, 2014 VISUALIZATION TECHNIQUES OF COMPONENTS

More information

The EMSX Platform. A Modular, Scalable, Efficient, Adaptable Platform to Manage Multi-technology Networks. A White Paper.

The EMSX Platform. A Modular, Scalable, Efficient, Adaptable Platform to Manage Multi-technology Networks. A White Paper. The EMSX Platform A Modular, Scalable, Efficient, Adaptable Platform to Manage Multi-technology Networks A White Paper November 2002 Abstract: The EMSX Platform is a set of components that together provide

More information

In: Proceedings of RECPAD 2002-12th Portuguese Conference on Pattern Recognition June 27th- 28th, 2002 Aveiro, Portugal

In: Proceedings of RECPAD 2002-12th Portuguese Conference on Pattern Recognition June 27th- 28th, 2002 Aveiro, Portugal Paper Title: Generic Framework for Video Analysis Authors: Luís Filipe Tavares INESC Porto lft@inescporto.pt Luís Teixeira INESC Porto, Universidade Católica Portuguesa lmt@inescporto.pt Luís Corte-Real

More information

Junghyun Ahn Changho Sung Tag Gon Kim. Korea Advanced Institute of Science and Technology (KAIST) 373-1 Kuseong-dong, Yuseong-gu Daejoen, Korea

Junghyun Ahn Changho Sung Tag Gon Kim. Korea Advanced Institute of Science and Technology (KAIST) 373-1 Kuseong-dong, Yuseong-gu Daejoen, Korea Proceedings of the 211 Winter Simulation Conference S. Jain, R. R. Creasey, J. Himmelspach, K. P. White, and M. Fu, eds. A BINARY PARTITION-BASED MATCHING ALGORITHM FOR DATA DISTRIBUTION MANAGEMENT Junghyun

More information

By LaBRI INRIA Information Visualization Team

By LaBRI INRIA Information Visualization Team By LaBRI INRIA Information Visualization Team Tulip 2011 version 3.5.0 Tulip is an information visualization framework dedicated to the analysis and visualization of data. Tulip aims to provide the developer

More information

Multi-Channel Clustered Web Application Servers

Multi-Channel Clustered Web Application Servers THE AMERICAN UNIVERSITY IN CAIRO SCHOOL OF SCIENCES AND ENGINEERING Multi-Channel Clustered Web Application Servers A Masters Thesis Department of Computer Science and Engineering Status Report Seminar

More information

Resource Allocation Schemes for Gang Scheduling

Resource Allocation Schemes for Gang Scheduling Resource Allocation Schemes for Gang Scheduling B. B. Zhou School of Computing and Mathematics Deakin University Geelong, VIC 327, Australia D. Walsh R. P. Brent Department of Computer Science Australian

More information

An example. Visualization? An example. Scientific Visualization. This talk. Information Visualization & Visual Analytics. 30 items, 30 x 3 values

An example. Visualization? An example. Scientific Visualization. This talk. Information Visualization & Visual Analytics. 30 items, 30 x 3 values Information Visualization & Visual Analytics Jack van Wijk Technische Universiteit Eindhoven An example y 30 items, 30 x 3 values I-science for Astronomy, October 13-17, 2008 Lorentz center, Leiden x An

More information

Ordered Treemap Layouts

Ordered Treemap Layouts Ordered Treemap Layouts Ben Shneiderman Department of Computer Science, Human-Computer Interaction Lab, Insitute for Advanced Computer Studies & Institute for Systems Research University of Maryland ben@cs.umd.edu

More information

STUDY AND SIMULATION OF A DISTRIBUTED REAL-TIME FAULT-TOLERANCE WEB MONITORING SYSTEM

STUDY AND SIMULATION OF A DISTRIBUTED REAL-TIME FAULT-TOLERANCE WEB MONITORING SYSTEM STUDY AND SIMULATION OF A DISTRIBUTED REAL-TIME FAULT-TOLERANCE WEB MONITORING SYSTEM Albert M. K. Cheng, Shaohong Fang Department of Computer Science University of Houston Houston, TX, 77204, USA http://www.cs.uh.edu

More information

Search Strategies for Automatic Performance Analysis Tools

Search Strategies for Automatic Performance Analysis Tools Search Strategies for Automatic Performance Analysis Tools Michael Gerndt and Edmond Kereku Technische Universität München, Fakultät für Informatik I10, Boltzmannstr.3, 85748 Garching, Germany gerndt@in.tum.de

More information

Extend Table Lens for High-Dimensional Data Visualization and Classification Mining

Extend Table Lens for High-Dimensional Data Visualization and Classification Mining Extend Table Lens for High-Dimensional Data Visualization and Classification Mining CPSC 533c, Information Visualization Course Project, Term 2 2003 Fengdong Du fdu@cs.ubc.ca University of British Columbia

More information

Enterprise Navigator: A System for Visualizing and Analyzing Software Infrastructures

Enterprise Navigator: A System for Visualizing and Analyzing Software Infrastructures Enterprise Navigator: A System for Visualizing and Analyzing Software Infrastructures Abstract A. Buchsbaum, Y. Chen, H. Huang, E. Koutsofios, J. Mocenigo, A. Rogers AT&T Labs Research, Florham Park, New

More information

Demonstration: On-Line Visualization and Analysis of Real-Time Systems with TuningFork

Demonstration: On-Line Visualization and Analysis of Real-Time Systems with TuningFork Demonstration: On-Line Visualization and Analysis of Real-Time Systems with TuningFork David F. Bacon 1, Perry Cheng 1,DanielFrampton 2, David Grove 1, Matthias Hauswirth 3,andV.T.Rajan 1 1 IBM T.J. Watson

More information

A Framework for Performance Analysis and Tuning in Hadoop Based Clusters

A Framework for Performance Analysis and Tuning in Hadoop Based Clusters A Framework for Performance Analysis and Tuning in Hadoop Based Clusters Garvit Bansal Anshul Gupta Utkarsh Pyne LNMIIT, Jaipur, India Email: [garvit.bansal anshul.gupta utkarsh.pyne] @lnmiit.ac.in Manish

More information

Fig. 3. PostgreSQL subsystems

Fig. 3. PostgreSQL subsystems Development of a Parallel DBMS on the Basis of PostgreSQL C. S. Pan kvapen@gmail.com South Ural State University Abstract. The paper describes the architecture and the design of PargreSQL parallel database

More information

Bridging the Gap Between Cluster and Grid Computing

Bridging the Gap Between Cluster and Grid Computing Bridging the Gap Between Cluster and Grid Computing Albano Alves and António Pina 1 ESTiG-IPB, Campus Sta. Apolónia, 5301-857, Bragança-Portugal albano@ipb.pt 2 UMinho, Campus de Gualtar, 4710-057, Braga-Portugal

More information

Praktikum Wissenschaftliches Rechnen (Performance-optimized optimized Programming)

Praktikum Wissenschaftliches Rechnen (Performance-optimized optimized Programming) Praktikum Wissenschaftliches Rechnen (Performance-optimized optimized Programming) Dynamic Load Balancing Dr. Ralf-Peter Mundani Center for Simulation Technology in Engineering Technische Universität München

More information

Efficient Service Broker Policy For Large-Scale Cloud Environments

Efficient Service Broker Policy For Large-Scale Cloud Environments www.ijcsi.org 85 Efficient Service Broker Policy For Large-Scale Cloud Environments Mohammed Radi Computer Science Department, Faculty of Applied Science Alaqsa University, Gaza Palestine Abstract Algorithms,

More information

Improved metrics collection and correlation for the CERN cloud storage test framework

Improved metrics collection and correlation for the CERN cloud storage test framework Improved metrics collection and correlation for the CERN cloud storage test framework September 2013 Author: Carolina Lindqvist Supervisors: Maitane Zotes Seppo Heikkila CERN openlab Summer Student Report

More information

Speed Performance Improvement of Vehicle Blob Tracking System

Speed Performance Improvement of Vehicle Blob Tracking System Speed Performance Improvement of Vehicle Blob Tracking System Sung Chun Lee and Ram Nevatia University of Southern California, Los Angeles, CA 90089, USA sungchun@usc.edu, nevatia@usc.edu Abstract. A speed

More information

An Intelligent Approach for Integrity of Heterogeneous and Distributed Databases Systems based on Mobile Agents

An Intelligent Approach for Integrity of Heterogeneous and Distributed Databases Systems based on Mobile Agents An Intelligent Approach for Integrity of Heterogeneous and Distributed Databases Systems based on Mobile Agents M. Anber and O. Badawy Department of Computer Engineering, Arab Academy for Science and Technology

More information

School of Computer Science

School of Computer Science School of Computer Science Computer Science - Honours Level - 2014/15 October 2014 General degree students wishing to enter 3000- level modules and non- graduating students wishing to enter 3000- level

More information

Resource Management on Computational Grids

Resource Management on Computational Grids Univeristà Ca Foscari, Venezia http://www.dsi.unive.it Resource Management on Computational Grids Paolo Palmerini Dottorato di ricerca di Informatica (anno I, ciclo II) email: palmeri@dsi.unive.it 1/29

More information

A Framework for Online Performance Analysis and Visualization of Large-Scale Parallel Applications

A Framework for Online Performance Analysis and Visualization of Large-Scale Parallel Applications A Framework for Online Performance Analysis and Visualization of Large-Scale Parallel Applications Kai Li, Allen D. Malony, Robert Bell, and Sameer Shende University of Oregon, Eugene, OR 97403 USA, {likai,malony,bertie,sameer}@cs.uoregon.edu

More information

Preserving Message Integrity in Dynamic Process Migration

Preserving Message Integrity in Dynamic Process Migration Preserving Message Integrity in Dynamic Process Migration E. Heymann, F. Tinetti, E. Luque Universidad Autónoma de Barcelona Departamento de Informática 8193 - Bellaterra, Barcelona, Spain e-mail: e.heymann@cc.uab.es

More information

Towards Visualizing mobile network data

Towards Visualizing mobile network data Towards Visualizing mobile network data Stavros Papadopoulos and Dimitrios Tzovaras Abstract This paper presents the research directions that the visualization in the NEMESYS project will follow, so as

More information

CHAPTER 1 INTRODUCTION

CHAPTER 1 INTRODUCTION 1 CHAPTER 1 INTRODUCTION Exploration is a process of discovery. In the database exploration process, an analyst executes a sequence of transformations over a collection of data structures to discover useful

More information

Hadoop Technology for Flow Analysis of the Internet Traffic

Hadoop Technology for Flow Analysis of the Internet Traffic Hadoop Technology for Flow Analysis of the Internet Traffic Rakshitha Kiran P PG Scholar, Dept. of C.S, Shree Devi Institute of Technology, Mangalore, Karnataka, India ABSTRACT: Flow analysis of the internet

More information

Process Tracking for Dynamic Tuning Applications on the Grid 1

Process Tracking for Dynamic Tuning Applications on the Grid 1 Process Tracking for Dynamic Tuning Applications on the Grid 1 Genaro Costa, Anna Morajko, Tomás Margalef and Emilio Luque Department of Computer Architecture & Operating Systems Universitat Autònoma de

More information

The Sierra Clustered Database Engine, the technology at the heart of

The Sierra Clustered Database Engine, the technology at the heart of A New Approach: Clustrix Sierra Database Engine The Sierra Clustered Database Engine, the technology at the heart of the Clustrix solution, is a shared-nothing environment that includes the Sierra Parallel

More information

Optimizing Configuration and Application Mapping for MPSoC Architectures

Optimizing Configuration and Application Mapping for MPSoC Architectures Optimizing Configuration and Application Mapping for MPSoC Architectures École Polytechnique de Montréal, Canada Email : Sebastien.Le-Beux@polymtl.ca 1 Multi-Processor Systems on Chip (MPSoC) Design Trends

More information

The Scientific Data Mining Process

The Scientific Data Mining Process Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In

More information

Hardware design for ray tracing

Hardware design for ray tracing Hardware design for ray tracing Jae-sung Yoon Introduction Realtime ray tracing performance has recently been achieved even on single CPU. [Wald et al. 2001, 2002, 2004] However, higher resolutions, complex

More information

An Open MPI-based Cloud Computing Service Architecture

An Open MPI-based Cloud Computing Service Architecture An Open MPI-based Cloud Computing Service Architecture WEI-MIN JENG and HSIEH-CHE TSAI Department of Computer Science Information Management Soochow University Taipei, Taiwan {wjeng, 00356001}@csim.scu.edu.tw

More information