Condition Database Monitoring Developments and Perspectives

Transcription

1 Condition Database Monitoring Developments and Perspectives Computing and Offline Monitoring Workshop, 11 May 2011 Antonio Pierro on behalf of the CMS DB group 1

2 Outline 1. CMS Condition Database tools PopCon monitoring, Payload Inspector, Global Tag List, 2. Development based on user, developer and security/performance requirements: Cross-browser, continuously updated, users support,.. Simplicity, Service Discovery Multi-tier architecture, Distributed caching system,.. 3. Development following new techniques: HTML5 specification. Mobile Web Application. 2

3 1. CMS Condition Database tools PopCon monitoring [1] used for monitoring the activity on the Condition Databases from different user perspectives (Sub-detector manager, Condition DB core developer, physicists) Payload Inspector [2] used by physicists for monitoring the calibration and alignment data in different format (synoptic maps, XML, trend plot ) Condition Global Tag List [3] used by physicists for accessing and monitoring CMS condition metadata information (GT, TAG, IOV) FroNTier On-line monitoring [10] EasyMon[4] web monitoring tool designed for mobile device; it provides metrics and service availability (see slide 10,11) 3

4 2.A Development following users requirements Cross-browser: We support the most popular browsers: Firefox, Safari, Google Chrome, Opera, Mobile Safari, Opera Mobile. Continuously updated to satisfy any needs coming from other services (DAS, ) getruninfo [5], getlumi [6], JSON, XML output for external scripts support Payload inspector, getlumi, getruninfo, Condition Global Tag list On-Call Service and DB mailing-list. 4

5 2.B Development following developer requirements Simplicity: Our development of software project aims to create applications with clear architecture and well modularized elements rather than adding elements which make it more complex. Independent Layer package Make easy to develop sophisticated workflow applications. Logging Service Discovery: Developers need a way to discover which services are available. Services and corresponding computers node should be easily searchable for a rapid intervention in case of critical situations. Welcome in changing requirements, even late in development. 5

6 2C. Development following Security/performance requirements [7] Multi-tier architecture (different tiers between different nodes) A greater degree of flexibility Modular software with well-defined interfaces Each tier does not depend on requirements or technology changes of other tiers Increased security, as security can be defined for each service/node, and at each level. Increased performance, as tasks are shared between servers Distributed caching system To avoid repeated queries to the database CherryPy implements a caching system as a pluggable Tool. FroNTier server with tiered Squids to cache database data. [8] 6

7 3A. Development following new techniques[9] HTML5 Web Storage: It is an API that enable any web app to store session data locally in the browser cache. HTML5 Web Storage, advantages: Faster response time: files that are cached locally will load much faster. Reduced load on server: every time you load a page that has some cached elements, the browser will poll the server to check if the cached file has been updated; if it hasn't, then it won t download it. By doing so, the load on the server is considerably reduced. 7

8 3B. Development following new techniques HTML5 Web Workers Web Workers allows thread-like operations by running in parallel individual script in background. It enables background processing of scripts while the user can still use the browser. By using Web Workers on multi-core microprocessors it is possible to reduce the JavaScript execution time depending on the context (number of core and computational algorithm). HTML5 Web Socket: It is a way of opening up a bidirectional communications channel with a server. WebSocket does not rely on costly polling or long polling (like ajax) techniques that eat up valuable server and network resources. 8

9 3C. Development following new techniques HTML5 mobile app framework for developing web apps the amount of users using mobile devices to access the web is exponentially growing. For developers, there are a lot of Web Framework for Smartphones & Tablets: jqtouch, jquery Mobile, Sencha Touch, Titanium Mobile, PhoneGap ios SDK These framework allow to develop mobile web apps that look and feel native on iphone, Android, and BlackBerry touch devices. (see an example in the next slide) 9

10 3D. CMS Condition Database tools Easymon Frontend [4] It provides metrics and service availability The Progress bar gives you a quick summary of the state of different services. The front-end uses Mobile JavaScript Framework 10

11 3E. CMS Condition Database tools Easymon Backend The backend relies on: Nagios-Core and custom plug-in, Lemon-Client, Service Level Status (SLS) The Nagios-Core custom plug-ins perform regression test to verify that repairs to code or software enhancements have not caused additional software bugs. (Payload inspector, ) Example of Lemon-Client commands: "lemon-cli -n %s -m %s -s --script-mode" % (node, metric) 11

12 Reference [1] PopCon Monitoring, < [2] Payload Inspector, < [3] Global Tag List, < [4] Easymon, < [5] GetRunInfo, < [6] GetLumi, < [7] A. Pierro et all., jspydb, an open source database-independent tool for data management, CERN-CMS-CR [8] FroNTier, < [9] A. Pierro et all., Fast access to the CMS detector condition data employing HTML5 technologies, CERN-CMS-CR [10] FroNTier Online < 12