From EGEE Operations Portal towards EGI Operations Portal Hélène Cordier CNRS-IN2P3, IN2P3-CC ISGC March 9 th -12 th 2010 Taipei, Taiwan www.eu-egee.org egee EGEE-III INFSO-RI-222667 COD21 22 Sept 2009 http://cic.gridops.org/ ISGC, March 10th 2010
Content EGEE Operations portal customers : EGEE actors (site, federation, operators) and main features of the Operations Portal EGEE Operations Model Situation at the end of EGEE-III EGI Operations portal Backend Reorganization: Symfony Enhancement of standardized access mechanism: Lavoisier Current and future work EGEE-III INFSO-RI-222667 2/12
EGEE Operations Portal features Enabling Grids for E-sciencE USER : end-user or community RESSOURCE PROVIDER VO info Site info User Support Integration Tools CIC Portal Monitoring tools Communication tools OPERATOR EGEE-III INFSO-RI-222667 OPERATIONS CENTER 3/12
EGEE Operations portal services Enabling Grids for E-sciencE Gstat Service Availability Monitoring Production Ressource provider VO ops info VO ID Card VO life cycle Workflows & Operations Tools Communication Overview Operator Management EGEE-III INFSO-RI-222667 4/12
EGEE Daily Operations Model Overview of the ressource providers activity: SAM based Operations Dashboard created December 2004 EGEE-I : Implementation centrally driven by 4 federations Procedures build-up EGEE-II : Operations di driven by 11 federations Procedures upgrade/ training material Build-up up of QoS: metrics/failover EGEE-III : decentralization of operations New model definition Continuous improvement through quarterly meetings De facto tight interaction with Sam, Samap, gstat, gocdb, dashboard Training sessions and workhops on procedures and tools Decentralized operations dashboard d based on Nagios relying on standard-based Web technology EGEE-III INFSO-RI-222667 5/12
Implementation of Symfony Framework Incidental Multi developpers environment Optimisation i of development Streamlining of code for future customisation of workflows Structural t Needs Optimize maintenance time Integrate my sql for future customisation Anticipate multi-linguistic feature Provide packaging for EGI operational entities/ NGI or group of NGIs Advantages: Optimisation of conception, uniform structure for developments, maintenance, pattern automation, multi-os platform and multi DB compatible. Drawbacks: Heavy initial reorganization workload EGEE-III INFSO-RI-222667 6/12
Enhancement of Lavoisier ref. CHEP 2006 Enabling Grids for E-sciencE Data Sources flat file flat file adapter Data Views Manager Data View triggers: startup notified Service getview RDBMS SQL adapter triggers: Data View about to expire WS WS adapter Data View getdataview XSLT adapter Data View triggers: refreshed processxsl config Advantages: Standardisation of data access, Uniformisation of information management, Reliability, Ease of maintenance Drawbacks: Heavy-weight for single info source EGEE-III INFSO-RI-222667 7/12
Lavoisier module External data sources Web portal module Database module Dashboard status at EGI start Enabling Grids for E-sciencE User Internal data Customized views hosted centrally Beta-package for local hosting available Available in production : end of March 2010 REGIONAL SCENARIOS (1) Full distributed model regional helpdesk, dashboard + DB (2) Partially distributed model : dashboard + DB (3)Helpdesk distributed EGEE-III INFSO-RI-222667 8/12
Current work Data access standardization via common re-engineering of front-end and back-end of the site and operational info databases together th with GOCDB team Ergonomic global info management All kind of decentralization scenarios Re-design of existing key features of the portal to provide information via standard xml format VO operational information, life-cycle; EGEE Broadcast Customization with Operations portal v2.0 : https://operations-portal.in2p3.fr/ Dashboard, Broadcast, Downtimes subscription, VO life- cycle, resource provider tools Integration of other DCI (GISELA) EGEE-III INFSO-RI-222667 9/12
Future work Operations Portal within JRA1 activity in EGI-Inspire OTAG Operations Tools Advisory Group monthly otag@mailman.egi.eu 3rd meeting in Upsalla at the UF 5 https://www.egi.eu/indico/categorydisplay.py?categid=4 EGEE-III INFSO-RI-222667 10/12
Try the dashboard beta-package: https://forge.in2p3.fr/documents/show/76 Need to know more Open a GGUS ticket: dedicated CIC Portal SU / OTAG SU Contact t us: cic-information@in2p3.fr i f /f feedback kform EGEE-III INFSO-RI-222667 11/12
- POLE1 : CE, NE - Nagios acceptance criteria/timeline - Model/metrics - POLE2 : NE - Ops Manuels, Best practices - Training guides, How-to - Feedback on NGI readiness - POLE3 : FR - Failover Procedure for recommendations - Procedure on NGI operations set-up - Forge Forum/Wiki/Documents Backup slides COD activity Transition to EGI OE5 (PL, NL) - OE13 (FI) project-eu-egee-sa1-c-codfollowup@cern.ch Oversight of daily operations Best practices/training OTAG: otag@mailman.egi.eu GOCDB, Operations Portal, Dashboard, EGEE-III INFSO-RI-222667 12/12
Implications of L2 regionalization (regionalized instance deployed nationally) A regionalized tool requires interoperation between the national and the central instance (interoperation with non-egi grids needs to be addressed in any case) a scalable and reliable transport mechanism, which becomes a critical component has a software development/maintenance cost committment/resources to test and then run it nationally in a reliable manner A regionalized tool allows for better scalability of the overall model easier customization use of native language (where relevant e.g. Helpdesk) persistent storage of national data (e.g. accounting URs) directly responsible of the service availability one technical reference solution for all, instead of independent development efforts [courtesytf : https://www.egi.eu/indico/contributiondisplay.py?contribid=12&sessionid=3&confid=1] EGEE-III INFSO-RI-222667 13 Tool Regionalization Transition meeting, Amsterdam 03 March 2010