CSC Yearly Team Meeting

Transcription

1 CSC Yearly Team Meeting 2012 Edition Sébastien Varrette, PhD Luxembourg, November 23th, 2012

2 Mini-CV 32 years old, married (2004), 2 children (2007,2010) 2003: Master s degree (Telecom department ENSIMAG) 2003: Master s degree (Cryptology, Security and Information Coding) 2007: PhD in computer science (UL/INPG) Security in Large Scale Distributed Systems: Authentication and Result Checking. Now Research associate (permanent position) 2

3 System administration 201 hosted projects registered users Collaboration tool (svn, git, Incoming: Redmine, Gitlab etc... Etherpad/Jabber Backup/OwnCloud (incoming) VMs deployment / management (www, etc.) 3

4 UL HPC Platform 2 geographical sites 3 clusters: 184 nodes, 2320 cores (20.4 TFlops) 691TB storage 3 system administrators 4M Hardware investment so far Open-Source software stack SSH, OpenLDAP, Puppet, FAI 4

5 UL HPC Platform 5

6 UL HPC Platform Other Clusters network Site <sitename> Local Institution Network 10 GbE 10 GbE 1 GbE Site access server 1 GbE Site router Cluster A Adminfront OAR Puppet supervision Kadeploy etc... Site Computing Nodes Cluster B NFS and/or Lustre Fast local interconnect (Infiniband, 10GbE) Disk Enclosure Site Shared Storage Area 6

7 UL HPC 2012 Achievments UL HPC new aquisitions +931,693, +51 nodes (792 cores), +3 disk encl. (180TB) Puppet Infrastructure Consolidation Configuration management made easy Automate service deployment / sysadmin duties declarative language (manifests), client/server model Git based workflow + Rakefile + Capistrano Hierachical PKI now in place, 52 modules 7

8 puppet.uni.lux Puppet (Root) CA Puppet Infrastructure TOTAL resources managed testing production devel Environments Managed hosts: 70 (+26 Grid'5000 Luxembourg) 96 servers 184 computing nodes (2320 cores) 691 TB shared stoage (NFS / Lustre) Files Puppet master Modules/Manifests Root CA LCSB site (Belval) (kali) puppet agent (lcsb-portal) puppet agent 12 hosts Puppet Master LCSB testing production devel Files XMLRPC / REST over SSL Puppet Master CSC production testing devel Files CSC site (Kirchberg) (shiva) puppet agent (gforge) puppet agent 29 hosts (transmart) puppet agent Puppet master CA CA Puppet master (urt) puppet agent gaia cluster (Belval) (adminfront) puppet agent (mds1) puppet agent Puppet Master chaos cluster testing production devel Puppet Master chaos cluster production testing devel chaos cluster (Kirchberg) (adminfront) puppet agent (dhcp) puppet agent 18 hosts Files Files 11 hosts (nfs) puppet agent Puppet master CA CA Puppet master (urt) puppet agent Computing nodes (73) Computing nodes (73) UL HPC Platform FAI Infrastructure Managed computing nodes: 146 (1952 cores) (+48 (368 cores) Grid'5000 Luxembourg) 8

9 Puppet Deployment (Demo) List managed nodes by dom0 $ cap conf:list:by:dom0 Create a fresh new Xen DomU (demo-csc.uni.lux) # xm list on puppetmaster $ aquamacs manifests/sites/csc/puppetmaster.uni.lux.pp $ cap puppet:deploy:testing HOST=puppetmaster [149s] Create the new host configuration and bootstrap Puppet $ cap site:host:add $ ssh demo-csc $ cap site:host:collect:hardware HOST=demo-csc $ cap site:host:generate:puppet_manifest $ aquamacs manifests/sites/csc/demo-csc.uni.lux.pp $ cap puppet:bootstrap HOST=demo-csc 9

10 Puppet Deployment (Demo) Sign the certificate request on Puppet (Root) CA $ sudo puppet cert --list $ sudo puppet cert --sign demo-csc.uni.lux Deploy the new VM $ cap puppet:deploy:testing HOST=demo-csc [135s] $ ssh demo-csc Test a new feature on a snapshot (Ex: Apache/MySQL) $ cap xen:domu:snapshot:create HOST=demo-csc $ ssh demo-csc $ aquamacs manifests/sites/csc/demo-csc.uni.lux.pp $ cap puppet:deploy:testing HOST=demo-csc [103s] $ cap xen:domu:snapshot:destroy HOST=demo-csc 10

11 Puppet Deployment (Demo) Sign the certificate request on Puppet (Root) CA $ sudo puppet cert --list $ sudo puppet cert --sign demo-csc.uni.lux Deploy the new VM $ cap puppet:deploy:testing HOST=demo-csc [135s] $ ssh demo-csc Test a new feature on a snapshot (Ex: Apache/MySQL) $ cap xen:domu:snapshot:create HOST=demo-csc $ ssh demo-csc $ aquamacs manifests/sites/csc/demo-csc.uni.lux.pp $ cap puppet:deploy:testing HOST=demo-csc [103s] $ cap xen:domu:snapshot:destroy HOST=demo-csc Total bootstrap time: ±6 min 10

12 Cloud/Software security TPM-based protocol to assert Cloud resources integrity protocol validation via reference validator AVISPA / Scyther Application to IaaS (... and signature scheme above) cf Ben s talk [TSI 12] B. Bertholon, S. Varrette, and P. Bouvry. CertiCloud: une plate-forme Cloud IaaS sécurisée. Journal Technique et Science informatiques (TSI), vol 2592:30 Nature-inspired Code obfuscation shadobf: MOEA PIPS-based (src-to-src compiler) C obfuscator jshadobf: MOEA javascript obfuscator cf Ben s talk [ComPas 13] S. Martinez and B. Bertholon and S. Varrette and P. Bouvry. Optimisation d'obfuscation de code source au moyen d algorithmes évolutionnaires multi-objectifs (Poster). Grenoble, France, Jan [SCAM 13] B. Bertholon and S. Varrette and P. Bouvry. JSHADOBF: A Javascript Obfuscator based on Multi-objective Optimization. IEEE Intl Conf on Source Code Analysis and Manipulation Algorithms (SCAM). To submit. 11

13 Fault Tolerance: EAs vs cheaters Nature inspired ABFT for Volunteer computations [distributed] Evolutionary Algorithms proved convergence of deas despite cheaters under some special hypothesis proved non-convergence of deas despite cheaters under some special hypothesis Cf Jakub s talk [CAMWA 12] J. Muszyński, S. Varrette, P. Bouvry, F. Seredyński, and S. U. Khan. Convergence Analysis of Evolutionary Algorithms in the Presence of Crash-Faults and Cheaters. Intl. Journal. of Computers and Mathematics with Applications (CAMWA), may [META 12] J. Muszyński, S. Varrette, J. L. Jimenez Laredo, B. Dorronsoro, and P. Bouvry. Convergence of Distributed Cellular Evolutionary Algorithms in Presence of Crash Faults and Cheaters. In META 12, Sousse, Tunisia, Oct

14 Crypto / Security MOEA GEP-based for hash function generation [CSS 12] S. Varrette, J. Muszyński, and P. Bouvry. Hash function generation by means of Gene Expression Programming. In Proc. of Intl. Conf. on Cryptography and Security System (CSS 12), Kazimierz Dolny, Poland, Sept Annales UMCS ser. Informatica Critical infrastructure security analysis CI security modeling & dependencies / risk analysis Concrete case study: Grid 5000 vs Network backbone provider cf Thomas talk [IJSSE 12] F. Caldeira, T. Schaberreiter, S. Varrette, E. Monteiro, P. Simoes, D Khadraoui, and P. Bouvry. Trust Based Interdependency Weighting for On-line Risk Monitoring in Interdependent Critical Infrastructures. Intl. Journal of Secure Software Engineering (IJSSE), To appear. 13

15 Cloud / HPC performance evaluation Hypervisor / Cloud middleware benchmarking from an HPC point of view green and FT aspects (with Mateusz, Fred, Xav etc.) in progress Green evaluation of novel architectures 2 ARM box incoming (48 nodes, 192 cores, 2U, 300W) Energy-aware benchmarking / evaluation (with Fred) in progress 14

16 To Co nclude Welcome on board for newcomers Call for contribution: PhD survival guide SVN (gforge): teambouvry/talks/phd_survival_guide 15