HPC Infrastructure Development in Bulgaria

Transcription

1 HPC Infrastructure Development in Bulgaria Svetozar Margenov Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, Acad. G. Bonchev Str. Bl. 25-A, 1113 Sofia, Bulgaria PRACE-HPCW, February 2012, Sofia, Bulgaria p. 1/32

2 Outline 1. Introduction 2. Strategic documents 3. Infrastructure development 4. SEE integration 5. Parallel scalability 6. Conclusions PRACE-HPCW, February 2012, Sofia, Bulgaria p. 2/32

3 1. Introduction PRACE-HPCW, February 2012, Sofia, Bulgaria p. 3/32

4 In 1930, John Vincent Atanasoff has had a problem leading to the extremely large-scale system of 30 linear algebraic equations arising from application of Ritz method for discretization of differential equations. This has been the motivation to invent the computer. µ-fem analysis of bone microstructure High Performance Computing (HPC) is one of the most rapidly developing part of computational sciences. The advanced HPC applications reach billions of degrees of freedom. PRACE-HPCW, February 2012, Sofia, Bulgaria p. 4/32

5 Argonne National Labs GBB PRACE-HPCW, February 2012, Sofia, Bulgaria p. 5/32

6 2. Strategic documents Draft National Reform Programme ( ) National Roadmap for Research Infrastructure ( ) National Broadband Strategy ( ) National Program on Accelerated IS development ( ) Operational Programmes ( ) National Strategic Reference Framework ( ) State Policy on Accelerated IS development ( ) PRACE-HPCW, February 2012, Sofia, Bulgaria p. 6/32

7 Roadmap for RI ( ) 1. Infrastructure for sustainable development in the area of sea research 2. Infrastructure for the production and research of new materials 3. Infrastructure for genome, proteome and metabolome researches IICT - BAS is a member of the consortium 4. Infrastructure in the area of renewable energy sources and energy efficiency 5. Bulgarian supercomputing center Scientific and technical coordinator: CoE on Supercomputing applications (IICT - BAS is a coordinator of SuperCA++) 6. BG-CLARIN: integration and development of Bulgarian language electronic resources as a part of European CLARIN Scientific and technical coordinator: IICT - BAS 7. Astronomical center for research and education PRACE-HPCW, February 2012, Sofia, Bulgaria p. 7/32

8 Approach towards HPC Concentrate on better management and exploitation of existing HPC Definition of new directions in areas important to ensure the catching up process Stepping up collaboration with other countries and international organisations Financial Instruments IBM Blue Gene/P It is attractive speaking about HPC, but keep in mind exponential growing overall expectations HPC is an enabler of scientific and innovative results not a ready solution or result PRACE-HPCW, February 2012, Sofia, Bulgaria p. 8/32

9 3. Infrastructure development IICT-BAS is the main coordinator for e-infrastructure activities in Bulgaria National Research and Education Network Bulgarian Grid Infrastructure Supercomputer Blue Gene/P Grid and Supercomputing applications National and international e-infrastructure projects PRACE-HPCW, February 2012, Sofia, Bulgaria p. 9/32

10 About IICT Center for Informatics and Computer Technology (CICT) Central Laboratory for Parallel Processing (CLPP) Institute for Parallel Processing (IPP) The Institute of Information and Communication Technologies at the Bulgarian Academy of Sciences - (IICT) is founded as a successor of Institute for Parallel Processing, Institute of Information Technologies and Institute of Computer and Communication Systems PRACE-HPCW, February 2012, Sofia, Bulgaria p. 10/32

11 IICT basic scientific trends IICT-BAS has the leading position in Bulgaria in the field of: Network and Grid services Grid, Cloud and GPU computing Large-Scale scientific computations and supercomputer applications Security and information systems A large number of international projects (total number: 39 for the last 5 years), among them: EGEE -1st, 2nd and 3rd phase, EGI-InSPIRE SEEGRID-1, SEEGRID-2, SEEGRID-SCI, HP-SEE CoreGRID, GRINKO, PSIRP, FORWARD Projects funded by Bulgarian National Science Fund (NSF) (36 for the last 5 years) PRACE-HPCW, February 2012, Sofia, Bulgaria p. 11/32

12 National ei responsibilities IICT-BAS coordinates consortium of 3 universities and 3 institutes of the Academy in Center of Excellence Supercomputer Applications (SuperCA++). IICT-BAS coordinates the National Grid Initiative (NGI) (named Bulgarian Grid Consortium) and presents it in the EGI Policy Board. IICT-BAS hosts the main node of BREN and is a member of the Board of Bulgarian Research and Educational Network (BREN). IICT-BAS is responsible for the operations of the Bulgarian Academic Certification Authority ( which is authorized to issue digital Grid certificates free of charge for all Bulgarian Grid users or hosts. PRACE-HPCW, February 2012, Sofia, Bulgaria p. 12/32

13 BREN The Bulgarian Research and Educational Network (BREN) is the academic provider of Internet for Bulgaria. Members of BREN: Executive Agency Electronic Communication Networks and Information Systems, Ministry of Transport, Information Technology and Communications Bulgarian Academy of Sciences The Council of Bulgarian Universities Rectors National Research Network PRACE-HPCW, February 2012, Sofia, Bulgaria p. 13/32

14 The Bulgarian Grid consortium Founders: Institute for Parallel Processing (IPP-BAS, former CLPP-BAS) and Institute for Nuclear Research and Nuclear Energy (INRNE-BAS) ( Agreement signed in September 2002) Joined by 8 institutes and 4 universities in the next several years Active work started 2004 Since 2007, IPP-BAS is recognized as the coordinator of Bulgarian Grid Initiative Main goals: Sharing of resources and expertise in Grid technologies; Development of Grid applications. PRACE-HPCW, February 2012, Sofia, Bulgaria p. 14/32

15 Grid computing resources PRACE-HPCW, February 2012, Sofia, Bulgaria p. 15/32

16 PRACE-HPCW, February 2012, Sofia, Bulgaria p. 16/32

21 HPC pyramid European and National HPC Projects and Initiatives PRACE: Partnership for Advanced Computing in Europe HP-SEE: High Performance Computing Infrastructure for South East Europe s Research Communities SuperCA++: Center of Excellence for Supercomputing Applications PRACE-HPCW, February 2012, Sofia, Bulgaria p. 21/32

22 SuperCA++ PRACE-HPCW, February 2012, Sofia, Bulgaria p. 22/32

23 5. SEE integration PRACE-HPCW, February 2012, Sofia, Bulgaria p. 23/32

28 5. Parallel scalability Figure: 1D, 2D and 3D partitioning: voxel triangulation of a cubic domain Parallel numerical tests for a parabolic problem in cubic space domain, voxel FEM mesh, and 96 implicit backward Euler time steps, are given bellow. Table: Parallel scalability PRACE-HPCW, February 2012, Sofia, Bulgaria p. 28/32

29 Unstructured meshes Figure: 3D FEM discretization: unstructured mesh and and ParMETIS partitioning for 16 processors ParMETIS is developed by Karypis Lab. It is an MPI-based parallel library that implements a variety of algorithms for partitioning unstructured graphs, meshes, and for computing fill-reducing orderings of sparse matrices. PRACE-HPCW, February 2012, Sofia, Bulgaria p. 29/32

30 ParMETIS partitioning Table: 3D FEM discretization: unstructured mesh and and ParMETIS partitioning for 512 processors ParMETIS computes in parallel partitionings of very large unstructured meshes. A high quality balance with respect to the number of elements and vertices, and minimization of the size of interfaces is provided. The relatively large number of neighbors is still an open problem. PRACE-HPCW, February 2012, Sofia, Bulgaria p. 30/32

31 Supercomputing in Blue Blue Gene/P: 4 x 3D Torus = : diam = 96 Blue Gene/Q: 32 x 5D Torus = : diam = 20 Blue Water diam = 4 PRACE-HPCW, February 2012, Sofia, Bulgaria p. 31/32

32 6. Conclusions Bulgaria has visible presence and active role in the area of e-infrastructures in the SEE region with its achievements, expertise and resources. Bulgaria is a pioneer in SEE region in the field of national SC programs (SuperCA, SuperCA++), and IICT-BAS is ready to share its experience. THANK YOU! PRACE-HPCW, February 2012, Sofia, Bulgaria p. 32/32