Program Grid and HPC workshop IV

Size: px
Start display at page:

Download "Program Grid and HPC workshop IV"

Transcription

1 Program rid and HPC workshop IV Azar 1390 Tuesday Wednesday Thursday Friday Staurday Sunday Monday Break Lunch SR Opening Advanced Advanced Advanced Report of Iran grid Raasi Testing and BenchMarking Dj Financial Risk Calculation ZZ IPM_rid Raasi Testing and BenchMarking Dj Financial Risk Calculation MN Introduction to CA Off B CRAB and CMS SW PU+CUDA K JPPF B CRAB and CMS SW H romacs+pu +MMT MPI+glite MN+ZZ +glite s Application, MPI, PU, Hadoop, CUDA CMS SW. Organizing Committee: "Hamed Seyed-allaei" <hamed@ipm.ir>, "Reza Ejtehadi" <ejtehadi@sharif.edu>, "S. Mehdi Vaez Allaei" <smvaez@gmail.com>, "Shahin Rouhani" <srouhani@sharif.edu>, "Saman Saadatmand Javan" <seadatmand@gmail.com>,

2 Speakers: Speaker Session Topic erami 2 Advanced X Zeinalpour 1 Intro to IPM-rid X Bakhshian 2 CRAB and CMS SW X Djoudi 2 Financial Risk Calculation X Nedaaee 6 Open MP, MPI,CUDA X Vladimir Slavnic 4 Middleware, X horbanfekr 1 romacs X Raasi 2 Test and BenchMarking X Rouhani 1 Opening and report Najafzadeh 2 CA X Karimi 1 JPPF X SUM 24 Contents 1. Hamed Bakhshian CRAB and CMS SW brief description of what CMSSW is and what it needs to work. multi-tier model of RID in CMS and define the RID-SITEs in this model Data Storage and sync. Mass production and reconstruction user analysis requirements CRAB and how it works servers : DBS, crab server, Omid Djoudi "Financial Risk Calculation" Counterparty and Market Risk Exposure and VaR calculation using compute/data grid Map/Reduce programming metaphore Implementation with Apache Hadoop 3. Mohammad Reza erami Limiting and Monitoring Users Server Hardening Security Tips Logical Volume Manager (LVM) on Software RAID performance tuning disaster and recovery

3 Debugging Shell Scripts - Programming log management Cluster Management 4. Hossein horbanfekr romacs on PU PU vs. CPU romacs on PU 5. Mohammad Hossein Karimi JPPF Introduction Tutorial: A first taste of JPPF Node and Server Management and Monitoring Extending and Customizing JPPF J2EE Connector igaspaces XAP Connector 6. Vladimir Slavnic Lecture 1: Introduction to RID computing Computing resources concepts Server Cluster High Performance Computing (HPC) RID Clouds RID as a model for distributed computing Lecture 2: RID infrastructures and projects RID Middlewares UMD ARC UNICORE Lecture 3: Resource Management Information services Data management Security Authentication and authorization Virtual Organizations (VO)

4 Lecture 4: Workload management Job Advanced job types services Workload Management System (WMS) User Interface (UI) Storage Element (SE) CREAM Hossein Raasi Topics in Testing & Benchmarking Challenges in Testing of HPC and rid Systems Functional vs Structural Testing Tools and Services Quality of Service & Benchmarking Aspects of QA in rid Environments 8. Mahsa Najafzadeh Certification Authority The importance of the establishment of security mechanisms in rid Computing How to create a secure infrastructure in rid Introduction to PKI Digital Certification Introduction to Certification Authority Main components The Responsibilities of Registration Authority The Responsibilities of Certification Authority Manager Introduction to IR-rid certification Authority The procedure of issuing digital Certification for users and host in rid 9. Ehsan Nedaee Open MP, MPI, CUDA Introduction level of parallization Shared Memory and distributed Memory models PU a new device for parallization Shared Memory Paralization Using OpenMp Inroduction Pros and Cons of OpenMP Compiling and Runnig OpenMP Basics Loop Construct Reduction operations Parallel overhead Optimization: Scheduling Distributed Memory Parallization Using MPI

5 MPI, an introduction 1. Applications of MPI 2. Some oals of MPI 3. What is included in MPI 4. Versions Of MPI Point to Point (PTP) Communications in MPI 1. Blocking PTP communications 2. Non-Blocking PTP Communications Collective Communications Paralization on PU using CUDA Introduction 1. raphics Processing Unit (PU) 2. Compute Unified device Architecture (CUDA) 3. CUDA Programming Model CUDA C: The Basics CUDA Threads CUDA Memories Performance Considerations Floating Point Considerations 10. Zeinab Zeinalpour Introducing IPM-rid Why grid What is IPM-grid How to use IPM-rid >> Registration >> Job Management How to use our UI? Timetable Tuesday Wednesday Thursday Saturday Sunday Monday Lunch ZZ: +MMT+K: +MMT+K: certification, UI, Job Advanced topics in Advanced topics in ZZ: certification, UI, Job MN+ZZ: certification, UI, Job Raasi+ZZ+P: Testing M: romacs ZZ: certification, UI, Job off B: CRAB+CMS SW : OpenMP, MPI : OpenMP, MPI

Program Grid and HPC5+ workshop

Program Grid and HPC5+ workshop Program Grid and HPC5+ workshop 24-30, Bahman 1391 Tuesday Wednesday 9.00-9.45 9.45-10.30 Break 11.00-11.45 11.45-12.30 Lunch 14.00-17.00 Workshop Rouhani Karimi MosalmanTabar Karimi G+MMT+K Opening IPM_Grid

More information

Academic Calendar for Faculty

Academic Calendar for Faculty Summer 2013 Term June 3, 2013 (Monday) June 3-4, 2013 (Monday Tuesday) June 5, 2013 (Wednesday) June 5-6, 2013 (Wednesday Thursday) June 6, 2013 (Thursday) July 3, 2013 (Wednesday) July 4, 2013 (Thursday)

More information

MATCHDAY 1 7-9 September 2014

MATCHDAY 1 7-9 September 2014 MATCHDAY 1 7-9 September 2014 7 September Sunday 18:00 Group D 7 September Sunday 20:45 Group D 7 September Sunday 20:45 Group D 7 September Sunday 18:00 Group F 7 September Sunday 20:45 Group F 7 September

More information

Part I Courses Syllabus

Part I Courses Syllabus Part I Courses Syllabus This document provides detailed information about the basic courses of the MHPC first part activities. The list of courses is the following 1.1 Scientific Programming Environment

More information

International University of Monaco 27/04/2012 14:55 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05

International University of Monaco 27/04/2012 14:55 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05 International University of Monaco 27/04/12 14:55 - Page 1 Master in International Business and Global Affairs - from 30 avril to 05 mai 12 Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday

More information

International University of Monaco 21/05/2012 16:01 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05

International University of Monaco 21/05/2012 16:01 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05 International University of Monaco 21/05/12 16:01 - Page 1 Master in International Sport Business and Management - from 30 avril to 05 mai 12 Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday

More information

Online Lecture Schedule Details from August 2015 to October 2015: Certificate Programs

Online Lecture Schedule Details from August 2015 to October 2015: Certificate Programs Online Lecture Schedule Details from August 2015 to October 2015: Certificate Programs Sr. 1 2015-08-16 12:30:00 Sunday Business Communication and Etiquette Session 1 2 2015-08-22 19:00:00 Saturday Business

More information

International University of Monaco 12/04/2012 12:50 - Page 1. Monday 30/01 Tuesday 31/01 Wednesday 01/02 Thursday 02/02 Friday 03/02 Saturday 04/02

International University of Monaco 12/04/2012 12:50 - Page 1. Monday 30/01 Tuesday 31/01 Wednesday 01/02 Thursday 02/02 Friday 03/02 Saturday 04/02 International University of Monaco 12/04/2012 12:50 - Page 1 Master in Finance - Private Banking and International - from 30/01/12 to 04/02/12 Monday 30/01 Tuesday 31/01 Wednesday 01/02 Thursday 02/02

More information

Automating Big Data Benchmarking for Different Architectures with ALOJA

Automating Big Data Benchmarking for Different Architectures with ALOJA www.bsc.es Jan 2016 Automating Big Data Benchmarking for Different Architectures with ALOJA Nicolas Poggi, Postdoc Researcher Agenda 1. Intro on Hadoop performance 1. Current scenario and problematic 2.

More information

FINAL SCHEDULE YEAR 1 AUGUST 18 22 WEEK 1

FINAL SCHEDULE YEAR 1 AUGUST 18 22 WEEK 1 YEAR 1 AUGUST 18 22 WEEK 1 TIME MONDAY (18) TUESDAY (19) WEDNESDAY (20) THURSDAY (21) FRIDAY (22) 11am 1 LUNCH LUNCH LUNCH LUNCH LUNCH 3 YEAR 1 AUGUST 25 29 WEEK 2 TIME MONDAY (25) TUESDAY (26) WEDNESDAY

More information

Trading Calendar - East Capital UCITS Funds

Trading Calendar - East Capital UCITS Funds Trading Calendar - UCITS s The table shows i) the days the funds will be closed due to holidays and ii) which days the funds have early cut-off times (11.30am Central European Time). Please note that the

More information

Business Intelligence Competency Partners

Business Intelligence Competency Partners Business Intelligence Competency Partners BI 4.1 Installation Best Practices Presenter: Rich Chlebek May 15, 2014 What We ll Cover Webinar Protocol Introductions Architecture Server Clustering High Availability

More information

Guillimin HPC Users Meeting. Bryan Caron

Guillimin HPC Users Meeting. Bryan Caron November 13, 2014 Bryan Caron bryan.caron@mcgill.ca bryan.caron@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News October Service Interruption

More information

Integrated Communication Systems

Integrated Communication Systems Integrated Communication Systems Courses, Research, and Thesis Topics Prof. Paul Müller University of Kaiserslautern Department of Computer Science Integrated Communication Systems ICSY http://www.icsy.de

More information

Spring 2011 Prof. Hyesoon Kim

Spring 2011 Prof. Hyesoon Kim Spring 2011 Prof. Hyesoon Kim Today, we will study typical patterns of parallel programming This is just one of the ways. Materials are based on a book by Timothy. Decompose Into tasks Original Problem

More information

Spring Semester May 2016 Exam Timetable

Spring Semester May 2016 Exam Timetable Spring Semester May 2016 Exam Timetable School of Science & Computing Department of Computing Please ensure that you are in possession of a current ID card. If not you should contact the Registrar's Office

More information

The Top Six Advantages of CUDA-Ready Clusters. Ian Lumb Bright Evangelist

The Top Six Advantages of CUDA-Ready Clusters. Ian Lumb Bright Evangelist The Top Six Advantages of CUDA-Ready Clusters Ian Lumb Bright Evangelist GTC Express Webinar January 21, 2015 We scientists are time-constrained, said Dr. Yamanaka. Our priority is our research, not managing

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

A Uniform Job Monitoring Service in Multiple Job Universes

A Uniform Job Monitoring Service in Multiple Job Universes A Uniform Job Monitoring Service in Multiple Job Universes Aleš Křenek, Miroslav Ruda CESNET, EGEE JRA1 www.eu-egee.org Information Society Grid Monitoring Workshop, June 25, 2007 1 Outline Logging and

More information

Introduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber

Introduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber Introduction to grid technologies, parallel and cloud computing Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber OUTLINES Grid Computing Parallel programming technologies (MPI- Open MP-Cuda )

More information

International University of Monaco 11/06/2012 09:27 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05

International University of Monaco 11/06/2012 09:27 - Page 1. Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05 Friday 04/05 Saturday 05/05 International University of Monaco 11/06/2012 09:27 - Page 1 Master in Finance - Hedge Funds and Private Equity - from 30 avril to 05 mai 2012 Monday 30/04 Tuesday 01/05 Wednesday 02/05 Thursday 03/05

More information

<Insert Picture Here> Adventures in Middleware Database Abuse

<Insert Picture Here> Adventures in Middleware Database Abuse Adventures in Middleware Database Abuse Graham Wood Architect, Real World Performance, Server Technologies Real World Performance Real-World Performance Who We Are Part of the Database

More information

Parallel Computing: Strategies and Implications. Dori Exterman CTO IncrediBuild.

Parallel Computing: Strategies and Implications. Dori Exterman CTO IncrediBuild. Parallel Computing: Strategies and Implications Dori Exterman CTO IncrediBuild. In this session we will discuss Multi-threaded vs. Multi-Process Choosing between Multi-Core or Multi- Threaded development

More information

Part-time Diploma in InfoComm and Digital Media (Information Systems) Certificate in Information Systems Course Schedule & Timetable

Part-time Diploma in InfoComm and Digital Media (Information Systems) Certificate in Information Systems Course Schedule & Timetable Certificate in Information Systems Course Schedule & Timetable Module Code Module Title Start Date End Date Coursework Final Exam PTDIS010101 Management Information Tue, April 16, 2013 Tue, 2 April 2013

More information

HPC and Grid Concepts

HPC and Grid Concepts HPC and Grid Concepts Divya MG (divyam@cdac.in) CDAC Knowledge Park, Bangalore 16 th Feb 2012 GBC@PRL Ahmedabad 1 Presentation Overview What is HPC Need for HPC HPC Tools Grid Concepts GARUDA Overview

More information

2015-2016 Academic Calendar - UNDERGRADUATE. All Other Classes Begin; Late Registration Begins. Last Day to Drop a Class without a W on Transcript;

2015-2016 Academic Calendar - UNDERGRADUATE. All Other Classes Begin; Late Registration Begins. Last Day to Drop a Class without a W on Transcript; 2015-2016 Academic Calendar - UNDERGRADUATE Fall 2015 Semester Monday, August 10 Friday, August 14 Saturday, August 15 Monday, August 17 Friday, August 21 Friday, August 28 Friday, September 4 Monday,

More information

Academic Calendar 2015-2016

Academic Calendar 2015-2016 Academic Calendar 2015-2016 Fall 2015 - Full/TCAT Session August 24, 2015 - December 10, 2015 Fall 2015-1st Session August 24, 2015 - October 9, 2015 Fall 2015-2nd Session October 14, 2015 - December 10,

More information

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013 Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache

More information

An Oracle White Paper November 2010. Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics

An Oracle White Paper November 2010. Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics An Oracle White Paper November 2010 Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics 1 Introduction New applications such as web searches, recommendation engines,

More information

The ENEA-EGEE site: Access to non-standard platforms

The ENEA-EGEE site: Access to non-standard platforms V INFNGrid Workshop Padova, Italy December 18-20 2006 The ENEA-EGEE site: Access to non-standard platforms C. Sciò**, G. Bracco, P. D'Angelo, L. Giammarino*, S.Migliori, A. Quintiliani, F. Simoni, S. Podda

More information

CNR-INFM DEMOCRITOS and SISSA elab Trieste

CNR-INFM DEMOCRITOS and SISSA elab Trieste elab and the FVG grid Stefano Cozzini CNR-INFM DEMOCRITOS and SISSA elab Trieste Agenda/Aims Present elab ant its computational infrastructure GRID-FVG structure basic requirements technical choices open

More information

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical Identify a problem Review approaches to the problem Propose a novel approach to the problem Define, design, prototype an implementation to evaluate your approach Could be a real system, simulation and/or

More information

Status and Evolution of ATLAS Workload Management System PanDA

Status and Evolution of ATLAS Workload Management System PanDA Status and Evolution of ATLAS Workload Management System PanDA Univ. of Texas at Arlington GRID 2012, Dubna Outline Overview PanDA design PanDA performance Recent Improvements Future Plans Why PanDA The

More information

Cloud Platforms, Challenges & Hadoop. Aditee Rele Karpagam Venkataraman Janani Ravi

Cloud Platforms, Challenges & Hadoop. Aditee Rele Karpagam Venkataraman Janani Ravi Cloud Platforms, Challenges & Hadoop Aditee Rele Karpagam Venkataraman Janani Ravi Cloud Platform Models Aditee Rele Microsoft Corporation Dec 8, 2010 IT CAPACITY Provisioning IT Capacity Under-supply

More information

Storage Architectures for Big Data in the Cloud

Storage Architectures for Big Data in the Cloud Storage Architectures for Big Data in the Cloud Sam Fineberg HP Storage CT Office/ May 2013 Overview Introduction What is big data? Big Data I/O Hadoop/HDFS SAN Distributed FS Cloud Summary Research Areas

More information

The Information Technology Solution. Denis Foueillassar TELEDOS project coordinator

The Information Technology Solution. Denis Foueillassar TELEDOS project coordinator The Information Technology Solution Denis Foueillassar TELEDOS project coordinator TELEDOS objectives (TELEservice DOSimetrie) Objectives The steps to reach the objectives 2 Provide dose calculation in

More information

Roadmap for Applying Hadoop Distributed File System in Scientific Grid Computing

Roadmap for Applying Hadoop Distributed File System in Scientific Grid Computing Roadmap for Applying Hadoop Distributed File System in Scientific Grid Computing Garhan Attebury 1, Andrew Baranovski 2, Ken Bloom 1, Brian Bockelman 1, Dorian Kcira 3, James Letts 4, Tanya Levshina 2,

More information

VMG ONLINE TRAINING SCHEDULE WINTER 2016

VMG ONLINE TRAINING SCHEDULE WINTER 2016 Volunteer Management Certificate WEDNESDAYS Date Day Time (EDT) Volunteer Program Management Jan. 27 Wed. 7:00 pm - 9:00 pm Leadership, Management & HR Feb. 3 Wed. 7:00 pm - 9:00 pm Effective Communications

More information

FORT LAUDERDALE INTERNATIONAL BOAT SHOW BAHIA MAR IN-WATER SET-UP SCHEDULE

FORT LAUDERDALE INTERNATIONAL BOAT SHOW BAHIA MAR IN-WATER SET-UP SCHEDULE IN-WATER SET-UP SCHEDULE 200-221 B DOCK Friday, October 22 9:00 a.m. 1 FACE DOCK Saturday, October 23 10:00 a.m. 222-245 Friday, October 22 11:00 a.m. 2 Sunday, October 24 10:00 a.m. 3 Sunday, October

More information

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Performance testing Hadoop based big data analytics solutions

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Performance testing Hadoop based big data analytics solutions 11 th International Conference on Software Testing June 2014 at Bangalore, Hyderabad, Pune - INDIA Performance testing Hadoop based big data analytics solutions by Mustufa Batterywala, Performance Architect,

More information

Multicore Parallel Computing with OpenMP

Multicore Parallel Computing with OpenMP Multicore Parallel Computing with OpenMP Tan Chee Chiang (SVU/Academic Computing, Computer Centre) 1. OpenMP Programming The death of OpenMP was anticipated when cluster systems rapidly replaced large

More information

Managing large clusters resources

Managing large clusters resources Managing large clusters resources ID2210 Gautier Berthou (SICS) Big Processing with No Locality Job( /crawler/bot/jd.io/1 ) submi t Workflow Manager Compute Grid Node Job This doesn t scale. Bandwidth

More information

MapReduce on GPUs. Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu

MapReduce on GPUs. Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu 1 MapReduce on GPUs Amit Sabne, Ahmad Mujahid Mohammed Razip, Kun Xu 2 MapReduce MAP Shuffle Reduce 3 Hadoop Open-source MapReduce framework from Apache, written in Java Used by Yahoo!, Facebook, Ebay,

More information

HPC Wales Skills Academy Course Catalogue 2015

HPC Wales Skills Academy Course Catalogue 2015 HPC Wales Skills Academy Course Catalogue 2015 Overview The HPC Wales Skills Academy provides a variety of courses and workshops aimed at building skills in High Performance Computing (HPC). Our courses

More information

Microsoft Compute Clusters in High Performance Technical Computing. Björn Tromsdorf, HPC Product Manager, Microsoft Corporation

Microsoft Compute Clusters in High Performance Technical Computing. Björn Tromsdorf, HPC Product Manager, Microsoft Corporation Microsoft Compute Clusters in High Performance Technical Computing Björn Tromsdorf, HPC Product Manager, Microsoft Corporation Flexible and efficient job scheduling via Windows CCS has allowed more of

More information

Performance Analysis of Lucene Index on HBase Environment

Performance Analysis of Lucene Index on HBase Environment Performance Analysis of Lucene Index on HBase Environment Anand Hegde & Prerna Shraff aghegde@indiana.edu & pshraff@indiana.edu School of Informatics and Computing Indiana University, Bloomington B-649

More information

Efficient Data Replication Scheme based on Hadoop Distributed File System

Efficient Data Replication Scheme based on Hadoop Distributed File System , pp. 177-186 http://dx.doi.org/10.14257/ijseia.2015.9.12.16 Efficient Data Replication Scheme based on Hadoop Distributed File System Jungha Lee 1, Jaehwa Chung 2 and Daewon Lee 3* 1 Division of Supercomputing,

More information

Grid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es

Grid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Grid Computing: A Ten Years Look Back María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Outline Challenges not yet solved in computing The parents of grid Computing

More information

Develop a process for applying updates to systems, including verifying properties of the update. Create File Systems

Develop a process for applying updates to systems, including verifying properties of the update. Create File Systems RH413 Manage Software Updates Develop a process for applying updates to systems, including verifying properties of the update. Create File Systems Allocate an advanced file system layout, and use file

More information

Private Cloud for WebSphere Virtual Enterprise Application Hosting

Private Cloud for WebSphere Virtual Enterprise Application Hosting Private Cloud for WebSphere Virtual Enterprise Application Hosting Tracy Smith Nationwide Insurance February 7, 2013 Session Number 12884 www.linkedin.com/in/tracysmith2 smitht40@nationwide.com Private

More information

Bernie Velivis President, Performax Inc

Bernie Velivis President, Performax Inc Performax provides software load testing and performance engineering services to help our clients build, market, and deploy highly scalable applications. Bernie Velivis President, Performax Inc Load ing

More information

Virtualization Infrastructure at Karlsruhe

Virtualization Infrastructure at Karlsruhe Virtualization Infrastructure at Karlsruhe HEPiX Fall 2007 Volker Buege 1),2), Ariel Garcia 1), Marcus Hardt 1), Fabian Kulla 1),Marcel Kunze 1), Oliver Oberst 1),2), Günter Quast 2), Christophe Saout

More information

Parallel Programming Survey

Parallel Programming Survey Christian Terboven 02.09.2014 / Aachen, Germany Stand: 26.08.2014 Version 2.3 IT Center der RWTH Aachen University Agenda Overview: Processor Microarchitecture Shared-Memory

More information

Big Data Analytics Using R

Big Data Analytics Using R October 23, 2014 Table of contents BIG DATA DEFINITION 1 BIG DATA DEFINITION Definition Characteristics Scaling Challange 2 Divide and Conquer Amdahl s and Gustafson s Law Life experience Where to parallelize?

More information

Mark Bennett. Search and the Virtual Machine

Mark Bennett. Search and the Virtual Machine Mark Bennett Search and the Virtual Machine Agenda Intro / Business Drivers What to do with Search + Virtual What Makes Search Fast (or Slow!) Virtual Platforms Test Results Trends / Wrap Up / Q & A Business

More information

Big Data Evaluator 2.1: User Guide

Big Data Evaluator 2.1: User Guide University of A Coruña Computer Architecture Group Big Data Evaluator 2.1: User Guide Authors: Jorge Veiga, Roberto R. Expósito, Guillermo L. Taboada and Juan Touriño May 5, 2016 Contents 1 Overview 3

More information

WEBLOGIC ADMINISTRATION

WEBLOGIC ADMINISTRATION WEBLOGIC ADMINISTRATION Session 1: Introduction Oracle Weblogic Server Components Java SDK and Java Enterprise Edition Application Servers & Web Servers Documentation Session 2: Installation System Configuration

More information

Microsoft Research Windows Azure for Research Training

Microsoft Research Windows Azure for Research Training Copyright 2013 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Dell Reference Configuration for Hortonworks Data Platform

Dell Reference Configuration for Hortonworks Data Platform Dell Reference Configuration for Hortonworks Data Platform A Quick Reference Configuration Guide Armando Acosta Hadoop Product Manager Dell Revolutionary Cloud and Big Data Group Kris Applegate Solution

More information

Progress Report Week 14 and 15

Progress Report Week 14 and 15 The Royal Institute of Technology KUNGLIGA TEKNISKA HÖGSKOLAN Progress Report - 7 CSD 2006 Date: 01 May 2006 Author: Mohammad Saqibuddin Team 16 Smart ISP - A portable ISP solution Progress Report Week

More information

Cloud Computing through Virtualization and HPC technologies

Cloud Computing through Virtualization and HPC technologies Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC

More information

Microsoft Research Microsoft Azure for Research Training

Microsoft Research Microsoft Azure for Research Training Copyright 2014 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Using WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014

Using WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014 Using WestGrid Patrick Mann, Manager, Technical Operations Jan.15, 2014 Winter 2014 Seminar Series Date Speaker Topic 5 February Gino DiLabio Molecular Modelling Using HPC and Gaussian 26 February Jonathan

More information

Manjrasoft Market Oriented Cloud Computing Platform

Manjrasoft Market Oriented Cloud Computing Platform Manjrasoft Market Oriented Cloud Computing Platform Aneka Aneka is a market oriented Cloud development and management platform with rapid application development and workload distribution capabilities.

More information

Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases

Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases NASA Ames NASA Advanced Supercomputing (NAS) Division California, May 24th, 2012 Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases Ignacio M. Llorente Project Director OpenNebula Project.

More information

Recap& What%is% big%data % Introduction%to%e4science% Reflections%of% big%data %in%health% Guest%lecture:%% DB%for%big%data%analytics%

Recap& What%is% big%data % Introduction%to%e4science% Reflections%of% big%data %in%health% Guest%lecture:%% DB%for%big%data%analytics% Recap& What%is% big%data % Introduction%to%e4science% Reflections%of% big%data %in%health% Guest%lecture:%% DB%for%big%data%analytics% 1$ Recap& Data%infrastructure% Sources,%capture,%representation,%access%

More information

Toward a Unified Ontology of Cloud Computing

Toward a Unified Ontology of Cloud Computing Toward a Unified Ontology of Cloud Computing Lamia Youseff University of California, Santa Barbara Maria Butrico, Dilma Da Silva IBM T.J. Watson Research Center 1 In the Cloud Several Public Cloud Computing

More information

Pinning and Graduation Ceremony at St. Aloysius. Fall Semester and Term B Classes End. St Francis School of Radiography Seniors Spring Semester

Pinning and Graduation Ceremony at St. Aloysius. Fall Semester and Term B Classes End. St Francis School of Radiography Seniors Spring Semester 2015 2016 Academic Calendar Fall Session 2015 Saturday, August 15 Monday, August 31 Monday, August 31 Friday, September 4 Monday, September 7 Friday, October 9 Tuesday, October 20 Wednesday, October 21

More information

SLURM Workload Manager

SLURM Workload Manager SLURM Workload Manager What is SLURM? SLURM (Simple Linux Utility for Resource Management) is the native scheduler software that runs on ASTI's HPC cluster. Free and open-source job scheduler for the Linux

More information

Apache Hadoop new way for the company to store and analyze big data

Apache Hadoop new way for the company to store and analyze big data Apache Hadoop new way for the company to store and analyze big data Reyna Ulaque Software Engineer Agenda What is Big Data? What is Hadoop? Who uses Hadoop? Hadoop Architecture Hadoop Distributed File

More information

Denis Caromel, CEO Ac.veEon. Orchestrate and Accelerate Applica.ons. Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst Capacity

Denis Caromel, CEO Ac.veEon. Orchestrate and Accelerate Applica.ons. Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst Capacity Cloud computing et Virtualisation : applications au domaine de la Finance Denis Caromel, CEO Ac.veEon Orchestrate and Accelerate Applica.ons Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst

More information

Anwendungsintegration und Workflows mit UNICORE 6

Anwendungsintegration und Workflows mit UNICORE 6 Mitglied der Helmholtz-Gemeinschaft Anwendungsintegration und Workflows mit UNICORE 6 Bernd Schuller und UNICORE-Team Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH 26. November 2009 D-Grid

More information

Best practices and use cases for consistent, enterprise-wide SIEM security policy management

Best practices and use cases for consistent, enterprise-wide SIEM security policy management Best practices and use cases for consistent, enterprise-wide SIEM security policy management Bhavika Kothari, QA Lead Victor Lee, Product Manager, CISSP Agenda Introduction Best practices Management tool

More information

Parallel Computing using MATLAB Distributed Compute Server ZORRO HPC

Parallel Computing using MATLAB Distributed Compute Server ZORRO HPC Parallel Computing using MATLAB Distributed Compute Server ZORRO HPC Goals of the session Overview of parallel MATLAB Why parallel MATLAB? Multiprocessing in MATLAB Parallel MATLAB using the Parallel Computing

More information

NorduGrid ARC Tutorial

NorduGrid ARC Tutorial NorduGrid ARC Tutorial / Arto Teräs and Olli Tourunen 2006-03-23 Slide 1(34) NorduGrid ARC Tutorial Arto Teräs and Olli Tourunen CSC, Espoo, Finland March 23

More information

White Paper. Big Data and Hadoop. Abhishek S, Java COE. Cloud Computing Mobile DW-BI-Analytics Microsoft Oracle ERP Java SAP ERP

White Paper. Big Data and Hadoop. Abhishek S, Java COE. Cloud Computing Mobile DW-BI-Analytics Microsoft Oracle ERP Java SAP ERP White Paper Big Data and Hadoop Abhishek S, Java COE www.marlabs.com Cloud Computing Mobile DW-BI-Analytics Microsoft Oracle ERP Java SAP ERP Table of contents Abstract.. 1 Introduction. 2 What is Big

More information

How is a rational (big) data deployment approach like optimizing the generation mix of a power company?

How is a rational (big) data deployment approach like optimizing the generation mix of a power company? How is a rational (big) data deployment approach like optimizing the generation mix of a power company? John Akred & Stephen O Sullivan @SVDataScience John Akred @BigDataAnalysis Puppy Daddy PIF Husband

More information

HIGHER EDUCATION AND TRAINING

HIGHER EDUCATION AND TRAINING HIGHER EDUCATION AND TRAINING FACULTY OF COMMERCE & ENTREPRENEURSHIP & FACULTY OF BUSINESS ADMINISTRATION SEMESTER 2 NATIONAL FINAL EXINATIONS TIMETABLE (13 02 DECEMBER ) NOTE This Time Table includes

More information

Matlab on a Supercomputer

Matlab on a Supercomputer Matlab on a Supercomputer Shelley L. Knuth Research Computing April 9, 2015 Outline Description of Matlab and supercomputing Interactive Matlab jobs Non-interactive Matlab jobs Parallel Computing Slides

More information

Virtualization of a Cluster Batch System

Virtualization of a Cluster Batch System Virtualization of a Cluster Batch System Christian Baun, Volker Büge, Benjamin Klein, Jens Mielke, Oliver Oberst and Armin Scheurer Die Kooperation von Cluster Batch System Batch system accepts computational

More information

TRAINING PROGRAM ON BIGDATA/HADOOP

TRAINING PROGRAM ON BIGDATA/HADOOP Course: Training on Bigdata/Hadoop with Hands-on Course Duration / Dates / Time: 4 Days / 24th - 27th June 2015 / 9:30-17:30 Hrs Venue: Eagle Photonics Pvt Ltd First Floor, Plot No 31, Sector 19C, Vashi,

More information

Strategies for Application Server Deployment Using Multiplatform Installers. October 17-18, 2006 l Santa Clara, CA

Strategies for Application Server Deployment Using Multiplatform Installers. October 17-18, 2006 l Santa Clara, CA Strategies for Application Server Deployment Using Multiplatform Installers Brian Lemberger Sr. Consultant Macrovision Corp. Chirag Shah Consultant Macrovision Corp. October 17-18, 2006 l Santa Clara,

More information

Architecture Guide Community 1.5.0 release

Architecture Guide Community 1.5.0 release Architecture Guide Community 1.5.0 release This guide details the architectural specifics of Jumbune, helps you understand core layers, major components, and their interactions. Table of Contents Introduction

More information

EMPLOYEE SCREENING TOOL AND TELECOMMUTING REQUEST UI TELECOMMUTING PROGRAM

EMPLOYEE SCREENING TOOL AND TELECOMMUTING REQUEST UI TELECOMMUTING PROGRAM EMPLOYEE SCREENING TOOL AND TELECOMMUTING REQUEST UI TELECOMMUTING PROGRAM The success of telecommuting is dependent on it being a mutually beneficial arrangement for the unit and the employee. This form

More information

Maximizing Hadoop Performance with Hardware Compression

Maximizing Hadoop Performance with Hardware Compression Maximizing Hadoop Performance with Hardware Compression Robert Reiner Director of Marketing Compression and Security Exar Corporation November 2012 1 What is Big? sets whose size is beyond the ability

More information

FLOW-3D Performance Benchmark and Profiling. September 2012

FLOW-3D Performance Benchmark and Profiling. September 2012 FLOW-3D Performance Benchmark and Profiling September 2012 Note The following research was performed under the HPC Advisory Council activities Participating vendors: FLOW-3D, Dell, Intel, Mellanox Compute

More information

for my computation? Stefano Cozzini Which infrastructure Which infrastructure Democrito and SISSA/eLAB - Trieste

for my computation? Stefano Cozzini Which infrastructure Which infrastructure Democrito and SISSA/eLAB - Trieste Which infrastructure Which infrastructure for my computation? Stefano Cozzini Democrito and SISSA/eLAB - Trieste Agenda Introduction:! E-infrastructure and computing infrastructures! What is available

More information

JBoss Seam Performance and Scalability on Dell PowerEdge 1855 Blade Servers

JBoss Seam Performance and Scalability on Dell PowerEdge 1855 Blade Servers JBoss Seam Performance and Scalability on Dell PowerEdge 1855 Blade Servers Dave Jaffe, PhD, Dell Inc. Michael Yuan, PhD, JBoss / RedHat June 14th, 2006 JBoss Inc. 2006 About us Dave Jaffe Works for Dell

More information

Petascale Software Challenges. Piyush Chaudhary piyushc@us.ibm.com High Performance Computing

Petascale Software Challenges. Piyush Chaudhary piyushc@us.ibm.com High Performance Computing Petascale Software Challenges Piyush Chaudhary piyushc@us.ibm.com High Performance Computing Fundamental Observations Applications are struggling to realize growth in sustained performance at scale Reasons

More information

marlabs driving digital agility WHITEPAPER Big Data and Hadoop

marlabs driving digital agility WHITEPAPER Big Data and Hadoop marlabs driving digital agility WHITEPAPER Big Data and Hadoop Abstract This paper explains the significance of Hadoop, an emerging yet rapidly growing technology. The prime goal of this paper is to unveil

More information

Hadoop and Map-Reduce. Swati Gore

Hadoop and Map-Reduce. Swati Gore Hadoop and Map-Reduce Swati Gore Contents Why Hadoop? Hadoop Overview Hadoop Architecture Working Description Fault Tolerance Limitations Why Map-Reduce not MPI Distributed sort Why Hadoop? Existing Data

More information

SEE-GRID-SCI. www.see-grid-sci.eu. SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul 09-10 December, 2009

SEE-GRID-SCI. www.see-grid-sci.eu. SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul 09-10 December, 2009 SEE-GRID-SCI Grid Site Monitoring tools developed and used at SCL www.see-grid-sci.eu SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul 09-10 December, 2009 V. Slavnić, B. Acković, D. Vudragović, A. Balaž,

More information

The Grid-it: the Italian Grid Production infrastructure

The Grid-it: the Italian Grid Production infrastructure n 1 Maria Cristina Vistoli INFN CNAF, Bologna Italy The Grid-it: the Italian Grid Production infrastructure INFN-Grid goals!promote computational grid technologies research & development: Middleware and

More information

ORACLE DATABASE HIGH AVAILABILITY STRATEGY, ARCHITECTURE AND SOLUTIONS

ORACLE DATABASE HIGH AVAILABILITY STRATEGY, ARCHITECTURE AND SOLUTIONS ORACLE DATABASE HIGH AVAILABILITY STRATEGY, ARCHITECTURE AND SOLUTIONS DOAG Nuremberg - 17/09/2013 Kirill Loifman Oracle Certified Professional DBA www: dadbm.com Twitter: @loifmkir ELEMENTS OF HIGH AVAILABILITY

More information

Infrastructure overview. Marlon Dutra Production Engineer, Traffic

Infrastructure overview. Marlon Dutra Production Engineer, Traffic 1 Infrastructure overview Marlon Dutra Production Engineer, Traffic October, 2013 2 Physical infra 3 Data centers 4 Edge locations 5 Prineville, OR 6 Organization Suites Clusters services front end back

More information

Parallel Computing. Benson Muite. benson.muite@ut.ee http://math.ut.ee/ benson. https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage

Parallel Computing. Benson Muite. benson.muite@ut.ee http://math.ut.ee/ benson. https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage Parallel Computing Benson Muite benson.muite@ut.ee http://math.ut.ee/ benson https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage 3 November 2014 Hadoop, Review Hadoop Hadoop History Hadoop Framework

More information

WEBSPHERE APPLICATION SERVER ADMIN V8.5 (on Linux and Windows) WITH REAL-TIME CONCEPTS & REAL-TIME PROJECT

WEBSPHERE APPLICATION SERVER ADMIN V8.5 (on Linux and Windows) WITH REAL-TIME CONCEPTS & REAL-TIME PROJECT WEBSPHERE APPLICATION SERVER ADMIN V8.5 (on Linux and Windows) WITH REAL-TIME CONCEPTS & REAL-TIME PROJECT Faculty Name Experience Course Duration Madhav (Certified Middleware Professional) Certified on

More information

Overview of HPC Resources at Vanderbilt

Overview of HPC Resources at Vanderbilt Overview of HPC Resources at Vanderbilt Will French Senior Application Developer and Research Computing Liaison Advanced Computing Center for Research and Education June 10, 2015 2 Computing Resources

More information

A Performance Data Storage and Analysis Tool

A Performance Data Storage and Analysis Tool A Performance Data Storage and Analysis Tool Steps for Using 1. Gather Machine Data 2. Build Application 3. Execute Application 4. Load Data 5. Analyze Data 105% Faster! 72% Slower Build Application Execute

More information