Please find the GoToMeeting information for the HPC User Group meeting scheduled for tomorrow:

Transcription

1 All, Please find the GoToMeeting information for the HPC User Group meeting scheduled for tomorrow: 1. Please join my meeting Use your microphone and speakers (VoIP) - a headset is recommended. Or, call in using your telephone. Dial +1 (267) Access Code: Audio PIN: Shown after joining the meeting Meeting ID: From: <Ritacco>, Alan <[email protected]> Reply-To: hpcusergroup <[email protected]> Date: Thursday, April 3, 2014 at 4:39 PM To: hpcusergroup <[email protected]> Subject: HPC User Group Meeting Thursday April 9th next HPC User Group meeting Please find the agenda for our next HPC User Group meeting, scheduled for: Thursday April 10th, 2:00PM Please let me know if you have additional Agenda items you would like added. Thanks Al Attendees: Hello All, Please find the agenda for our next MGHPCC User Group Meeting Date: Thursday April 8, 2014 Call to 2:00PM Initial voting members (Primary, secondary): UMASS Amherst: Lin-Jun Ma, Lixin Gao, Courtney Babbitt UMASS Boston: Crystal Schaaf, Todd Riley, Jeff Dusenberry UMASS Dartmouth: Geoffrey Cowles, Gaurav Khanna, Bob Fisher UMASS Lowell: Erno Sajo, Juan Pablo Trelles, Sukesh Aghara UMASS Worcester: John Landers, Jeff Bailey, Manuel Garber

2 We ask that each campus have at least two representatives participate. 1) Approval or correction of minutes from last meeting Meeting minutes created at last meeting had been sent out for review. Review meeting minutes briefly. Please let me know if you have found any errors in the meeting minutes. (meeting minutes will be posted and made available via the Wiki page) {Add corrections and approve meeting minutes see link} Linjun accept, all in favor. 2) Report of recent activity related to the MGHPCC work The MGHPCC group has completed the following work: Training has been completed at all campuses o We will be offering extended training, beyond basics LDAP/IDM integration is on hold. Outbound Internet access via I2 is available, commodity Internet is being setup by the UMASS Amherst team Most requested software packages have been installed PI based signup and their users o Verification of PI by the HPC User group would be helpful o Jeff - send out list of User and PI 3) Report from sub-groups (where applicable) Outbound Internet access Access from the Holyoke facility to the Internet (via I2) is available, commodity Internet is being setup General report of statistics of the GHPCC environment: CPU Time, pending time, and suspended time Per Campus:

3 Average Daily Core Utilization

4 Storage Allocated: Linjun Storage allocation We will provide storage in 60%-75% pay as you go to the campuses. Jeff Provide actual usage as well We have added 1024 new AMD cores into the cluster, ~5200 cores available. 4) Unfinished discussions from last meeting Review discussions Outstanding new business: Election for the following positions (yearly positions): 1. Chair 2. Secretary Al Ritacco is the secretary. 1 st rule of order: Nominations Crystal nominates Al Ritacco as secretary, seconded and all in favor. 2 nd rule of order:

5 Vote for chair and secretary. Chair Linjun feels that Al is best to pick. Al to stay as chair for now. 5) New Business To help with operational procedures and features we are looking for the HPC User group look to discuss and vote on the following questions: *Linjun UMASS Amherst user running structure (Anna) is having issues. Linjun to contact. 1. Currently the Short and Parallel queues allow for ~80% of all resource utilization a. As short and Parallel jobs can suspend other jobs, is there a suggestion on changes to this ~80% resource allocation? Suspension time. Example: Job in parallel queue using 1000 cores (1/3 of cluster at that point) with a wall time of ~20days, any cores job used suspended jobs in the long queue for the length of the original job (ex: 20 days). What limits do we want to put on short/long queues? Short and parallel can suspend long queue jobs today. Ex: Change priority of parallel queue, no longer suspend long jobs and long and parallel have same priority. hours. Jeff Bailey Short vs long: Breaking apart long from parallel may be a good idea. Short 12 Jeff D. Rename parallel queue to mpi-queue based name (mpi-parallel) Chris Set user to have only x number of jobs in the queue On the table, move to change parallel no longer suspending: Try for a month? Jeff B. Yes to try for a month. Update graphs per month and review 2. We are currently in the fourth month of production. We are looking for a discussion on the current queue setup, along with possible suggestions related to the configuration. a. Discussion? Jeff B. What % of people are specifying job dependencies approaching 100%. Provide the timing for the short queue for all jobs median, send out plot of data. John L. Has been seeing variable run time between similar jobs. Have not been able to determine run time changes. We will need to profile. Slow transfer speeds related? Should not be 3. Hadoop setup. We have been receiving Hadoop requests from several campuses, and are looking for each rep to poll their respective campus for interest. a. As Hadoop is a separate from HPC we would need to determine how Hadoop would fit into MGHPCC. Tabled until next month each rep to discuss on campus.

6 6) General announcements Note: Firmware storage update has been scheduled during the May (monthly) downtime window: Wednesday May 7 th, Starting at 9:00am The storage system node firmware upgrade. This work will take ~6 hours. Please note that during this time the cluster will be offline, and all jobs will be stopped before the work begins. Power testing at MGHPCC: entire MGHPCC down. 2014: Monday, August 25, : Monday, May 11, 2015 SSL Heartbeat bug patched on the day of release. MGHPCC New user Signup We have created the following user signup web page for new MGHPCC user access (see below link). Please feel free to forward this link to colleagues and other users for access. Note that the requesting user s PI will need to approve this access via a provided ( ed) link. If the user is the PI, the user will need to approve the access. Please note that access to this URL, and PI approval process is only available via a UMASS network. 7) Adjourn Meeting shall adjourn Al ---