IceCube Project Monthly Report July 2007

Transcription

1 IceCube Project Monthly Report July 2007 Accomplishments The Data Acquisition (DAQ) software processed 1.50 billion events during 2.69 million live seconds in the month of July. The DAQ uptime percentage was 98.8%. A two-week training program for drillers and personnel working on string and IceTop installation was conducted during July in Madison, WI. The participants completed both classroom and hands-on training activities. The training program benefited from the use of the drill test bed at the Physical Sciences Laboratory. The first automated algorithm for determining a good data run was implemented in July. The algorithm uses a wide variety of low-level and high-lever criteria from both detector monitoring data and data verification programs to determine the quality of data in a given run. The algorithm will be further refined as we gain more pre-operations experience. The DOM Main Board assembly and test vendor delivered 2494 tested DOM Main Boards to LBNL, completing shipments on the current purchase order quantity. LBNL exceeded its delivery goal of 2388 Main Board assemblies for this portion of production ahead of schedule. A total of 2447 fully tested and inspected boards were delivered to the DOM integration sites (1332 to PSL, 666 to DESY Zeuthen, and 408 to Stockholm). DOLLARS IN MILLIONS IceCube Project Baseline (M$) Initial In-Ice Strings & IceTop Tanks Installed Initial Operational Capability Project Completion & Closeout CONTINGENCY %ETC INITIAL % CURRENT % Jan-2005 Mar-2007 Sep-2011 Total Project Cost $276.6 Value of Foreign Contributions $34.5 NSF Funding $242.1 Contingency as % of Remaining Costs 24.0 # Strings/Tanks 70/160 Performance and Cost through: 30-Jun COST EARNED VALUE CURRENT BUDGET DEPLOY INITIAL STRINGS & TANKS COMPLETE EHWD INTEGRATION & TEST ORIGINAL BUDGET Scheduled, 75.4 % Performed, 75.4 % Actual Cost, 75% % INITIAL OPERATIONS & DATA ANALYSIS CAPABILITY FULL SCALE DOM PRODUCTION DETERMINE FULL DEPLOYMENT RATE FUNDING FULL OPERATIONS & DATA ANALYSIS CAPABILITY Total Funds (US & NonUS) Current Bdgt (BCWS) Actual Cost (ACWP) Original Bdgt (BCWS0) Earned Value (BCWP) FISCAL YEAR

2 Cost and Schedule Performance The project is 75.4% complete versus the plan of 75.4% complete, as measured using earned value techniques. The earned value measurement includes all tasks completed to date including design, development, procured materials, and the construction of the infrastructure that supports the seasonal installation plan, e.g., the hot water drill, cargo shipments, etc. IceCube Neutrino Observatory Cost Schedule Status Report Reporting Period Ending: 6/30/2007 Cumulative To Date (AY K$) Budgeted Cost 2 Actual Cost Variance Contingency Latest Work Work of Work Budgeted Revised OBS Structure L2 Scheduled Performed Performed Schedule Cost Assigned % ETC AY $s Estimate Variance Sched Perf Project Support 21, , , % 27, , % 77.0% 76.8% Implementation 29, , , , % 44, , , % 66.8% 67.1% Instrumentation 56, , , , % 69, , % 81.3% 80.3% Data Acquisition 31, , , % 33, , % 92.4% 92.4% Data Systems 20, , , % 26, , % 77.0% 77.4% Note 1 At Completion (AY K$) Note 5 Complete (%) Actl Cost Detector Comm. & Verification 15, , , % 22, , % 71.1% 72.0% Pre Operations % % 21.5% 9.9% Subtotal 174, , , , % 224, , , % 77.9% 77.8% RPSC SUPPORT 21, , , , % 35, , % 60.3% 58.0% NSF % 1, , % 57.3% 57.3% Total 196, , , , , % 261, , , % 75.4% 75.0% CONTINGENCY Notes 3,4 15, , ,014.3 IceCube Total Note 2 196, , , , , % 276, , % 75.4% 75.0% Notes: 1 Incorporates approved baseline changes. 2 Total Budget at Completion includes non-us contributions 4,857 K over the amount in the post Hartill III baseline of: 3 Budgeted contingency is: 24.0% of the Budgeted cost of work remaining. 4 Budgeted contingency is: 23.7% of the Estimated Cost to Complete (ETC) 5 All latest revised estimates detailed planning for PY Contingency is assigned to each L-2 element based on the ETC, a bottom-up risk assessment model, management judgement, and cost constraints. $29,698 K 40% IceCube Contingency: % of remaining work 40.0% 30% 20% 10% Original Baseline March '04 Annual Baseline Re-Plan June '05 Annual Baseline Re-Plan Additional Installation Season 10 Ice-Top Stations March '06 Baseline Re-Plan Feb '07 RPSC Re-Plan PY5 Closeout PreOperations April ' % 30.0% 20.0% 10.0% 0% Feb-04 Jun-04 Oct-04 Feb-05 Jun-05 Oct-05 Feb-06 Jun-06 Oct-06 Feb-07 Jun % 2

3 Item Description Risk Assessment & Potential Contingency Adjustments Potential Contingency Adjustments Additional Notes Assign contingency to mitigate technical, cost and schedule risks associated with the defined scope of work. The cost to retro IceCube equipment/materials from the South Pole at the end of the project was not included in the baseline budget Improvements to the data archiving system in the South Pole IceCube Laboratory and in the UW central data warehouse. Improvements include both hardware and software. Additional Pre-Operations activities to be completed prior to completion of the construction project. $7,500K $1,500K $216K $700K Risk model applied at WBS-Level 4 to assess appropriate contingency as a percent of the cost of work remaining. This number represents a worst-case scenario if all drill equipment is returned after the 2010/11 drilling season. A more likely scenario would cost less than one half of this amount. Change request IC0106 was approved on 08/01/07 and will be reported as an approved change next month. During the first three years of initial operations it may be necessary to conducting engineering runs concurrent with operations to debug software and ensure reliability of the installed equipment. Restore 80-string configuration $5,500K This is the current estimate of restoring the array to the 80-string configuration described in the original IceCube proposal. 6/30/2007 Change Log - IceCube Total Project Budget Baseline ($K) No. Description Date Approved Total Baseline Allocated Budget Allocated Budget Change Contingency Budget Estimate To Complete (ETC) Budgeted Cost of Work Remaining Contingency % of Remaining Work NA Status as of May 2007 CR098 CR 0098 Adjust Drillers Labor CR108 CR 0108 Correct LBNL Rates NA Status as of June , , ,819 68,516 67, % 06/27/07 276, , ,693 07/18/07 276, , , , , ,420 65,193 64, % Drill Operation and String Installation The annual Driller and Installer Training was held at the University of Wisconsin Physical Sciences Laboratory from July 23 through August 3. The new Test Bed was used for the training. Safety was a key component of training this year and 3

4 was integrated and discussed throughout the two weeks. To emphasize the importance of safety, a Caterpillar 287 was used during this time. Members from RPSC and IceCube will be meeting on September 12 in Madison. This meeting will provide RPSC and IceCube a chance to review all schedules and plans. Digital Optical Module and Cable Production Status and Plans - There are no major issues with instrumentation production. The plans provide instrumentation well in advance of the installation dates and support the use of the least expensive shipping methods. The actual status of DOM integration is provided in the following chart. IceCube DOM Integration PY6 (April, 2007 to March, 2008) - Plan vs. Actual DOMs ready for PSL - cumulative plan DOMs ready for DESY - cumulative plan DOMs ready for Swed - cumulative plan DOMs ready for DFL - cumulative plan all sites DOMs ready for DFL - cumulative actual all sites Quantity of DOMs ready for DFL /7/2007 4/21/2007 5/5/2007 5/19/2007 6/2/2007 6/16/2007 6/30/2007 7/14/2007 7/28/2007 8/11/2007 8/25/2007 9/8/2007 9/22/ /6/ /20/ /3/ /17/ /1/ /15/ /29/2007 1/12/2008 1/26/2008 2/9/2008 2/23/2008 3/8/2008 3/22/2008 Week ending Detector Commissioning and Verification - Numerous high-level verification plots have been incorporated into the standard monitoring pages. These more sophisticated tools will enable us to better track down errors and will also make it possible to view trends in these high level quantities. The verification suite is ready for implementation in PnF, where it will benefit from running on data that has the most accurate calibration constants and detector configuration parameters. The first good run determination algorithm is in place. It uses a wide variety of low-level and high-lever criteria from both monitoring and verification to determine the quality of data in a given run. The algorithm will be further refined as we gain more operational experience. Calibration - We have an initial PMT/saturation curve from three DOMs and are now studying the systematics of that analysis. When we fully understand these results, we will be able to quickly generate the curves for all of the I-9 DOMs, and will be ready to acquire the required 4

5 dataset for the other DOMs in I-22. collaboration with Penn State. This work is being done in New Zealand in close The third stage of the geometry calibration using muon tomography is underway. For the bulk ice calibration, additional data was collected from the bottom 20 DOMs. An initial analysis indicates that the data is very good. The next step is to improve the Monte Carlo to take into account the possibility of the asymmetric phi distribution of light coming from the 6 LEDs. Data Acquisition System Hardware The remaining primary deliverables for the DAQ hardware group at LBNL for this project year are DOM Main Board Assemblies, and final design documentation for the DOM Hub Industrial Computers. DOM Main Board production continues to progress smoothly and without any major issues. The vendor has been able to meet all of their quality and shipping commitments to date. The assembly and test vendor has delivered 2494 tested DOM Main Boards to LBNL and has completed shipments on the current purchase order quantity. LBNL has delivered 2447 fully tested and inspected MBs, on schedule, to the DOM integration sites, 1332 to PSL, 666 to DESY Zeuthen, and 408 to Stockholm. The LBNL delivery goal for this portion of production is 2388 MB Assemblies to all integration sites by the end of September. LBNL will continue to ship fully tested, deployment quality Main Boards from current and past production cycles until the stock on hand is fully depleted. The final production run of DOM Main Boards is now in the baseline plan and a continuation of the fabrication contract with Sanmina will be initiated when funding is available. The Rev3 DOM Hub design documentation is 100% complete, and all documents have been released to UW. All DOM Hub spare parts have been shipped to UW Madison. Data Acquisition Software Events =1.50 billion, Live Seconds = 2.69million, and Uptime Percentage = 98.8% Figure 1 - Daily Log of pdaq Uptime for July

6 The month of July proved an extremely stable running period for the IceCube Data Acquisition with a loss of live running time of only slightly greater than one percent, most of which is attributable to maintenance activities and other planned operator interventions. Software activities which took place this month included planning and implementation of support for DOM flasherboard control in pdaq. To this point only TestDAQ was capable of conducting the flasherboard runs used for calibration of detector geometry, ice properties, and detector response to large signals. The pdaq includes vast improvements to data acquisition and real-time triggering and building of events compared to TestDAQ and its support of calibration runs will facilitate collection and processing of these data sets. The new flasherboard software is still under test at the northern hemisphere test system SPTS, however we anticipate its release in late-august well in time to support calibration runs during the South Pole Summer season. In addition to flasherboard support, the DAQ development team is working on a full simulation of the 40-string (and eventually 80-string detector) on SPTS in order to gain confidence that the DAQ software will scale to accommodate the additional channels next year. This effort is requiring substantial improvements to several subsystems including I/O and memory management to improve code performance. No major obstacles requiring redesign of the basic system have been uncovered and the DAQ group expects that both 40 and 80-string simulations will be possible by the fall. Data Handling - South Pole systems in the ICL continue normal operation. Data rates on the satellite during normal TDRSS operations are on the order of 20 GB/day. Figure below shows the satellite usage for the month of July. There were some periodic TDRSS outages during the month. Figure 2 - Satellite Usage for July

7 Operation, maintenance and upgrades to the UW data center and data warehouse to keep pace with incoming data from IC-22 continued during this month. Preliminary planning for replacement of components in the South Pole tape archiving system was done. The drives at Pole are failing, likely due to drywall micro-dust in the ICL. The new drives and library system will be protected against this environmental element. Filtering, Software & Database - The IC-22 online physics filtering was successfully deployed in July. JEB/PnF merging of IceCube-22 and Amanda TWR data streams continues at South Pole sending filtered data sets of approximately 20GB/day over the satellite. The figure on the next page shows the IceCube status page with filter passing rates for the individual physics filters at the bottom. Simulation - Work continued towards the major milestone of the IceSim 2.0 production release. IceSim 2.0 will be the production version of the Monte Carlo for IC-22 simulation over the next year. A pre-production release candidate was completed and began production testing. Full production with the final IceSim 2.0 is now scheduled to begin in August. Experiment Control - The experiment control system is running at Pole and coordinating all subsystem configuration start/stop and status information for all IceCube subsystems (i.e. p-daq, JEB/PnF/Spade/TWR-daq). Final feature set and improved ease of use for operators is continuing. Figure 3, in the software section above, is a screen shot from one of the several Experiment Control Subsystem Monitoring pages. This page is available in the north via web page and is updated 24/7 though the iridium system. 7

8 Figure 3 - Experiment Control Subsystem Monitoring Quality Assurance and Safety There are no significant issues to report. The monthly reports are posted at IceCube Monthly Reports. Meetings and Events Season Planning Wrap-up, UW-Madison, Wisconsin Collaboration Meeting, University of Gent, Brussels, Belgium September 12, 2007 October 6 11,