. ATLAS Muon System Data Quality: Tools and Organization... Hugh Skottowe, Kevin Mercurio on behalf of the Muon Data Quality group.. Muon Week: Data Quality session 14 April 2011
. Outline Organization of Data Quality for the muon system Online DQ Overview of online DQ tools Responsibilities of online muon shifter for DQ Offline DQ Overview of offline DQ tools Responsibilities of offline muon DQ shifter Detailed information on implementation of tools for each subdetector will be given in next four talks covering MDT, CSC, RPC, TGC separately 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (2/17)
. Organization of muon DQ Muon Data Quality Coordinator: Mauro Iodice Muon Data Quality Operations Coordinators Run daily DQ meeting, supervise shifters, communicate with experts Monthly rotation between group of four coordinators: Nectarios Benekos, Arely Cortes Gonzalez, Kevin Mercurio, HS Many, many other people responsible for maintaining individual tools for each subdetector To contact all DQ coordinators and experts: atlas-muon-dqa-experts@cern.ch Larger mailing list containing all interested in muon DQ: atlas-muon-data-quality@cern.ch Main forum for Muon Data Quality: Daily Muon DQ and Operations meeting, every weekday at 15:10, 3150 R-002 or R-003 New in 2011: Extended Muon DQ and Operations meeting, every tuesday, 14:45, 3150 R-002: All DQ experts requested to attend! 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (3/17)
. From data Recording to flags DQ: overview 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (4/17)
. Online Data Quality: OHP Tool for displaying small number of histos for shifter to check by eye Crucial to have good documentation and reference histos Also used by ATLAS-wide Data Quality shifter in control room Histograms from L1, L2 (CalibStream) and EF (GlobalMonitoring). 3 tabs of histos for each subdet.select.subdet.double-click to enlarge 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (5/17)
. Online Data Quality: documentation for OHP Crucial to have good documentation: Description and reference histos on twiki Where possible, write info on histogram itself, e.g. RPC timing: 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (6/17)
. Online Data Quality: DQMF online (or DQM Display ) Tool for display and automated flagging of large number of histograms Can navigate by layout diagram, or through tree Algorithms used to fit and flag histograms Flags propagate up through tree, providing overall region or subdet flags.tree:.hierarchy.of regions.and.chambers.subdet layout.shows flag for.each chamber 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (7/17)
. Online Data Quality: DQMF online (or DQM Display ).Select Histograms tab.tree:.expanded.to list.chambers.border colour flag.lots of useful info across 4 tabs, including:. Description. Fit/algorithm results. Reason for flag. What to do if flag is not green. 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (8/17)
. Online Data Quality: other tools Subdetector-specific tools see subdetector-specific talks to follow MDT: gnamon Occupancy monitoring tool RPC: DCS Monitors tower status and trigger rates TGC Status Panel for TGC info including occupancies (panel in igui obtained with Start Partition or Monitor Partition from DAQPanel) 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (9/17)
. Online Data Quality: gnamon (MDTs only... so far) 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (10/17)
. Online Data Quality: DCS (RPC) Useful for spotting trigger hot spots and inefficiencies 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (11/17)
. Online Data Quality: TGC Status Panel 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (12/17)
. Online Data Quality: muon desk shifter in ACR Muon shifter in control room must (see twiki): Check DQ tools Report findings in shift summary elog Describe problems spotted in OHP, DQMF and other tools Even if no problems, should report OK DQ section of shift summary still often left empty! Increasingly important with more stable detector and beams Dedicated DQ shift summary? (to encourage more detail) For each run, fill SHIFTONL flags RunCom tool now used to periodically flash tasklist including DQ checks on to muon shift desk monitors Morning shifter: Attend daily DQ/operation meeting and report on status and problems 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (13/17)
. Offline Data Quality Offline DQ shifter: weekly shift, friday-thursday Purpose of shift: Identify problems and follow them up with experts Decide flags for use in Good Run Lists for physics analysis Responsibilities of shifter: Read daily DQ runs to consider email from atlas-dataquality-automatic-notifications@cern.ch For each run, review DCS flags and SHIFTONL flags Read elogs from past 24 hrs to look for problems and settings/status Review offline DQMF plots in ATLAS DQ webdisplay: https://atlasdqm.cern.ch/webdisplay/tier0/ Present slides showing results and selected plots; propose flags: daily muon DQ meeting at 15:10 Issues from meeting should be described in daily email by shifter to atlas-muon-dqa-experts@cern.ch Attend daily ATLAS-wide DQ meeting and sign off runs on sharepoint by 16:30 deadline (sharepoint signoff and deadline applies also on weekends) Contact coordinators or see twiki for more information 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (14/17)
. Offline Data Quality: Offline DQMF Shows large range of histos Runs algorithms and fits flags Crucial for both online and offline DQMF: Well maintained algorithms: find bad histos but keep low fake red flag rate Flag propagation logic: provide sensible flagging at high level (e.g. using MDT chamber flags to calculate MDT overview flag) 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (15/17)
. Offline Data Quality: defects and sign-off In 2010, flagged each run/lb as green/yellow/red In 2011, have moved to entering list of defects in DB for each run/lb: https://atlasdqm.cern.ch/defectentry/ LBs for STANDBY HV defects now pre-filled from DCS flags (>10% red), but must be checked by offline shifter and signed off before they take effect MS UNCHECKED defect used to indicate whether run has been signed off (is in DB by default, and then marked absent when run is signed off by muon offline DQ shifter) Defects now in run query with / show dq (but only during ATLAS READY) Current list of defects 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (16/17)
. Summary Have given overview of tools and organization of muon system DQ Important to keep tools up-to-date: Documentation Reference histograms Algorithms for automated flagging See following talks for detailed info on: DQ from yesterday s 50ns bunch-gap run 179581 Status and implementation of DQ tools for each subdetector DQ work at calibration centres DQ experiences from 2011 so far 2011/4/14 Hugh Skottowe ATLAS Muon System DQ: Tools and Organization (17/17)