R. GIACHINO, M. ALBERT LHC MACHINE CHECKOUT 2015
QUENCH 2
SATURDAY PNO.b3 in RQD.A45 and RQF.A45 Tripped a few minutes after flattop 3
SATURDAY RQF.A12 tripped at while at nominal. Earth fault still present RQ9.L2 : QPS not OK Quench heaters discharged Piquet intervention OK RB/RQD/RQF in 45 reached the flat top. 4
SATURDAY RB.A78 tripped while going to standby. PC trip at 17:39.38. signal I_EARTH_PCNT = -109% disappeared after. 5
SATURDAY - COLLIMATORS Test of collimator sequences TCDQ B1 / B2 PROFILE_OUT_OF_ENERGY ERROR position is within limits but error cannot be reset PRSStatus FAULTY - unable to reset it Energy limit: 45mm Collimator position: 15mm Ramp & SQUEEZE of collimators movement + sequences OK 6
SATURDAY - COLLIMATORS Collimator MP tests of limit functions successful all collimators ARMED with RAMP functions (except TCDQ) TCDQ has interlock due to wrong energy value PRS moves but MDC not all OK MDC moves with functions and PRS is not started: collimators correctly stopped all OK 7
SATURDAY pre-cycle S23, 56, 67, 81 RAMP/SQUEEZE/RAMPDOWN of S23, S56, S67, S81 RSD2.A67B1 tripped at end of ramp down. Looks like quench due to zero voltage crossing. RSD1.A67B1 and RSF2.A67B1 subsequently trip 8
SUNDAY PGC1.1 on ARC45 RCO.A45B1/2 RCD.A45B1/2 RCS.A45B1 tripped @ FT 9
POWERING GROUPS OF CIRCUITS 10
SUNDAY REMAINING HWC TESTS PGC1.1 on ARC45 done but trips of: RCO.A45B1/2, RCD.A45B1/2, RCS.A45B1 @ FT 11
SATURDAY PC s issues: RQF.A12. ELQA done nothing found. Trip at nominal no quench Earth fault >> EPC Piquet Intervention Nothing found on the converter side. RQT13.R1B1 tripped S12 (not powered since) RQD.A45 and RQF.A45 Tripped a few minutes after flattop >> Reset OK RSD2.A67B1 RSD1.A67B1 RSF2.A67B1 tripped at end of ramp down RB.A78 tripped while going to standby from FT Earth Fault disappeared after 15 mins. RCO/RCD.A78B1 trip at the end of the ramp!!! 5 th time Three quenches in a shift... 12
WEDNESDAY PC s issues: RQF.A12. ELQA done nothing found. Trip at nominal no quench Earth fault >> EPC Piquet Intervention Nothing found on the converter side. Standard procedure in case of an earth fault is to perform HV qualification by ELQA. From the voltage feelers it seems that the earth fault is in the warm part so I would suggest that ELQA goes in on monday. Also better to first perform some simulations (Emmanuele, Monday) before we power the circuit again. Arjan 13
WEDNESDAY PC s issues: RB.A78 tripped while going to standby from FT Earth Fault disappeared after 15 mins. 14
RB.A78 I_MEAS and I_EARTH_PCNT ~17:39:53@600A Ground fault, fuse gone (1A or 100mA?) ~17:57 No fault anymore? Or next fuse? 15
RB.A78 nqps DS: U_DIODE signals 16
RB.A78 nqps: Voltage feelers (1) 17
RB.A78 nqps: Voltage feelers (2) 18
RB.A78 nqps: Voltage feelers (3) 19
SATURDAY Ramp of RCO.A78B1 to 105A and RCD.A78.B1 to -560A => Tripped after 55min Later both circuits tripped again after almost 1 h at high current 20
INVESTIGATION ON RB.A34 FAULT TO GROUND Investigation continued Precise fault localization through electrical measurements performed in the tunnel by ElQA team (including reflectometry) X-ray imaging to localize precisely the short Many Lab tests to simulate the behaviour of the short in a configuration as close as possible to the one of the tunnel Several possible solutions investigated and risk analysis assessed Cryogenic investigation to try a local displacement Local heating of the diode via injection of small current Local (global) warm-up. Injection appropriate current through the fault to try moving/eliminating it A19L4 25-26.03.2015 C19L4 21
INVESTIGATION ON RB.A34 FAULT TO GROUND Investigation continued Summary: the power part of the system to burn the debris is working correctly, the DAQ electronics is working correctly, but only at low range the capacitor bank charging voltages, for high charging voltages the recorded signals are unphysical and not easy to interpret. Rescheduled not before Monday A19L4 25-26.03.2015 C19L4 22
ACCESS REQUESTS WHO WHERE WHEN WHAT Duration RF UX45 RF setting-up BIS IR3 & 4 Back to nominal 3 hrs. BIS Ua63& 67 28/3 Bis team 3 hrs EN/MME Point 4 Xray Material 2 hrs. Alice 28/3 8 hrs. ELQA Point 4 Earth fault intervention 23
WEEK-END PLAN Preparation for RB.A34 earth fault test >> Monday Priority to PGC s RB.A45 and all the remaining circuits. Full Operational machine cycle tests BIS interlock tests Nominal sequence tests Precycle, ramp and squeeze in all possible sectors RF tests Collimator tests LHC and experiments mostly closed during week end https://indico.cern.ch/category/6386/ 24
OPERATIONAL CYLE Nominal sequence : signature missing for CHECK MKD MCS SETTINGS SET BETS READTABLES TRUE failed: ABT is working on it HW/database mismatch for ABORTGAP CLEAN parameters BPM calibration failed : host not reachable >>BI informed BCT OFFSET correction failed because system B not OK DC BCT calibration finished. Overall result: SUCCESS BLM MCS checks failing for2 card only BLM sanity check and MCS ok now Issue when loading the TCDQ B2 Injection Protection collimators: machine protection tests on-going 25
BEAM INSTRUMENTATION BLM system operational BLM BIS user permit should be enabled BLM MCS and SANITY CHECKS finished BLM team need more tests. New thresholds and monitor factor uploaded tests ongoing Wirescanners Operational BI/OP tests RBAC problem for BCT, BLM Tasks updating with the 2 new crates (Laurette), BPM calibration failed device not accessible RING DC-BCT calibration task not working >> Done 26
THURSDAY NIGHT Collimators B1 and B2 Collimators have been sent to parking B1&B2 colls at injection settings Collimators ARMED RAMP functions except TCDQ More tests continue TCDQ B1 / B2 PROFILE_OUT_OF_ENERGY ERROR TCDQ B1 / B2 PROFILE_OUT_OF_ENERGY ERROR TCDQA.A4R6.B1 failed in inj. Settings The position is within limits reset does not work! 27
WEDNESDAY Cryogenic status: OK S34 at 3.2 K 28
A19L4 25-26.03.2015 C19L4 29
SATURDAY Continuation of HWC tests on main circuits in S45 (PNO.a6) RAMP & SQUEEZE of sectors 23, 56, 67, 78, 81 Trip of RQ9.L2 (QPS problem, fixed after access @ P2) RB.A78 tripped @ 17:39 while going to STANDBY. Earth Fault disappeared after 20 min. RB, RQD, RQF in 45 to IPNO + 100A for 2h after PNO.a6 30
SATURDAY - COLLIMATORS Test of collimator sequences TCDQ B1 / B2 PROFILE_OUT_OF_ENERGY ERROR position is within limits but error cannot be reset PRSStatus FAULTY - unable to reset it Energy limit: 45mm Collimator position: 15mm Ramp & SQUEEZE of collimators movement + sequences OK 31
SATURDAY - COLLIMATORS Collimator MP tests of limit functions successful all collimators ARMED with RAMP functions (except TCDQ) TCDQ has interlock due to wrong energy value PRS moves but MDC not all OK MDC moves with functions and PRS is not started: collimators correctly stopped all OK 32
S 12 QF.A12 trip (Wednesday) 33
WEDNESDAY S 12 QF.A12 trip (Saturday) 34
REMAINING ISSUES Vacuum valve MSI-TI2 (VVGS.29528) interlock SPS EXT1 master BIC to be tested extraction conditions established >> Markus - BIC LHC probe beam re-phasing issues, stability issues => often BQM interlocks Threshold increased, to be checked with beam BTVDD image orientation > on hold until LBDS experts decide on preference BI-ABT decision to be made >> Jan -BI Controls: CMW/RDA issue affecting several clients new libraries released CIBDS problem while arming LBDS > Bruno, ongoing LBDS-XPOC: Missing BI data: (BCTFR, BSRA, etc..) >> Nicolas M- BI 35
TEST TO BE DONE BIS LOOP CLOSED Vacuum valves test with BIS loop closed LBDS BETS with 45 finished Circulate and Dump 36
FRIDAY Access in the morning Deployment & restart of LHC-SIS (new MKI FESA classes) Trimming of the RF voltage OK RCO.A78B1 to +105 A RCD.A78B1 to -560 A -> quenched at about -545 A RCO.A78B1 RCD.A78B1 37
FRIDAY Collimator MPS tests IP7: software & hardware reboot on TCSG.A4L7.B2 OK IP3: software & hardware reboot on TCSG.4R3.B1 - OK Test LOCAL MODE all OK ADT-FGC configuration updated => loading settings for injection OK FPA in RB.A78 at 2 ka LHC SEQ: BLM MCS and SANITY CHECKS OK PGCs on XR5 and XL1 Manual ramps on RQT12, RQT13, RQTL11 Again trip of RCO/RCD.A78B1 during the ramp 38
POWERING GROUPS OF CIRCUITS GPM OK RCD+RCO PGC1.1 PGC1.2 PGC1.3 PGC1.4 PGC1.5 PGC1.6 COMPLETED ARC12 Yes 17/02-19:25 20/02-20:41 13/03-00:45 13/03-17:12 LR1 Yes 24/02-13:09 04/03-23:01 ML2 Yes 03/03-17:57 04/03-23:58 IT.R1 Yes 23/03-23:42 16/03-21:06 IT.L2 Yes 17/03-00:01 17/03-06:11 ARC23 Yes 10/03-22:19 13/03-18:00 14/03-13:19 16/03-22:30 MR2 Yes 03/03-18:08 10/03-16:39 IT.R2 Yes 23/03-21:55 16/03-21:43 ARC34 ML4 Yes 22/03-12:03 22/03-23:52 ARC45 MR4 Yes 15/03-01:44 15/03-19:37 LL5 Yes 14/03-00:02 15/03-18:54 IT.L5 Yes 23/03-23:43 17/03-00:28 ARC56 Yes 14/03-04:19 14/03-14:46 16/03-01:33 17/03-01:32 LR5 Yes 14/03-00:17 15/03-19:14 ML6 Yes 03/03-18:38 06/03-00:16 IT.R5 Yes 23/03-23:45 24/03-03:09 ARC67 Yes 14/02-08:40 11/03-00:31 12/03-14:17 13/03-18:30 MR6 Yes 20/02-21:01 05/03-02:33 ARC78 Yes 21/03-14:10 21/03-17:33 22/03-19:43 23/03-20:00 ML8 Yes 03/03-18:15 11/03-02:38 IT.L8 Yes 23/03-19:18 24/03-00:27 ARC81 Yes 13/03-17:52 14/03-13:10 17/03-03:26 17/03-05:40 MR8 Yes 03/03-18:28 11/03-01:58 LL1 Yes 13/03-21:14 15/03-19:20 IT.R8 Yes 14/03-12:45 16/03-20:59 IT.L1 Yes 24/03-15:54 21/03-02:38 Cryo tuning to be improved 39
JPhT 30.03.2015 Credits to EN-MME Big thanks to A Piguiet,JM Dalin, G Arnau, A Porret For flexibility, reactivity, quality of the work RADIOS FROM TOP C19L4 BEFORE
41
Resolution : < 0.5 mm 42
43
44
FROM A CLOSED INTERCONNECTION, BEST ANGLES TO RADIOGRAPHY THE HALF MOON OF THE DIODES Axe2 Axe1 45
46
47
48
49