# PHYSVAL TODOS ## Official validation rounds reminder: DSIDs were 410000 and 427080 usual fluctuations: http://atlas-computing.web.cern.ch/atlas-computing/links/PhysValDir/Btagging/Rel21_01-10-2020/topic2/ROC/SV1.pdf --- ### July 29th Task 1a - Ref 1 r12861_p4668_p4450 (22.0.34 without pile-up) https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38601/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12861_p4668_p4450_tid26306976_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12861_p4668_p4450_tid26306860_00 - Test 1a r12849_p4668_p4450 22.0.39 w/0 pile-up https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38548/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12849_p4668_p4450_tid26288743_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12849_p4668_p4450_tid26288654_00 Task 1b - Ref 1 r12861_p4668_p4450 (22.0.34 without pile-up) https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38601/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12861_p4668_p4450_tid26306976_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12861_p4668_p4450_tid26306860_00 - Test 1b r12849_p4676_p4681_p4450 22.0.39 w/o pile-up via DAOD_PHYSVAL https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38548/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12849_p4676_p4681_p4450_tid26312324_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12849_p4676_p4681_p4450_tid26312256_00 --- ### July 15th 1) Validation of mc20a: Tasks 1a and 1b from https://its.cern.ch/jira/browse/ATLPHYSVAL-781 2) Validation of Track Geometry cond Alg (MC): Task 1 from https://its.cern.ch/jira/browse/ATLPHYSVAL-787 3) Validation of G4 with EMEC custom solid: Task 1 https://its.cern.ch/jira/browse/ATLPHYSVAL-785 4) Validation of Pile-up model including leptons from b-decays Task 4 from https://its.cern.ch/jira/browse/ATLPHYSVAL-748 #### Task 1a We expect similar differences to those observed comparing mc16e v4 to old run2 conditions with the same pile-up in ATLPHYSVAL-746 **Ref**: r12788_p4525_p4450 ~~https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38304/~~ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12788_p4525_p4450_tid26125587_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12788_p4525_p4450_tid26125458_00 **Test**: r12802_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38396/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12802_p4525_p4450_tid26189581_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12802_p4525_p4450_tid26189408_00 #### Task 1b We expect similar differences to those observed comparing mc16e v4 to old run2 conditions with the same pile-up in ATLPHYSVAL-746 **Ref**: r12787_p4525_p4450 ~~https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38305/~~ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12787_p4525_p4450_tid26125518_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12787_p4525_p4450_tid26125237_00 **Test**: r12801_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38395/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12801_p4525_p4450_tid26189473_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12801_p4525_p4450_tid26189279_00 #### Task 2 **Ref**: r12744_p4647_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38077/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12744_p4647_p4450_tid26180928_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12744_p4647_p4450_tid26188962_00 **Test**: r12745_p4647_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38077/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12745_p4647_p4450_tid26189018_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12745_p4647_p4450_tid26189036_00 #### Task 3 **Ref**: s3702_r12697_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37956/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3702_r12697_p4525_p4450_tid25930455_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3702_r12697_p4525_p4450_tid25930331_00 **Test**: s3705_r12697_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38279/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3705_r12697_p4525_p4450_tid26109984_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3705_r12697_p4525_p4450_tid26128395_00 #### Task 4 **Ref**: s3227_r12627_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00 **Test**: s3227_r12780_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38268/ - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12780_p4525_p4450_tid26119368_00 - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12780_p4525_p4450_tid26119253_00 --- ### July 1st https://its.cern.ch/jira/browse/ATLPHYSVAL-779 We will have our next PhysVal meeting this Thursday, July 1st @ 15:00 CERN time: https://indico.cern.ch/event/1021653/ There will be two tasks: - Validation new G4 version in r21 vs r22. - Validation of old G4 version vs new in r21. --- **Task 1**: new G4 in r22 (s3702) vs r21 (s3691). Ref: s3691 (r21) r12697: https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37880/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3691_r12697_p4525_p4450_tid26010638_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3691_r12697_p4525_p4450_tid26010500_00** Test: s3702 (r22) r12697: https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37956/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3702_r12697_p4525_p4450_tid25930455_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3702_r12697_p4525_p4450_tid25930331_00** --- **Task 2**: r21 old G4 version (s3227) vs new (s3692). Ref: s3691 (r21) r12697: https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37880/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3691_r12697_p4525_p4450_tid26010638_00)** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3691_r12697_p4525_p4450_tid26010500_00** Test: s3227 r12697: https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37879/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12697_p4525_p4450_tid25825181_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12697_p4525_p4450_tid25870368_00** --------------------------------------------------- ### May 20th Task 1a: validation of final r-tags for 2nd round of CP samples, no pile-up JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759 - Reference (mc16e): r12576_p4525_p4450 (running, ready in O(1 day)) https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37014/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12576_p4525_p4450_tid25601865_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12576_p4525_p4450_tid25601780_00** - Test (mc20e): r12631_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37385/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12631_p4525_p4450_tid25570069_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12631_p4525_p4450_tid25569962_00** - Reference vs test: expect differences related to beamspot weighting (can compare against https://its.cern.ch/jira/browse/ATLPHYSVAL-712), differences between 22.0.30 vs 22.0.34 ---------------------------------------------------- Task 1b: validation of final r-tags for 2nd round of CP samples, with pile-up JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759 - Reference (mc16e): r12585_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36990/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12585_p4525_p4450_tid25540446_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12585_p4525_p4450_tid25581871_00** - Test (mc20e): r12627_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00** - Reference vs test: expect differences related to beamspot weighting (can compare against task 1a here https://its.cern.ch/jira/browse/ATLPHYSVAL-712), different pile-up profiles, differences between 22.0.30 vs 22.0.34. ---------------------------------------------------- Task 2: validation of final r-tags for 2nd round of CP samples, with pile-up JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759 - Reference (mc20e): r12627_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00** - Test (mc20d): r12629_p4525_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37383/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12629_p4525_p4450_tid25569888_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12629_p4525_p4450_tid25569718_00** - Reference vs test: comparing sub-campaigns. --- ### April 29th Task 1: beamspot reweighting JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-712 - Task 1a: Reference 1a vs Test 1 We expect real differences due to narrower beamspot in pile-up and reweighted Hard scatter in variables sensitive to the Z-beamspot position - Task 1b: Reference 1b vs Test 1 We expect differences equivalent to normal pile-up fluctuations **Reference 1a: 42mm HS, 42 mm PU** Sim in Athena 21.0.119 s3636 Digi+Reco in Athena_22.0.26 (r12421) RDOtrig in 21.0.121 (called in r12421) NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500) s3626_r12421_p4500_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36076/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3626_r12421_p4500_p4450_tid25352751_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3626_r12421_p4500_p4450_tid25361675_00** **Reference 1b: 35mm HS, 35 mm PU** Sim in Athena 21.0.119 s3636 Digi+Reco in Athena_22.0.26 (r12428) RDOtrig in 21.0.121 (called in r12428) NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500) s3652_r12428_p4500_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36175/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3652_r12428_p4500_p4450_tid25352686_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3652_r12428_p4500_p4450_tid25361526_00** **Test 1: 42mm HS 35mm PU with BS RW** Sim in Athena 21.0.119 s3636 Digi+Reco in Athena_22.0.26 (r12434) RDOtrig in 21.0.121 (called in r12434) NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500) s3626_r12434_p4500_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36076/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3626_r12434_p4500_p4450_tid25352756_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3626_r12434_p4500_p4450_tid25361602_00** --- Task 2: JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-748 - Task 2a ) Reference 2a and 2b vs Test 2a This compares the old pythia tune having v2 (ref 2a) or v4 (ref 2b) conditions to the new EPos+A3 tune with v2 conditions - Task 2b) Reference 2a and 2b vs Test 2b This compares the old pythia tune having v2 (ref 2a) or v4 (ref 2b) conditions to the new EPos+A3 tune with v4 conditions - We expect differences in variables sensitive to pile-up and recent changes in noise thresholds (all samples in task 2 use 42mm BS for HS and PU) **Reference 2a (22.0.30 with pythia pile-up, v2 conditions )** Digi+reco in 22.0.30, r12522 NTUP_PHYSVAL in 22.0.32: p4479 r12522_p4479_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36757/ sames as ref 2 with pile-up in ATLPHYSVAL-746 - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12522_p4479_p4450_tid24911462_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12522_p4479_p4450_tid24913332_00** **Reference 2b (22.0.30 with pythia pile-up, v4 conditions)** Digi+reco in 22.0.30, r12531 (r12522->r12531) postExec for TRT PHF>0.3 RDOtoRDOTrig in 21.0.124 (called in r12530) NTUP_PHYSVAL in 22.0.32: p4479 r12531_p4479_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36830/ same as test with pile-up in ATLPHYSVAL-746 - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12531_p4479_p4450_tid24911602_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12531_p4479_p4450_tid24914786_00** **Test 2a (22.0.30 with Epos +A3 pile-up v2 conditions)** Digi+Reco in Athena_22.0.30 (r12570) RDOtrig in 21.0.121 (r12568) NTUP_PHYSVAL in 22.0.32 (p4479) r12570_p4479_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36989/ - **ttbar: running** https://bigpanda.cern.ch/task/25370809/ - **Zprime: running** https://bigpanda.cern.ch/task/25370847/ **Test 2b (22.0.30 with Epos +A3 pile-up v4 conditions)** Digi+Reco in Athena_22.0.30 (r12570) RDOtrig in 21.0.121 (r12569) NTUP_PHYSVAL in 22.0.32 (p4479) r12569_p4479_p4450 https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36990/ - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12569_p4479_p4450_tid25370888_00** - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12569_p4479_p4450_tid25370947_00** --- ### Specific todos on Apr 20th - [x] ~~write an email for the samples that can't be downloaded~~ - [x] prepare 'summary' slides for the validation round last week - [x] look at the bug James reported - [x] produce the missing plots - [x] do the AF3 without / with comparison - [x] take care of the samples for Martino - [x] write the follow-up email - [ ] put this into the tutorial: maybe you can try one quick thing: logout from the xterm and then just do "setuATLAS, then lsetup rucio, and the voms command, try again a rucio download. I mean start from a clean fresh indows and setup. notes :) - ref and test sample in the MT vs MP validation (task 2 here: https://its.cern.ch/jira/browse/ATLPHYSVAL-690) - `r12416_r12508_p4464_p4450` - `r12416_r12506_p4464_p4450` - -> difference only in the r-tag -> MP vs MT applies to the reco step - the 'broken' p-tag (which does not have the new code, but --doBTag disabled): **p4464** - since then, newer p-tags were generated -> including the new code, e.g. **p4475** (22.0.32-nightly, April 12th) - the newer p-tag was used in the r.30 validation, there all plots are there and all is fine --- ### April 15th - todo - [x] task 2 ttbar - [x] task 2 zprime - [x] task 3a ttbar - [x] task 3a zprime - [x] task 3b ttbar - [x] task 3b zprime --- - ~~Task 1) Athena MT vs MP comparison in 22.0.30~~ ~~Reference: MP 8 cores 22.0.30~~ ~~• r12416_r12508_p4464_p4450~~ ~~• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/35770/~~ ~~Test: MT 8 threads 22.0.30~~ ~~• r12416_r12506_p4464_p4450~~ ~~• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/35770/~~ ~~Expectations: Expect identical agreement, no ftag nor plfow_flowelements plots.~~ --- - Task 2) Follow up on final AF3 validation JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-741 (task 2 in the ticket) Reference 2: (G4 + F4fix for QS with pile-up digi+reco in rel22) • Sim in Athena-21.0.42 with G4Fix in 21.0.124 (s3668) • Digi+Reco in Athena_22.0.24 (r12340) • NTUP_PHYSVAL in Athena_22.0.24 (p4360) • merge NTUP_PHYSVAL in 22.0.29 (p4450) • ~~s3227_3668_r12340_p4360_p4450~~ “s3668_r12340_p4360_p4450” • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36676/ • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3668_r12340_p4360_p4450_tid24862138_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3668_r12340_p4360_p4450_tid24862080_00** Test 2: (AF3 with QS particles with pile-up digi+Reco in rel22 ) • Sim in 21.0.123 (s3659) • Digi+Reco in Athena_22.0.24 (r12340) • NTUP_PHYSVAL in 22.0.24 (p4360) • merge NTUP_PHYSVAL in 22.0.29 (p4450) • s3659_r12340_p4360_p4450 • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/30954/ • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3659_r12340_p4360_p4450_tid24828575_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3659_r12340_p4360_p4450_tid24828617_00** Expectations: Similar differences to task 1b from the JIRA issue, particularly interested in differences in the jet distributions --- - Task 3a) 22.0.30 validation, no pile-up JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-742 Reference • Digi+reco in 22.0.26 • NTUP_PHYSVAL in 22.0.32-nightly: p4475 • r12456_p4475_p4450 • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36219/ • Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36219 • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12456_p4475_p4450_tid24858626_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12456_p4475_p4450_tid24862397_00** Test • Digi+reco in 22.0.30, r12521 • NTUP_PHYSVAL in 22.0.32-nightly: p4475 • r12521_p4475_p4450 • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36633/ • Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36633 • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12521_p4475_p4450_tid24865034_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12521_p4475_p4450_tid24864985_00** --- - Task 3b) 22.0.30 validation, with pile-up JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-742 Reference • Digi+reco in 22.0.26 • NTUP_PHYSVAL in 22.0.32-nightly: p4475 • r12455_p4475_p4450 • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36212/ • Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36212 • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12455_p4475_p4450_tid24858865_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12455_p4475_p4450_tid24862275_00** Test • Digi+reco in 22.0.30, r12522 • NTUP_PHYSVAL in 22.0.32-nightly: p4475 • r12522_p4475_p4450 • https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36757/ • Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36757 • **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12522_p4475_p4450_tid24860549_00** • **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12522_p4475_p4450_tid24862516_00** Expectations: test samples include FTAG-related and MET tau term fixes (and possibly others). --- ### March 4th - MT vs MP: https://its.cern.ch/jira/browse/ATLPHYSVAL-690 - ref: r12416_r12416_p4368_p3821 *(-> valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12416_r12416_p4368_p3821_tid24434841_00)* - test: r12416_r12422_p4368_p3821 - QSP Test 3: https://its.cern.ch/jira/projects/ATLPHYSVAL/issues/ATLPHYSVAL-701 - ref: s3227_r12287_p4360 - test: s3634_r12287_p4360 - test3: s3653_r12320_p4360 - todo - ~~re-run ROC curves with right root version ^^~~ - ~~update task 2 presentation with new ROC curves and orange status~~ - ~~make task 1 presentation~~ - ~~send email~~ - ~~info to Arnaud for intro slides~~ - ~~change label of Zprime ROCs to Zprime~~ - ~~make special plots for ttbar~~ - Disc quota is exceeded ... move some folders - ~~redo task2a with new code~~ --- ## Private validation of new code - run old code vs new code - test sample: referece (MT) of MT vs MP validation: - AOD: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.recon.AOD.e4993_s3227_r12416_r12416_tid24344014_00 - NTUP_PHYSVAL: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12416_r12416_p4368_p3821_tid24434841_00 ## New variables / changes to add to the new code ## Bugfixes and questions - why is DL1rnn not properly filled before r.19? test sample: (r.18) `valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.recon.AOD.e5362_s3227_r12153_r12215_r12153_tid23211423_00` - why is DL1r not properly filled in r21? test sample: - (r.24 crashes on the grid) ## Thoughts about plot shifter selection - global: - jet pt, eta for b, l - B truth Lxy - track variables: - z0, d0, sigz0, sigd0 - num tracks (from HF ?) - track pT frac - SV variables: - SV1 num vtcs - SV1 Lxy - SV1 mass ??? - Jet Fitter num vtcs - purity - tagger related: - IP3D grade of tracks, num tracks - SV1 n good tracks - DL1r pb pc pu ? IP3D d0 and z0 ? - discriminant values & ROC curves: - IP3D, SV1, JetFitter, MV2c10, DL1r, (DL1 or RNNIP) ## Tasks done :) - ~~deltaR(BHadron, jet) & deltaR(CHadron, jet)~~ - ~~code is changed, currently running test plots~~ - ~~plots look ok :)~~ ![](https://juhofer.web.cern.ch/juhofer/PHYSVAL/testHistoDefs_compare_new_versions_v02/AntiKt4EMTopoJets/jet/jet/BTag_AntiKt4EMTopoJets_truth_deltaR_truthBHadron_jet_b.png =200x) ![](https://juhofer.web.cern.ch/juhofer/PHYSVAL/testHistoDefs_compare_new_versions_v02/AntiKt4EMTopoJets/jet/jet/BTag_AntiKt4EMTopoJets_truth_deltaR_truthCHadron_jet_c.png =200x) - ~~check if the new code runs on r21~~ - ~~extend range of any fraction variables to not have events in the overflow bin~~ - solution to the large number of events in the overflow bin: - I wasn't careful in checking for divides by zero, and the nan/inf from those events (where the total number of tracks is zero) is filled in the overflow bin -> those events are set to -1 now (i.e. in the underflow bin) - ~~for SV1 fracTracksFromX variables: implement a check against divide by zero~~ - ~~change range of PV x, y, and z~~ - ~~x and y in range (-0.75, -0.25)~~ - ~~commit the updated ROC curves post-processing script to git~~ - ~~Arnaud will clean the script a bit before~~ - ~~commit the scripts to gitlab: /afs/cern.ch/work/d/duperrin/public/PhyVal/Clean_Draw_Macro/~~ - ~~check range of IP3D_gradeOfTracks~~ - ~~[0,13], integers only~~ - ~~update DL1r working points~~ ~~and c fraction~~ - ~~write to Algo convenors~~ - ~~-> take info from CDI file~~ - ~~add RNNIP~~ - ~~pu, pb, pc~~ - ~~also build a discriminant from that~~ - ~~update WP values~~ - ~~check that IP3D grade of tracks input variables are only hits numbers~~ - ~~remove MV2c10mu and MV2c10rnn~~ - ~~remove DL1rnn from my code~~ - ~~switch to new truth-track association scheme~~ - ~~declaration of tool done (it worked now)~~ - ~~next step: adapt code to elegantly use the tool~~ - ~~synchronize with PerfFwk plots~~ - ~~specific steps:~~ - ~~make detail level available in plots class~~ - ~~have standard plots with bigger categories~~ - ~~have additional plots for detail level > 10~~ - ~~check and commit~~ - ~~write update to group~~ - ~~RNNIP WPs~~ - ~~run old - new comparison~~ - ~~update WP values (DL1(r) and RNNIP)~~ - ~~add beamspot event weight~~ - ~~read weight from event info~~ - ~~make it available in other class~~ - ~~add it to all Fill calls~~ - ~~double check the procedure for profiles~~ - ~~make presentation on old-new comparison~~