---
# System prepended metadata

title: PHYSVAL TODOS

---

# PHYSVAL TODOS

## Official validation rounds
reminder: DSIDs were 410000 and 427080
usual fluctuations: http://atlas-computing.web.cern.ch/atlas-computing/links/PhysValDir/Btagging/Rel21_01-10-2020/topic2/ROC/SV1.pdf


---
### July 29th

Task 1a
- Ref 1
r12861_p4668_p4450 (22.0.34 without pile-up)
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38601/
    - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12861_p4668_p4450_tid26306976_00
    - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12861_p4668_p4450_tid26306860_00
 
- Test 1a
r12849_p4668_p4450 22.0.39 w/0 pile-up
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38548/
    - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12849_p4668_p4450_tid26288743_00
    - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12849_p4668_p4450_tid26288654_00
    
Task 1b
- Ref 1
r12861_p4668_p4450 (22.0.34 without pile-up)
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38601/
    - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12861_p4668_p4450_tid26306976_00
    - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12861_p4668_p4450_tid26306860_00
    
- Test 1b
r12849_p4676_p4681_p4450 22.0.39 w/o pile-up via DAOD_PHYSVAL
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38548/
    - ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12849_p4676_p4681_p4450_tid26312324_00
    - Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12849_p4676_p4681_p4450_tid26312256_00

---
### July 15th

1) Validation of mc20a:
  Tasks 1a and 1b  from https://its.cern.ch/jira/browse/ATLPHYSVAL-781

2) Validation of Track Geometry cond Alg (MC):
  Task 1 from https://its.cern.ch/jira/browse/ATLPHYSVAL-787

3) Validation of G4 with EMEC custom solid:
  Task 1 https://its.cern.ch/jira/browse/ATLPHYSVAL-785

4) Validation of Pile-up model including leptons from b-decays
  Task 4 from https://its.cern.ch/jira/browse/ATLPHYSVAL-748

#### Task 1a
We expect similar differences to those observed comparing mc16e v4 to old run2 conditions with the same pile-up in ATLPHYSVAL-746
**Ref**: r12788_p4525_p4450 
~~https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38304/~~
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12788_p4525_p4450_tid26125587_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12788_p4525_p4450_tid26125458_00

**Test**: r12802_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38396/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12802_p4525_p4450_tid26189581_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12802_p4525_p4450_tid26189408_00

#### Task 1b
We expect similar differences to those observed comparing mc16e v4 to old run2 conditions with the same pile-up in ATLPHYSVAL-746
**Ref**: r12787_p4525_p4450 
~~https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38305/~~
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12787_p4525_p4450_tid26125518_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12787_p4525_p4450_tid26125237_00

**Test**: r12801_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38395/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12801_p4525_p4450_tid26189473_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12801_p4525_p4450_tid26189279_00


#### Task 2
**Ref**: r12744_p4647_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38077/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12744_p4647_p4450_tid26180928_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12744_p4647_p4450_tid26188962_00

**Test**: r12745_p4647_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38077/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12745_p4647_p4450_tid26189018_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12745_p4647_p4450_tid26189036_00


#### Task 3
**Ref**: s3702_r12697_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37956/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3702_r12697_p4525_p4450_tid25930455_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3702_r12697_p4525_p4450_tid25930331_00

**Test**: s3705_r12697_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38279/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3705_r12697_p4525_p4450_tid26109984_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3705_r12697_p4525_p4450_tid26128395_00


#### Task 4
**Ref**: s3227_r12627_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00

**Test**: s3227_r12780_p4525_p4450 
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/38268/
- ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12780_p4525_p4450_tid26119368_00
- Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12780_p4525_p4450_tid26119253_00

---
### July 1st
https://its.cern.ch/jira/browse/ATLPHYSVAL-779
We will have our next PhysVal meeting this Thursday, July 1st @ 15:00 CERN time: https://indico.cern.ch/event/1021653/
There will be two tasks:
- Validation new G4 version in r21 vs r22.
- Validation of old G4 version vs new in r21.

---

**Task 1**: new G4 in r22 (s3702) vs r21 (s3691).
Ref: s3691 (r21) r12697:
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37880/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3691_r12697_p4525_p4450_tid26010638_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3691_r12697_p4525_p4450_tid26010500_00**
Test: s3702 (r22) r12697:
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37956/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3702_r12697_p4525_p4450_tid25930455_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3702_r12697_p4525_p4450_tid25930331_00**
    
---

**Task 2**: r21 old G4 version (s3227) vs new (s3692).
Ref: s3691 (r21) r12697:
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37880/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3691_r12697_p4525_p4450_tid26010638_00)**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3691_r12697_p4525_p4450_tid26010500_00**
Test: s3227 r12697:
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37879/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12697_p4525_p4450_tid25825181_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12697_p4525_p4450_tid25870368_00**


---------------------------------------------------
### May 20th


Task 1a: validation of final r-tags for 2nd round of CP samples, no pile-up
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759

- Reference (mc16e): r12576_p4525_p4450 (running, ready in O(1 day))
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37014/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12576_p4525_p4450_tid25601865_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12576_p4525_p4450_tid25601780_00**


- Test (mc20e): r12631_p4525_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37385/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12631_p4525_p4450_tid25570069_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12631_p4525_p4450_tid25569962_00**


- Reference vs test: expect differences related to beamspot weighting (can compare against https://its.cern.ch/jira/browse/ATLPHYSVAL-712), differences between 22.0.30 vs 22.0.34 

----------------------------------------------------

Task 1b: validation of final r-tags for 2nd round of CP samples, with pile-up
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759

- Reference (mc16e): r12585_p4525_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36990/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12585_p4525_p4450_tid25540446_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12585_p4525_p4450_tid25581871_00**


- Test (mc20e): r12627_p4525_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00**


- Reference vs test: expect differences related to beamspot weighting (can compare against task 1a here https://its.cern.ch/jira/browse/ATLPHYSVAL-712), different pile-up profiles, differences between 22.0.30 vs 22.0.34. 

----------------------------------------------------

Task 2: validation of final r-tags for 2nd round of CP samples, with pile-up
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-759

- Reference (mc20e): r12627_p4525_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37382/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12627_p4525_p4450_tid25569774_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12627_p4525_p4450_tid25569629_00**


- Test (mc20d): r12629_p4525_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/37383/
    - **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12629_p4525_p4450_tid25569888_00**
    - **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12629_p4525_p4450_tid25569718_00**


- Reference vs test: comparing sub-campaigns.


---

### April 29th
Task 1: beamspot reweighting
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-712

- Task 1a: Reference 1a vs Test 1
We expect real differences due to narrower beamspot in pile-up and
reweighted Hard scatter in variables sensitive to the Z-beamspot position
- Task 1b: Reference 1b vs Test 1
We expect differences equivalent to normal pile-up fluctuations

**Reference 1a: 42mm HS, 42 mm PU**

Sim in Athena 21.0.119 s3636
Digi+Reco in Athena_22.0.26 (r12421)
RDOtrig in 21.0.121 (called in r12421)
NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500)
s3626_r12421_p4500_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36076/
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3626_r12421_p4500_p4450_tid25352751_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3626_r12421_p4500_p4450_tid25361675_00**

**Reference 1b: 35mm HS, 35 mm PU**

Sim in Athena 21.0.119 s3636
Digi+Reco in Athena_22.0.26 (r12428)
RDOtrig in 21.0.121 (called in r12428)
NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500)
s3652_r12428_p4500_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36175/
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3652_r12428_p4500_p4450_tid25352686_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3652_r12428_p4500_p4450_tid25361526_00**

**Test 1: 42mm HS 35mm PU with BS RW**

Sim in Athena 21.0.119 s3636
Digi+Reco in Athena_22.0.26 (r12434)
RDOtrig in 21.0.121 (called in r12434)
NTUP_PHYSVAL in 22.0.33-master-2021-04-22T2101 (p4500)
s3626_r12434_p4500_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36076/
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3626_r12434_p4500_p4450_tid25352756_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3626_r12434_p4500_p4450_tid25361602_00**

---

Task 2:
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-748

- Task 2a ) Reference 2a and 2b vs Test 2a
This compares the old pythia tune having v2 (ref 2a) or v4 (ref 2b)
conditions to the new EPos+A3 tune with v2 conditions
- Task 2b) Reference 2a and 2b vs Test 2b
This compares the old pythia tune having v2 (ref 2a) or v4 (ref 2b)
conditions to the new EPos+A3 tune with v4 conditions
- We expect differences in variables sensitive to pile-up and recent
changes in noise thresholds
(all samples in task 2 use 42mm BS for HS and PU)

**Reference 2a (22.0.30 with pythia pile-up, v2 conditions )**
Digi+reco in 22.0.30, r12522
NTUP_PHYSVAL in 22.0.32: p4479
r12522_p4479_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36757/
sames as ref 2 with pile-up in ATLPHYSVAL-746
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12522_p4479_p4450_tid24911462_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12522_p4479_p4450_tid24913332_00**

**Reference 2b (22.0.30 with pythia pile-up, v4 conditions)**
Digi+reco in 22.0.30, r12531 (r12522->r12531)
postExec for TRT PHF>0.3
RDOtoRDOTrig in 21.0.124 (called in r12530)
NTUP_PHYSVAL in 22.0.32: p4479
r12531_p4479_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36830/
same as test with pile-up in ATLPHYSVAL-746
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12531_p4479_p4450_tid24911602_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12531_p4479_p4450_tid24914786_00**

**Test 2a (22.0.30 with Epos +A3 pile-up v2 conditions)**
Digi+Reco in Athena_22.0.30 (r12570)
RDOtrig in 21.0.121 (r12568)
NTUP_PHYSVAL in 22.0.32 (p4479)
r12570_p4479_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36989/
- **ttbar: running** https://bigpanda.cern.ch/task/25370809/
- **Zprime: running** https://bigpanda.cern.ch/task/25370847/

**Test 2b (22.0.30 with Epos +A3 pile-up v4 conditions)**
Digi+Reco in Athena_22.0.30 (r12570)
RDOtrig in 21.0.121 (r12569)
NTUP_PHYSVAL in 22.0.32 (p4479)
r12569_p4479_p4450
https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36990/
- **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12569_p4479_p4450_tid25370888_00**
- **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12569_p4479_p4450_tid25370947_00**


---

### Specific todos on Apr 20th
- [x] ~~write an email for the samples that can't be downloaded~~
- [x] prepare 'summary' slides for the validation round last week
- [x] look at the bug James reported
- [x] produce the missing plots
- [x] do the AF3 without / with comparison
- [x] take care of the samples for Martino
- [x] write the follow-up email
- [ ] put this into the tutorial: maybe you can try one quick thing: logout from the xterm and then just do "setuATLAS, then lsetup rucio, and the voms command, try again a rucio download. I mean start from a clean fresh indows and setup.

notes :)
- ref and test sample in the MT vs MP validation (task 2 here: https://its.cern.ch/jira/browse/ATLPHYSVAL-690)
- `r12416_r12508_p4464_p4450`
- `r12416_r12506_p4464_p4450`
- -> difference only in the r-tag -> MP vs MT applies to the reco step
- the 'broken' p-tag (which does not have the new code, but --doBTag disabled): **p4464**
- since then, newer p-tags were generated -> including the new code, e.g. **p4475** (22.0.32-nightly, April 12th)
- the newer p-tag was used in the r.30 validation, there all plots are there and all is fine
 


---

### April 15th
- todo
- [x] task 2 ttbar
- [x] task 2 zprime
- [x] task 3a ttbar
- [x] task 3a zprime
- [x] task 3b ttbar
- [x] task 3b zprime

---

- ~~Task 1) Athena MT vs MP comparison in 22.0.30~~
~~Reference: MP 8 cores 22.0.30~~
~~• r12416_r12508_p4464_p4450~~
~~• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/35770/~~
~~Test: MT 8 threads 22.0.30~~
~~• r12416_r12506_p4464_p4450~~
~~• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/35770/~~
~~Expectations: Expect identical agreement, no ftag nor plfow_flowelements plots.~~

---

- Task 2) Follow up on final AF3 validation
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-741 (task 2 in the ticket)
Reference 2: (G4 + F4fix for QS with pile-up digi+reco in rel22)
• Sim in Athena-21.0.42 with G4Fix in 21.0.124 (s3668)
• Digi+Reco in Athena_22.0.24 (r12340)
• NTUP_PHYSVAL in Athena_22.0.24 (p4360)
• merge NTUP_PHYSVAL in 22.0.29 (p4450)
• ~~s3227_3668_r12340_p4360_p4450~~ “s3668_r12340_p4360_p4450”
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36676/
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3668_r12340_p4360_p4450_tid24862138_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3668_r12340_p4360_p4450_tid24862080_00**
Test 2: (AF3 with QS particles with pile-up digi+Reco in rel22 )
• Sim in 21.0.123 (s3659)
• Digi+Reco in Athena_22.0.24 (r12340)
• NTUP_PHYSVAL in 22.0.24 (p4360)
• merge NTUP_PHYSVAL in 22.0.29 (p4450)
• s3659_r12340_p4360_p4450
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/30954/
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3659_r12340_p4360_p4450_tid24828575_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3659_r12340_p4360_p4450_tid24828617_00**

Expectations: Similar differences to task 1b from the JIRA issue, particularly interested in differences in the jet distributions

---

- Task 3a)  22.0.30 validation, no pile-up
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-742
Reference
• Digi+reco in 22.0.26
• NTUP_PHYSVAL in 22.0.32-nightly: p4475
• r12456_p4475_p4450
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36219/
• Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36219
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12456_p4475_p4450_tid24858626_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12456_p4475_p4450_tid24862397_00**
Test
• Digi+reco in 22.0.30, r12521
• NTUP_PHYSVAL in 22.0.32-nightly: p4475
• r12521_p4475_p4450
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36633/
• Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36633
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12521_p4475_p4450_tid24865034_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12521_p4475_p4450_tid24864985_00**

---

- Task 3b)  22.0.30 validation, with pile-up
JIRA: https://its.cern.ch/jira/browse/ATLPHYSVAL-742
Reference
• Digi+reco in 22.0.26
• NTUP_PHYSVAL in 22.0.32-nightly: p4475
• r12455_p4475_p4450
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36212/
• Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36212
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12455_p4475_p4450_tid24858865_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12455_p4475_p4450_tid24862275_00**
Test
• Digi+reco in 22.0.30, r12522
• NTUP_PHYSVAL in 22.0.32-nightly: p4475
• r12522_p4475_p4450
• https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/36757/
• Samples: https://prodtask-dev.cern.ch/prodtask/task_table/#/?time_period=all&task_type=production&request=36757
• **ttbar: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12522_p4475_p4450_tid24860549_00**
• **Zprime: valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.merge.NTUP_PHYSVAL.e5362_s3227_r12522_p4475_p4450_tid24862516_00**
Expectations: test samples include FTAG-related and MET tau term fixes (and possibly others).

---

### March 4th
- MT vs MP: https://its.cern.ch/jira/browse/ATLPHYSVAL-690
    - ref: r12416_r12416_p4368_p3821 *(-> valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12416_r12416_p4368_p3821_tid24434841_00)*
    - test: r12416_r12422_p4368_p3821
- QSP Test 3: https://its.cern.ch/jira/projects/ATLPHYSVAL/issues/ATLPHYSVAL-701
    - ref: s3227_r12287_p4360
    - test: s3634_r12287_p4360
    - test3: s3653_r12320_p4360
- todo
    - ~~re-run ROC curves with right root version ^^~~
    - ~~update task 2 presentation with new ROC curves and orange status~~
    - ~~make task 1 presentation~~
    - ~~send email~~
    - ~~info to Arnaud for intro slides~~
    - ~~change label of Zprime ROCs to Zprime~~
    - ~~make special plots for ttbar~~
    - Disc quota is exceeded ... move some folders
    - ~~redo task2a with new code~~

---

## Private validation of new code
- run old code vs new code
    - test sample: referece (MT) of MT vs MP validation: 
    - AOD: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.recon.AOD.e4993_s3227_r12416_r12416_tid24344014_00
    - NTUP_PHYSVAL: valid1.410000.PowhegPythiaEvtGen_P2012_ttbar_hdamp172p5_nonallhad.merge.NTUP_PHYSVAL.e4993_s3227_r12416_r12416_p4368_p3821_tid24434841_00


## New variables / changes to add to the new code


## Bugfixes and questions
- why is DL1rnn not properly filled before r.19?
    test sample: (r.18) `valid1.427080.Pythia8EvtGen_A14NNPDF23LO_flatpT_Zprime.recon.AOD.e5362_s3227_r12153_r12215_r12153_tid23211423_00`
- why is DL1r not properly filled in r21?
    test sample: 
- (r.24 crashes on the grid)

## Thoughts about plot shifter selection
- global:
    - jet pt, eta for b, l
    - B truth Lxy
- track variables: 
    - z0, d0, sigz0, sigd0
    - num tracks (from HF ?)
    - track pT frac
- SV variables:
    - SV1 num vtcs
    - SV1 Lxy
    - SV1 mass ???
    - Jet Fitter num vtcs
    - purity
- tagger related:
    - IP3D grade of tracks, num tracks 
    - SV1 n good tracks
    - DL1r pb pc pu ? IP3D d0 and z0 ?
- discriminant values & ROC curves:
    - IP3D, SV1, JetFitter, MV2c10, DL1r, (DL1 or RNNIP)

## Tasks done :)
- ~~deltaR(BHadron, jet) & deltaR(CHadron, jet)~~
    - ~~code is changed, currently running test plots~~
    - ~~plots look ok :)~~
![](https://juhofer.web.cern.ch/juhofer/PHYSVAL/testHistoDefs_compare_new_versions_v02/AntiKt4EMTopoJets/jet/jet/BTag_AntiKt4EMTopoJets_truth_deltaR_truthBHadron_jet_b.png =200x) ![](https://juhofer.web.cern.ch/juhofer/PHYSVAL/testHistoDefs_compare_new_versions_v02/AntiKt4EMTopoJets/jet/jet/BTag_AntiKt4EMTopoJets_truth_deltaR_truthCHadron_jet_c.png =200x)
- ~~check if the new code runs on r21~~
- ~~extend range of any fraction variables to not have events in the overflow bin~~
    - solution to the large number of events in the overflow bin:
        - I wasn't careful in checking for divides by zero, and the nan/inf from those events (where the total number of tracks is zero) is filled in the overflow bin -> those events are set to -1 now (i.e. in the underflow bin)
- ~~for SV1 fracTracksFromX variables: implement a check against divide by zero~~
- ~~change range of PV x, y, and z~~
    - ~~x and y in range (-0.75, -0.25)~~
- ~~commit the updated ROC curves post-processing script to git~~
    - ~~Arnaud will clean the script a bit before~~
    - ~~commit the scripts to gitlab: /afs/cern.ch/work/d/duperrin/public/PhyVal/Clean_Draw_Macro/~~
- ~~check range of IP3D_gradeOfTracks~~
    - ~~[0,13], integers only~~
- ~~update DL1r working points~~ ~~and c fraction~~ 
    - ~~write to Algo convenors~~
    - ~~-> take info from CDI file~~
- ~~add RNNIP~~
    - ~~pu, pb, pc~~
    - ~~also build a discriminant from that~~
    - ~~update WP values~~
- ~~check that IP3D grade of tracks input variables are only hits numbers~~
- ~~remove MV2c10mu and MV2c10rnn~~
- ~~remove DL1rnn from my code~~
- ~~switch to new truth-track association scheme~~
    - ~~declaration of tool done (it worked now)~~
    - ~~next step: adapt code to elegantly use the tool~~
    - ~~synchronize with PerfFwk plots~~
    - ~~specific steps:~~
        - ~~make detail level available in plots class~~
        - ~~have standard plots with bigger categories~~
        - ~~have additional plots for detail level > 10~~
    - ~~check and commit~~
- ~~write update to group~~
- ~~RNNIP WPs~~
- ~~run old - new comparison~~
- ~~update WP values (DL1(r) and RNNIP)~~
- ~~add beamspot event weight~~
    - ~~read weight from event info~~
    - ~~make it available in other class~~
    - ~~add it to all Fill calls~~
    - ~~double check the procedure for profiles~~
- ~~make presentation on old-new comparison~~