# Ruck Rover 2022-10-21 - 2022-10-27

###### tags: `ruck_rover`
###### Next RR notes: TODO
###### Previous RR notes: https://hackmd.io/0Lev7RRlRDCj9hiNUKN1zw

##### ruck: marios, rover: dasm

## Handover
### Active bugs

* https://bugs.launchpad.net/tripleo/+bug/1990480 - Tempest test test_create_update_port_with_dns_domain failure KeyError: 'dns_domain'
* https://bugs.launchpad.net/tripleo/+bug/1991093 - compute and network tempest tests failing on fs35 train
* https://bugs.launchpad.net/tripleo/+bug/1993730 - Wallaby c8 and c9 OVB jobs are failing the modify image step - mount point does not exist
* it's close to be resolved, patches are being merged atm.

### Promotions
* rhel8 osp16-2: last_promotion=2022-10-26 16:30:56
* rhel8 osp17-1: last_promotion=2022-10-26 21:31:34
* rhel9 osp17: last_promotion=2022-10-26 21:31:38
* rhel9 osp17.1: last_promotion=2022-10-27 12:34:55
* cs8 train: last_promotion=2022-10-25 20:18:20
* https://review.rdoproject.org/r/c/testproject/+/45781
* cs8 wallaby: last_promotion=2022-10-27 07:51:02
* cs9 wallaby: last_promotion=2022-10-27 18:22:02
* cs9 zed: last_promotion=2022-10-26 22:29:18
* cs9 master: last_promotion=2022-10-27 11:48:29
* upstream components:
* https://review.rdoproject.org/r/c/testproject/+/45763
* downstream components:
* https://code.engineering.redhat.com/gerrit/c/testproject/+/432521

---
## Oct 27 handover
### Promotions
* rhel8 osp16-2: last_promotion=2022-10-26 16:30:56
* rhel8 osp17-1: last_promotion=2022-10-26 21:31:34
* rhel9 osp17: last_promotion=2022-10-26 21:31:38
* rhel9 osp17.1: last_promotion=2022-10-27 12:34:55
* cs8 train: last_promotion=2022-10-25 20:18:20
* https://review.rdoproject.org/r/c/testproject/+/45781
* cs8 wallaby: last_promotion=2022-10-27 07:51:02
* cs9 wallaby: last_promotion=2022-10-27 18:22:02
* cs9 zed: last_promotion=2022-10-26 22:29:18
* cs9 master: last_promotion=2022-10-27 11:48:29
* upstream components:
* https://review.rdoproject.org/r/c/testproject/+/45763
* downstream components:
* https://code.engineering.redhat.com/gerrit/c/testproject/+/432521

## Oct 26 handover
### Promotions

##### missing cs8 wallaby: Steve Baker's job built containers, it's retrying and not finishing. Rechecked.
* **PRIORITY** rhel9 osp17.1: last_promotion=2022-10-21 19:01:43
* https://code.engineering.redhat.com/gerrit/c/testproject/+/432677
* **PRIORITY** cs8 wallaby: last_promotion=2022-10-20 05:40:09
* https://review.rdoproject.org/r/c/testproject/+/45851
* **PRIORITY** cs9 zed: last_promotion=2022-10-20 06:24:19
* https://review.rdoproject.org/r/c/testproject/+/45834
* https://review.rdoproject.org/r/c/testproject/+/45850
* ~~testing sbaker's fix with https://review.rdoproject.org/r/c/testproject/+/45812~~
* rhel8 osp16-2: last_promotion=2022-10-26 16:30:56
* rhel8 osp17-1: last_promotion=2022-10-25 22:26:48
* rhel9 osp17: last_promotion=2022-10-24 20:18:50
* https://code.engineering.redhat.com/gerrit/c/testproject/+/432675
* cs9 master: last_promotion=2022-10-25 19:20:21
* cs9 wallaby: last_promotion=2022-10-24 12:47:26
* cs8 train: last_promotion=2022-10-25 20:18:20
* upstream components: https://review.rdoproject.org/r/c/testproject/+/45763
* downstream components: https://code.engineering.redhat.com/gerrit/c/testproject/+/431128

### New issues:
* RHEL9, OSP17.1 is affected by Steve Baker's change:
* https://sf.hosted.upshift.rdu2.redhat.com/logs/21/432521/2/check/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset001-internal-tripleo-rhos-17.1/732b07a/job-output.txt

## Oct 25 handover
### New issues:
* dasm: please check result of
* previous run failed on missing container hash f5551b6bbbd2720ddec8a263bfab3620 https://quay.rdoproject.org/repository/tripleowallabycentos8/openstack-neutron-server?tab=tags (actually not in registry?)
* trying rerun with container build https://review.rdoproject.org/r/c/testproject/+/45812/2#message-98de2cd20b26015074aa9438e9db08ceeae1b12e to push container again

* (3rd party check) https://bugs.launchpad.net/tripleo/+bug/1994130 ovb job fails at [build-test-packages: RUN DLRN] task because of syntax error
* amoralej reported it working: https://bugs.launchpad.net/tripleo/+bug/1994130/comments/4

### Pending issues / Still in gate:

* https://bugzilla.redhat.com/show_bug.cgi?id=2137166
* ~~patch: https://review.opendev.org/c/openstack/tripleo-quickstart/+/862466~~
* ~~Also impacting 17 on rhel-9 (no promo yet) - 2022-10-23 03:35:20.688526 | primary | failed: [undercloud -> undercloud] (item=tempest) => {"ansible_loop_var": "item", "attempts": 5, "changed": false, "item": "tempest", "msg": "Incompatible openstacksdk library found: Version MUST be >=0.101 and <=None, but 0.55.1 is smaller than minimum version 0.101."~~

* **Downstream impact** - ~~cert expired - killing all lines. Didn't log a bugzilla as I think Alan wants a service now ticket - unless it's on his team to fix. Please check in with Alan and #rhos-ops on Monday morning~~
* created cix directly (no bz as per apevec requests?) https://trello.com/c/Bk784PV8

* https://review.rdoproject.org/r/c/testproject/+/45806 Chasing wallaby 8 df0621cbe7fe701a16628828d812ca66 fs1 ovb

### Promotions
##### missing cs8 wallaby: out of promotion. discussion with Steve Baker at Chat.
* testing sbaker fix with https://review.rdoproject.org/r/c/testproject/+/45812
* upstream components reruns: https://review.rdoproject.org/r/c/testproject/+/45763
* cs9 master: last_promotion=2022-10-24 15:56:39
* cs9 wallaby: last_promotion=2022-10-24 12:47:26
* cs8 train: last_promotion=2022-10-24 16:34:50
* PRIORITY (should be unblocked now tripleo-quickstart/+/862466 ) rhel8 osp16-2:last_promotion=2022-10-21 21:01:58
* rhel9 osp17:last_promotion=2022-10-24 20:18:50
* PRIORITY rhel9 osp17.1: last_promotion=2022-10-21 19:01:43

## Oct 24
### handover notes:
We should have rhel9 17.0 and 17.1 rhel8 16.2 got rekicked
* ~~17.0: https://code.engineering.redhat.com/gerrit/c/testproject/+/431128~~
* ~~Steve Baker's OVB bugfix is merge in progress.~~

* ~~job reruns for 17 on rhel-9 and 17.1 on rhel-8 : https://code.engineering.redhat.com/gerrit/c/testproject/+/430999~~
* ~~17 baremetal component job rerun: https://code.engineering.redhat.com/gerrit/c/testproject/+/430582~~

* testprojects:
* ~~rlandy> marios: master and train rerun https://review.rdoproject.org/r/c/testproject/+/45359/14#message-5bf027a76d56652300f86c9d35a1e80f5fd3d526~~
* passed, master and train promoted
* ~~https://code.engineering.redhat.com/gerrit/c/testproject/+/431128 Rerun baremetal~~

## Oct 21
### New/Transient/No bug yet:

#### d/stream
##### rhel8/16.2 - still hitting registry issues https://bugzilla.redhat.com/show_bug.cgi?id=2135432#c6 & rekicked manually the openstack-periodic-integration-rhos-16.2 1 currently running
* also chasing an earlier hash ~~https://code.engineering.redhat.com/gerrit/c/testproject/+/432086~~ (17th https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/tripleo-ci-testing/ac/7a/)
* abandon because of not enough bm resources don't want to hose current runs (still waiting https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#432086)
##### centos8 components (ibm cloud) are stuck and holding component lines e.g. https://review.rdoproject.org/zuul/buildset/e41b7c8fbba142b0b0be4d5929ca6739 15 hours in progress
* ~~https://review.rdoproject.org/r/c/rdo-jobs/+/44770~~
* ~~https://review.rdoproject.org/r/c/rdo-jobs/+/45778~~

## Resolved
##### https://bugs.launchpad.net/tripleo/+bug/1984237 -> hitting check and also periodic integration https://review.rdoproject.org/zuul/build/e2c88a92218c4f1f98b4e03010d13b3f
* ~~https://review.opendev.org/c/openstack/tripleo-quickstart/+/856582/~~
* https://lists.openstack.org/pipermail/openstack-discuss/2022-October/030934.html
* ~~dasm please update in a few hours ^^^ the fix is merged. Send update email~~ email sent

## Promotions

### Downstream
* **Integration lines**:
* **rhos17 on rhel9**: **promoted 24-oct**
* rekicking now

* **rhos17.1 on rhel9**: **promoted 21-oct**
* rerun on rbac job - all passed

* **rhos17.1 on rhel8**: **promoted 24-oct**
* all passed

* **rhos16.2**: **promoted 21-oct**
* rerun of jenkins job - all passed