[RDO Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) / [RHOS Cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com)
[RDO Promoter](http://promoter.rdoproject.org/promoter_logs/) / [RHOS Promoter](http://10.0.110.143/promoter_logs/)

[OpenStack Program Meeting indexes](https://docs.engineering.redhat.com/pages/viewpage.action?spaceKey=PRODCHAIN&title=Meeting+notes)

[Modernization CI](https://hackmd.io/f9JzEVjMQC-hkJu1L9eolw)

Zuul Status:
* [opendev.org:openstack](https://zuul.opendev.org/t/openstack/status/)
* [rdoproject.org:rdoproject.org](https://review.rdoproject.org/zuul/status)
* [redhat.com:tripleo-ci-internal](https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status)

Prow Status
* [Operators - Check/Gate failures](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*&state=failure)
* For now, we just look (and investigate) if a test has multiple failures across different PRs
* [Operators - Check/Gate status](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*)
* [pre-commit jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-main-precommit-check&state=failure)
* [pre-commit jobs status](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-main-precommit-check)
* [unit tests jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-main-unit&state=failure)
* [kuttl tests Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-kuttl&state=failure)
* [Tempest Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-tempest&state=failure)

[Review List](/FGMoCiRfSNa8puA1BpTQ-Q)

#### Podifed Container Build Lines
* [openstack-periodic-container-master-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-master-centos9)
* [openstack-periodic-container-antelope-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-antelope-centos9&skip=0)

###### tags: `ruck_rover`
###### Previous RR notes: https://hackmd.io/8B2vC53mRPSGjXmm1vo5oQ

##### ruck & rover: soniya29
##### ruck & rover alias: @ruckroverciframework

:::info
**Fixes and Improvements needed**

* role *oooci-build-images* needs to use *discover-latest-image* to always get latest CentOS image. So we can stop manual updates on role's vars.
* https://github.com/openstack/tripleo-ci/commit/6df518c8a98bfb73d585c6f6e238f1c2ad9053f1
* periodic build-image jobs were failing because of that
* Dowstream DLRN report needs to retry reporting when receiving a 401 answer (since it seems related to network issues)
* https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17.1-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17.1/645a5df/job-output.txt
* Improve ruck_rover script to work with DLRN + Kerberos authentication
* Mandatory for DS DLRN
:::

:::danger

**OPEN BUGS**
* https://issues.redhat.com/browse/OSPCIX-16 - [LP:2028506][operator]openstack-operator-content-provider fails with [Makefile:223: bundle] - "Error 1", "owner": "zuul", "rc": 2, "secontext": "unconfined_u:object_r:user_home_t:s0"
* upstream is good, monitoring this issue for rhos18 rhel9
* https://issues.redhat.com/browse/OSPCIX-21 [next-gen][Master][Antelope][cs9] cs9 quay push jobs are failing on master with error msg="Failed to copy container image: Error in copy the image"
:::

## Thursday 27/07/2023
:::warning
#### Upstream promotion
Podified Master: 2023-07-25
* https://review.rdoproject.org/r/c/testproject/+/40101
* blocked on https://issues.redhat.com/browse/OSPCIX-21
Podified Antelope: 2023-07-25
* https://review.rdoproject.org/r/c/testproject/+/49413
* blocked on https://issues.redhat.com/browse/OSPCIX-21
* blocked on https://issues.redhat.com/browse/OSPCIX-16
CentOS 9 Wallaby: 2023-07-26 NNH
- https://trunk.rdoproject.org/centos9-wallaby/current-tripleo/delorean.repo.md5
- https://trunk.rdoproject.org/centos9-wallaby/tripleo-ci-testing/delorean.repo.md5
CentOS 8 Wallaby: 2023-07-26 NNH
https://trunk.rdoproject.org/centos8-wallaby/current-tripleo/delorean.repo.md5
https://trunk.rdoproject.org/centos8-wallaby/current-tripleo/delorean.repo.md5
CentOS 8 Train: 2023-07-26

#### Downstream Promotion
Podified RHEL 9 RHOS 18.0: 2023-07-26
- https://code.engineering.redhat.com/gerrit/c/testproject/+/443606

RHEL 9 RHOS 17.1: 2023-07-21 NNH 14e5c775a89c88c05ae28cddc54ef6e0
https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17-1/tripleo-ci-testing/delorean.repo.md5
https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17-1/current-tripleo/delorean.repo.md5
- https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/job/pipeline_component-network-pcci-17.1_dlrn-rhel-9.2-virthost-3cont_2comp_3net-ipv4-geneve-lvm-networking-ovn-vlan-provider-network/

RHEL 9 RHOS 17.0: 2023-06-22 - NNH 3876eba14585e0a14a0597a43c5e5e6c
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17/current-tripleo/delorean.repo.md5
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17/tripleo-ci-testing/delorean.repo.md5
- https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/job/pipeline_component-compute-pcci-17_dlrn-rhel-9.0-virthost-3cont_2comp_3ceph-ipv4-geneve-ceph/

RHEL 8 RHOS 17.1: 2023-07-25 - NNH after 25
feceb40ba9f30e2c687ec080ec0982d4
- https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/current-tripleo/delorean.repo.md5
- https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/tripleo-ci-testing/delorean.repo.md5

RHEL 8 RHOS 16.2: 2023-07-19
- https://code.engineering.redhat.com/gerrit/c/testproject/+/445441
- https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/job/pipeline_component-network-pcci-16.2_dlrn-rhel-8.4-virthost-3cont_2comp_3net-ipv4-geneve-lvm-networking-ovn-vlan-provider-network/

:::

## Tuesday 25/07/2023
:::warning

## Wednesday 26/07/2023
:::warning
#### Upstream promotion
Podified Master: 2023-07-25
* https://review.rdoproject.org/r/c/testproject/+/49412
Podified Antelope: 2023-07-25
* https://review.rdoproject.org/r/c/testproject/+/49413
* https://review.rdoproject.org/r/c/testproject/+/40101
CentOS 9 Wallaby: 2023-07-26
CentOS 8 Wallaby: 2023-07-26
CentOS 8 Train: 2023-07-26

#### Downstream Promotion
Podified RHEL 9 RHOS 18.0: 2023-07-26
RHEL 9 RHOS 17.1: 2023-07-21 NNH 14e5c775a89c88c05ae28cddc54ef6e0
https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17-1/tripleo-ci-testing/delorean.repo.md5
https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17-1/current-tripleo/delorean.repo.md5

RHEL 9 RHOS 17.0: 2023-06-22 - NNH after 3876eba14585e0a14a0597a43c5e5e6c
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17/current-tripleo/delorean.repo.md5
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17/tripleo-ci-testing/delorean.repo.md5
RHEL 8 RHOS 17.1: 2023-07-25 - NNH after 25
feceb40ba9f30e2c687ec080ec0982d4
- https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/current-tripleo/delorean.repo.md5
- https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/tripleo-ci-testing/delorean.repo.md5
RHEL 8 RHOS 16.2: 2023-07-19 - NNH
6ad1fbdd4803d9cd0277b871f105e71b
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/current-tripleo/delorean.repo.md5
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/tripleo-ci-testing/delorean.repo.md5

:::

## Tuesday 25/07/2023
:::warning
#### Upstream promotion
Podified Master: 2023-07-25
Podified Antelope: 2023-07-25
CentOS 9 Wallaby: 2023-07-25
CentOS 8 Wallaby: 2023-07-25
CentOS 8 Train: 2023-07-24

#### Downstream Promotion
Podified RHEL 9 RHOS 18.0: 2023-07-25
RHEL 9 RHOS 17.1: 2023-07-21 NNH 14e5c775a89c88c05ae28cddc54ef6e0 https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17-1/tripleo-ci-testing/delorean.repo.md5

RHEL 9 RHOS 17.0: 2023-06-22 - NNH after 3876eba14585e0a14a0597a43c5e5e6c
* https://code.engineering.redhat.com/gerrit/c/testproject/+/430517
* https://code.engineering.redhat.com/gerrit/c/testproject/+/430284
RHEL 8 RHOS 17.1: 2023-07-25
RHEL 8 RHOS 16.2: 2023-07-19 - NNH
* https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/current-tripleo/delorean.repo.md5
##### Downstream components:

:::

## Monday 24/07/2023
:::warning
#### Upstream promotion
Podified Master: 2023-07-18
* blocked on quay build push
Podified Antelope: 2023-07-17
* blocked on quay build push
CentOS 9 Wallaby 2023-07-23
* https://review.rdoproject.org/r/c/testproject/+/48768
CentOS 8 Wallaby 2023-07-23
CentOS 8 Train 2023-07-22
* blocked on mirror issue

#### Downstream Promotion
Podified RHEL 9 RHOS 18.0: 2023-07-23
- https://code.engineering.redhat.com/gerrit/c/testproject/+/443606
RHEL 9 RHOS 17.1: 2023-07-21
* line enqueued
RHEL 9 RHOS 17.0: 2023-06-22 - NNH after 3876eba14585e0a14a0597a43c5e5e6c
RHEL 8 RHOS 17.1: 2023-07-21
RHEL 8 RHOS 16.2: 2023-07-19 - NNH 6ad1fbdd4803d9cd0277b871f105e71b https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/tripleo-ci-testing/delorean.repo.md5

Downstream components:
common: https://code.engineering.redhat.com/gerrit/c/testproject/+/443590
:::