# Ruck Rover 2023-06-16 - 2023-06-22

[RDO Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) / [RHOS Cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com)
[RDO Promoter](http://promoter.rdoproject.org/promoter_logs/) / [RHOS Promoter](http://10.0.110.143/promoter_logs/)

[OpenStack Program Meeting indexes](https://docs.engineering.redhat.com/pages/viewpage.action?spaceKey=PRODCHAIN&title=Meeting+notes)

Zuul Status:
* [opendev.org:openstack](https://zuul.opendev.org/t/openstack/status/)
* [rdoproject.org:rdoproject.org](https://review.rdoproject.org/zuul/status)
* [redhat.com:tripleo-ci-internal](https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status)

Prow Status
* [Operators - Check/Gate failures](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*&state=failure)
* For now, we just look (and investigate) if a test has multiple failures across different PRs
* [pre-commit jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-main-precommit-check&state=failure)
* [unit tests jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-main-unit&state=failure)
* [kuttl tests Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-kuttl&state=failure)
* [Tempest Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-tempest&state=failure)

[Review List](/FGMoCiRfSNa8puA1BpTQ-Q)

#### Podifed Container Build Lines
* [openstack-periodic-container-master-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-master-centos9)
* [openstack-periodic-container-antelope-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-antelope-centos9&skip=0)

###### tags: `ruck_rover`
###### Previous RR notes: https://hackmd.io/A5GoG28LR9eK6vIanKITVA

##### ruck & rover: chandankumar
##### ruck & rover alias: @ruckroverciframework

https://review.rdoproject.org/r/c/testproject/+/48811
https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/884993

:::info
**Fixes and Improvements needed**

* role *oooci-build-images* needs to use *discover-latest-image* to always get latest CentOS image. So we can stop manual updates on role's vars.
* https://github.com/openstack/tripleo-ci/commit/6df518c8a98bfb73d585c6f6e238f1c2ad9053f1
* periodic build-image jobs were failing because of that

:::

:::danger

**OPEN BUGS**

* https://bugzilla.redhat.com/show_bug.cgi?id=2215882: Run cephadm bootstrap failed with ERROR: Container release quincy != cephadm release pacific
* fixed now.

* Issue with build05 cluster blocking kuttl prow jobs : https://issues.redhat.com/browse/OHSS-23516

* DLRN Client: version 0.13.0 has broken promoter script: https://issues.redhat.com/browse/PCTOOLING-783

* EDPM antelope periodic jobs are broken: https://issues.redhat.com/browse/OSP-25843
:::

:::info
### Promotion status

#### Upstream promotion

* Podified Master: 2023-06-18
* Podified Antelope: 2023-06-19
* CentOS 9 Wallaby 2023-06-21
* CentOS 8 Wallaby 2023-06-21
* CentOS 8 Train 2023-06-17 (NNH after 2f5857e3fe133aca0ddf965e3ea76a85)

#### Downstream Promotion
* Podified RHEL 9 RHOS 18.0: 2023-06-21
* RHEL 9 RHOS 17.1: 2023-06-21
* RHEL 9 RHOS 17.0: 2023-05-22
* RHEL 8 RHOS 17.1: 2023-06-22
* RHEL 8 RHOS 16.2: 2023-06-21
:::

## Handover notes
* Zuul check jobs are not triggering on github pr or gerrit reviews: https://redhat-internal.slack.com/archives/C042U5CT6TH/p1687405457679229

* https://review.rdoproject.org/zuul/builds?job_name=periodic-centos-9-podified-edpm-integration-antelope&project=rdo-jobs - tempest failures blocking the containers - https://issues.redhat.com/browse/OSP-25843
* fix : https://review.rdoproject.org/r/c/rdo-jobs/+/48932
* testing: https://review.rdoproject.org/r/c/testproject/+/48907

* New release of dlrnapi-client broke the promoter
* downstream dlrn service stopped right now
* Alredo is investigating, once issue found, please revert it https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/48933
* Related tracker: https://issues.redhat.com/browse/PCTOOLING-783

* Prow kuttl jobs failure on build05 cluster: https://issues.redhat.com/browse/OHSS-23516
## Jun 22, 2023