# Ruck Rover 2023-02-24 - 2023-03-02
[RDO Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) / [RHOS Cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com)
[RDO Promoter](http://promoter.rdoproject.org/promoter_logs/) / [RHOS Promoter](http://10.0.110.143/promoter_logs/)

[OpenStack Program Meeting 2022](https://docs.engineering.redhat.com/pages/viewpage.action?spaceKey=PRODCHAIN&title=Meeting+notes)

Zuul Status:
* [opendev.org:openstack](https://zuul.opendev.org/t/openstack/status/)
* [rdoproject.org:rdoproject.org](https://review.rdoproject.org/zuul/status)
* [redhat.com:tripleo-ci-internal](https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status)

:::warning
**Prow Status**
* [Operators - Check/Gate failures](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*&state=failure)
* For now, we just look (and investigate) if a test has multiple failures across different PRs
:::

[Review List](/FGMoCiRfSNa8puA1BpTQ-Q)

###### tags: `ruck_rover`
###### Previous RR notes: https://hackmd.io/1TeTSRVeSKqudWce7RQYhA?view

##### ruck & rover: Bhagyashri (bshewale), Doug (dviroel)
##### ruck & rover alias: @ruckroverciframework

:::warning
### Ongoing bugs

#### Upstream check
* https://bugs.launchpad.net/tripleo/+bug/2008822 tripleo-ansible "tripleo_compute_node" molecule job failing on "tripleo_iscsid" task
#### Upstream blockers
* https://bugs.launchpad.net/tripleo/+bug/2007659 master and zed content providers fail container build "no module named ansible"
* https://bugs.launchpad.net/tripleo/+bug/2007839 centos-9-standalone-external-compute job fails “Destination /etc/iscsi/iscsid.conf does not exist”
#### Downstream blockers
* https://bugzilla.redhat.com/show_bug.cgi?id=2174352 rhos18 on rhel9 - tempest.lib.exceptions.SSHTimeout: Connection to the 192.168.24.197 via SSH timed out
* https://bugzilla.redhat.com/show_bug.cgi?id=2170553 [RHOS-17.1][RHEL-9.2] Container image prepare is failing with No module named 'ansible'
- need to monitor
:::

## Thus 02nd March 2023

### Promotion Status
:::info
#### Upstream Promotion
CentOS 8 Train: 2023-03-02
CentOS 8 wallaby: 2023-03-02
CentOS 9 wallaby: 2023-03-02
CentOS 9 Zed: 2023-03-02
CentoS 9 master: 2023-03-02

#### Downstream Promotion

RHEL 9 RHOS 18.0 - 2023-03-02
* https://bugzilla.redhat.com/show_bug.cgi?id=2174352
RHEL 9 RHOS 17.1 2023-03-02
RHEL 9 RHOS 17.0 2023-03-01 (no new content)
RHEL 8 RHOS 17.1 2023-03-02
RHEL 8 RHOS 16.2 - 2023-03-02
:::

## Upstream:

* master: re-running failing job: https://review.rdoproject.org/r/c/testproject/+/44874 [DNM] Test failing job **SUCCESS**
* zed:
* wallaby c9:
* wallaby c8:
* train c8:

## Downstream:

* 18 on rhel9:
* 17.1 on rhel9:
* 17 on rhel9:
* 17.1 on rhel8:
* 16.2 on rhel8: re-running failing job: https://code.engineering.redhat.com/gerrit/c/testproject/+/431140 [DNM] Test failing jobs **SUCCESS**

## Component:

* **Note:** According to rr tool result all the copmonents (both upstream downstream) jobs for all branches (except master fs001 tripleo component job) are GREEN
* Upstream:
* master: re-running job here : https://review.rdoproject.org/r/c/testproject/+/47232 [DNM] Test failing component jobs **SUCCESS**
* Downstream:
*

## Wed 01st March 2023

### Promotion Status
:::info
#### Upstream Promotion
CentOS 8 Train: 2023-02-26 (no new content)
CentOS 8 wallaby: 2023-03-01
CentOS 9 wallaby: 2023-03-01
CentOS 9 Zed: 2023-03-01
CentoS 9 master: 2023-03-01

#### Downstream Promotion

RHEL 9 RHOS 18.0 - 2023-02-25
* https://bugzilla.redhat.com/show_bug.cgi?id=2174352
RHEL 9 RHOS 17.1 2023-02-28 (no new content)
RHEL 9 RHOS 17.0 2023-03-01
RHEL 8 RHOS 17.1 2023-03-01
RHEL 8 RHOS 16.2 - 2023-03-01
:::

## Upstream:

* master: re-running failing jobs here : https://review.rdoproject.org/r/c/testproject/+/44874 [DNM] Test failing job **SUCCESS**
* zed:
* wallaby c9:
* wallaby c8:
* train c8:

## Downstream:

* 18 on rhel9: blocked due to standalone job failure due to tempest test failure. reported bug https://bugzilla.redhat.com/show_bug.cgi?id=2174352
* 17.1 on rhel9:
* 17 on rhel9: re-running failing job: https://code.engineering.redhat.com/gerrit/c/testproject/+/431169 [DNM] Test rhos17 on rhel9 failing job - **SUCCESS**
* 17.1 on rhel8:
* 16.2 on rhel8:

## Component:
* Upstream: All branches component jobs are GREEN except master
* master: re-running failing job here : https://review.rdoproject.org/r/c/testproject/+/47232 [DNM] Test failing component jobs **SUCCESS**

* Downstream:
*

## Tuesday 28th Feb 2023

### Promotion Status
:::info
#### Upstream Promotion
CentOS 8 Train: 2023-02-26 (no new content)
CentOS 8 wallaby: 2023-02-27 (no new content)
CentOS 9 wallaby: 2023-02-26 (no new content)
CentOS 9 Zed: 2023-02-26 (no new content)
CentoS 9 master: 2023-02-28

#### Downstream Promotion

RHEL 9 RHOS 18.0 - 2023-02-25 (no new content)
RHEL 9 RHOS 17.1 2023-02-26 (no new content)
RHEL 9 RHOS 17.0 2023-02-28
RHEL 8 RHOS 17.1 2023-02-28
RHEL 8 RHOS 16.2 - 2023-02-28
:::

## Upstream:

* master: re-running failing jobs: https://review.rdoproject.org/r/c/testproject/+/44874 [DNM] Test failing job : **JOBS PASSED**

* zed:
* wallaby c9:
* wallaby c8:
* train c8:

## Downstream:

* 18 on rhel9: re-running failing job here: https://code.engineering.redhat.com/gerrit/c/testproject/+/431140
* 17.1 on rhel9:
* 17 on rhel9:
* 17.1 on rhel8:
* 16.2 on rhel8: re-running failing jon here https://code.engineering.redhat.com/gerrit/c/testproject/+/431140 [DNM] Test 16.2 on rhel8 failing jobs : - **JOBS PASSED**

## Component:
* master and zed common component jobs are failing - rerunning jobs here: https://review.rdoproject.org/r/c/testproject/+/47232 [DNM] Test failing component jobs [NEW] : **JOBS PASSED**
* log error: https://logserver.rdoproject.org/openstack-component-common/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-common-wallaby/30b73ab/job-output.txt

2023-02-28 06:17:27.922454 | TASK [ceph-loop-device : Make sure we have losetup installed/latest]
2023-02-28 06:18:30.936857 | primary | ERROR
2023-02-28 06:18:30.937104 | primary | {
2023-02-28 06:18:30.937154 | primary |   "msg": "Failed to download packages: device-mapper-event-9:1.02.187-7.el9.x86_64: Cannot download, all mirrors were already tried without success",
2023-02-28 06:18:30.937191 | primary |   "results": []
2023-02-28 06:18:30.937225 | primary | }
2023-02-28 06:18:30.939354 | 
2023-02-28 06:18:30.939443 | PLAY RECAP
2023-02-28 06:18:30.939506 | primary | ok: 4 changed: 0 unreachable: 0 failed: 1 skipped: 7 rescued: 0 ignored: 0

## Mon 27th Feb 2023

### Promotion Status
:::info
#### Upstream Promotion
CentOS 8 Train: 2023-02-26 (no new content)
CentOS 8 wallaby: 2023-02-27
CentOS 9 wallaby: 2023-02-26 (no new content)
CentOS 9 Zed: 2023-02-26 (no new content)
CentoS 9 master: 2023-02-27

#### Downstream Promotion

RHEL 9 RHOS 18.0 - 2023-02-25 (no new content)
RHEL 9 RHOS 17.1 2023-02-26 (no now content)
RHEL 9 RHOS 17.0 2023-02-24 (no new content
RHEL 8 RHOS 17.1 2023-02-27
RHEL 8 RHOS 16.2 - 2023-02-26
:::

## Upstream:

* master:
* Running failing job : https://review.rdoproject.org/r/c/testproject/+/44874 [DNM] Test failing job - JOB PASSED
* zed:
* wallaby c9:
* wallaby c8:
* train c8:

## Downstream:

* 18 on rhel9:
* 17.1 on rhel9:
* 17 on rhel9:
* 17.1 on rhel8:
* 16.2 on rhel8: