# Ruck Rover 2023-03-03 - 2023-03-09
[RDO Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) / [RHOS Cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com)
[RDO Promoter](http://promoter.rdoproject.org/promoter_logs/) / [RHOS Promoter](http://10.0.110.143/promoter_logs/)

[OpenStack Program Meeting 2022](https://docs.engineering.redhat.com/pages/viewpage.action?spaceKey=PRODCHAIN&title=Meeting+notes)

Zuul Status:
* [opendev.org:openstack](https://zuul.opendev.org/t/openstack/status/)
* [rdoproject.org:rdoproject.org](https://review.rdoproject.org/zuul/status)
* [redhat.com:tripleo-ci-internal](https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status)

:::warning
**Prow Status**
* [Operators - Check/Gate failures](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*&state=failure)
* For now, we just look (and investigate) if a test has multiple failures across different PRs
:::
[Review List](/FGMoCiRfSNa8puA1BpTQ-Q)

###### tags: `ruck_rover`
###### Previous RR notes: https://hackmd.io/aRYXIQ2ZSlShFAGzhU7KNA

##### ruck & rover: Amol (akahat), Dariusz (dasm)
##### ruck & rover alias: @ruckroverciframework

:::warning
### Ongoing bugs

#### Upstream check
* https://bugs.launchpad.net/tripleo/+bug/2008822 tripleo-ansible "tripleo_compute_node" molecule job failing on "tripleo_iscsid" task
* the fix got merged. Waiting for another test run to verify it.
#### Upstream blockers
* https://bugs.launchpad.net/tripleo/+bug/2009488 tripleo modify-image role failed with format: raw error
#### Downstream blockers
* https://bugzilla.redhat.com/show_bug.cgi?id=2170553 [RHOS-17.1][RHEL-9.2] Container image prepare is failing with No module named 'ansible'
- need to monitor
:::

:::success
### Solved bugs
:::spoiler
* ~~https://bugs.launchpad.net/tripleo/+bug/2007659 master and zed content providers fail container build "no module named ansible"~~
* ~~https://bugs.launchpad.net/tripleo/+bug/2007839 centos-9-standalone-external-compute job fails “Destination /etc/iscsi/iscsid.conf does not exist”~~
* ~~https://bugzilla.redhat.com/show_bug.cgi?id=2174352 rhos18 on rhel9 - tempest.lib.exceptions.SSHTimeout: Connection to the 192.168.24.197 via SSH timed out~~
:::

## Thursday, 09 March 2023
### Promotion Status
::: info
#### Upstream promotion
https://review.rdoproject.org/r/c/testproject/+/42887/27/.zuul.yaml

CentoS 9 Master: 2023-03-09
CentOS 9 Zed: 2023-03-07
CentOS 9 Wallaby: 2023-03-09
CentOS 8 Wallaby: 2023-03-09
CentOS 8 Train: 2023-03-08

#### Downstream Promotion
https://code.engineering.redhat.com/gerrit/c/testproject/+/432677/8/.zuul.yaml

RHEL 9 RHOS 18.0 2023-03-08
RHEL 9 RHOS 17.1 2023-03-06
RHEL 9 RHOS 17.0 2023-03-07
RHEL 8 RHOS 17.1 2023-03-08
RHEL 8 RHOS 16.2 2023-03-09
:::

#### Vexxhost ticket node_failures
- https://support.vexxhost.com/hc/en-us/requests/363602

## Wednesday, 08 March 2023
### Promotion Status
::: info
#### Upstream promotion
https://review.rdoproject.org/r/c/testproject/+/42887/27/.zuul.yaml

CentoS 9 Master: 2023-03-07
CentOS 9 Zed: 2023-03-07
CentOS 9 Wallaby: 2023-03-08
CentOS 8 Wallaby: 2023-03-08
CentOS 8 Train: 2023-03-08

#### Downstream Promotion
https://code.engineering.redhat.com/gerrit/c/testproject/+/432677/8/.zuul.yaml

RHEL 9 RHOS 18.0 2023-03-06
RHEL 9 RHOS 17.1 2023-03-06
RHEL 9 RHOS 17.0 2023-03-07
RHEL 8 RHOS 17.1 2023-03-08
RHEL 8 RHOS 16.2 2023-03-07
:::

## Tuesday, 07 March 2023
### Promotion Status
::: info
#### Upstream promotion
https://review.rdoproject.org/r/c/testproject/+/42887/24

CentoS 9 Master: 2023-03-07
CentOS 9 Zed: 2023-03-07
CentOS 9 Wallaby: 2023-03-07
CentOS 8 Wallaby: 2023-03-07
CentOS 8 Train: 2023-03-05

#### Downstream Promotion

RHEL 9 RHOS 18.0 2023-03-06
RHEL 9 RHOS 17.1 2023-03-06
RHEL 9 RHOS 17.0 2023-03-07
RHEL 8 RHOS 17.1 2023-03-07
RHEL 8 RHOS 16.2 2023-03-06
:::

## Monday, 06 March 2023
### Promotion Status
::: info
#### Upstream promotion
https://review.rdoproject.org/r/c/testproject/+/42887/24

CentoS 9 master: 2023-03-06
CentOS 9 zed: 2023-03-06
CentOS 9 wallaby: 2023-03-06
CentOS 8 Train: 2023-03-05
CentOS 8 wallaby: 2023-03-06

#### Downstream Promotion
https://code.engineering.redhat.com/gerrit/c/testproject/+/428925

RHEL 9 RHOS 18.0 - 2023-03-03
* https://bugzilla.redhat.com/show_bug.cgi?id=2174352
RHEL 9 RHOS 17.1 2023-03-06
RHEL 9 RHOS 17.0 2023-03-04
RHEL 8 RHOS 17.1 2023-03-05
RHEL 8 RHOS 16.2 2023-03-06
:::

## Upstream issues
- fs-35-master failing on different tempest tests[1] checking internal job run[2]
[1] https://review.rdoproject.org/r/c/testproject/+/42887/23#message-f1a2ab2be800c1b8486fec79663acea7771613a7
[2] https://code.engineering.redhat.com/gerrit/c/testproject/+/428925
- ~~Adding periodic-tirpleo-ci-centos-9-standalone-external-compute-target-host-master back to criteria https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/47356~~

## Friday, 03 March 2023

### Promotion Status
:::info
#### Upstream Promotion
https://review.rdoproject.org/r/c/testproject/+/45781

CentoS 9 master: 2023-03-03
CentOS 9 zed: 2023-03-02
CentOS 9 wallaby: 2023-03-03
CentOS 8 Train: 2023-03-02
CentOS 8 wallaby: 2023-03-03

#### Downstream Promotion
https://code.engineering.redhat.com/gerrit/c/testproject/+/432677

RHEL 9 RHOS 18.0 - 2023-03-02
* https://bugzilla.redhat.com/show_bug.cgi?id=2174352
RHEL 9 RHOS 17.1 2023-03-03
RHEL 9 RHOS 17.0 2023-03-03
RHEL 8 RHOS 17.1 2023-03-03
RHEL 8 RHOS 16.2 2023-03-03
:::

## Upstream check issues
tripleo-ci-centos-9-containers-multinode jobs failure
- ERROR! Unexpected Exception, this is probably a bug: cannot import name 'ipaddr' from 'ansible_collections.ansible.utils.plugins.filter' (/usr/share/ansible/collections/ansible_collections/ansible/utils/plugins/filter/__synthetic__)
- https://ee3effbf52dec7b2801c-baa753fa9aa73e2e1b575c4411692489.ssl.cf5.rackcdn.com/876254/1/check/tripleo-ci-centos-9-containers-multinode/4eeaeaf/logs/undercloud/home/zuul/undercloud_install.log
- https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_01b/876247/2/check/tripleo-ci-centos-9-containers-multinode/01b67bb/logs/undercloud/home/zuul/undercloud_install.log
- https://04e1a81b9004b13f1732-58d59663991bfd1d0dc3ba3167f83a98.ssl.cf1.rackcdn.com/876247/1/check/tripleo-ci-centos-9-containers-multinode/f6e945b/logs/undercloud/home/zuul/undercloud_install.log