###### tags: `ruck_rover`
###### Previous RR notes: https://hackmd.io/p0GEY1m5ToagXucq7FhlHg

##### ruck & rover: dviroel
##### ruck & rover alias: @ruckroverciframework

[Next Gen cockpit](https://prometheus.monitoring.softwarefactory-project.io/grafana/d/5JC-ru3Vz/github-projects-workflow-status?orgId=1)
* [doc](https://docs.google.com/document/d/14CcHuMEACfXpAy1HkSc8s_CpN1KNC_POG2lzLnbKYLM/edit)

[RDO Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) / [RHOS Cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com)
[RDO Promoter](http://promoter.rdoproject.org/promoter_logs/) / [RHOS Promoter](http://10.0.110.143/promoter_logs/)

[OpenStack Program Meeting indexes](https://docs.engineering.redhat.com/pages/viewpage.action?spaceKey=PRODCHAIN&title=Meeting+notes)

[Modernization CI](https://hackmd.io/f9JzEVjMQC-hkJu1L9eolw)

Zuul Status:
* [opendev.org:openstack](https://zuul.opendev.org/t/openstack/status/)
* [rdoproject.org:rdoproject.org](https://review.rdoproject.org/zuul/status)
* [redhat.com:tripleo-ci-internal](https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status)

Prow Status
* [Operators - Check/Gate failures](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*&state=failure)
* For now, we just look (and investigate) if a test has multiple failures across different PRs
* [Operators - Check/Gate status](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*)
* [pre-commit jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-main-precommit-check&state=failure)
* [pre-commit jobs status](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-main-precommit-check)
* [unit tests jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-main-unit&state=failure)
* [kuttl tests Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-kuttl&state=failure)
* [Tempest Jobs](https://prow.ci.openshift.org/?job=pull-ci-openstack-k8s-operators*-operator-build-deploy-tempest&state=failure)

[Review List](/FGMoCiRfSNa8puA1BpTQ-Q)

#### Podifed Container Build Lines
* [openstack-periodic-container-master-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-master-centos9)
* [openstack-periodic-container-antelope-centos9](https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-periodic-container-antelope-centos9&skip=0)

---
:::danger

## Bugs

- https://issues.redhat.com/browse/OSPCIX-60 - [master] EDPM job failing to deploy DataPlane in "Configure neutron.conf" task
- https://issues.redhat.com/browse/OSPCIX-63 - tripleo-build-containers-rhel-[8|9] failing in "Execute build-report" task
:::

:::info
## Closed bugs
* ~~https://issues.redhat.com/browse/OSP-27549~~ - EDPM/Baremetal Jobs fails randomly with no endpoints available for service "nmstate-webhook
* ~~https://issues.redhat.com/browse/OSPCIX-55~~ - cs8 train: os_tempest ping router ip address task failing with Destination Host Unreachab
* in the end, iptables is pinned in release file and no fix will land for stable/train. **The last train is about to leave**.

:::

## Promotion Status

:::warning
#### Upstream
* Podified Master: 2023-08-28 - blocked by [OSPCIX-60]
* Podified Antelope: 2023-09-06
* CentOS 9 Wallaby : 2023-09-04 (No new hash)
* CentOS 8 Wallaby: 2023-09-07
* CentOS 8 Train: 2023-08-28 (No new hash)

#### Downstream
* Podified RHEL 9 RHOS 18.0: 2023-09-05
* RHEL 9 RHOS 17.1: 2023-09-02 (no new hash)
* RHEL 9 RHOS 17.0: 2023-09-01 (bm_envB still failing) (No new hash)
* RHEL 8 RHOS 17.1: 2023-09-07 NEW HASH - blocked by [OSPCIX-63] (got jobs to pass by extending the timeout on container build/push jobs)
* RHEL 8 RHOS 16.2: 2023-09-03 (no new hash)
---
:::
## Sep 7
* **featureset001-wallaby** and **featureset035-wallaby** are still failing on node_provision step.Need CIX/investigation on this now
* New CIX https://issues.redhat.com/browse/OSPCIX-63 - card updated - with comments from Jason re: registry slow down. https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/6068fc1a351147acb7dd4219a4bc7a68 very slow but passed ... ran with 18000 timeout
* 16.2 compute component - testproject rerun

## Sep 6
* ci-framework jobs are broken due to a major change in dataplane operator and affected operators - see more info here https://redhat-internal.slack.com/archives/CQXJFGMK6/p1694011657265869
* New CIX https://issues.redhat.com/browse/OSPCIX-63

## Sep 4
* **featureset001-wallaby** and **featureset064-wallaby** are frequently failing on node_provision step. We eventually got those 2 passing and wallaby will promote. Needs attention.
* Question raised on CIX: should we keep creating CIX for podified-master? What are the benefits of raising CIX/bugs for master branch? To be discussed on prod-chain-consul meeting.
* Tomcat: Revert was created, but new pkg version is not available on AFS mirros yet, only on CS9 https://review.opendev.org/c/openstack/tripleo-quickstart/+/893551
* **podified-antelope-centos9** continues to fail on different jobs, which makes hard to promote a tag. (UPDATE: promoted today)

## Sep 1
* https://review.opendev.org/c/openstack/tripleo-quickstart/+/893443 - https://issues.redhat.com/browse/OSPCIX-37 revert patch
* Test project: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/893490
* New bug: - https://issues.redhat.com/browse/OSPCIX-60 - [master] EDPM job failing to deploy DataPlane in "Configure neutron.conf" task