# Ruck and rover notes #39
###### tags: `ruck_rover`

## INFO AND LINKS
:::spoiler

ruck/rover primer: https://docs.openstack.org/tripleo-docs/latest/ci/ruck_rover_primer.html

Infrared gerrit: https://review.gerrithub.io/q/project:redhat-openstack/infrared

Infrared doc: https://infrared.readthedocs.io/en/latest/

Cockpit: http://tripleo-cockpit.usersys.redhat.com/d/9DmvErfZz/cockpit?orgId=1

Internal Cockpit (WIP) http://tripleo-cockpit.usersys.redhat.com/?orgId=1
http://cistatus.tripleo.org/
https://trello.com/b/j4IcIomh/production-chain-escalation
http://rhos-release.virt.bos.redhat.com:3030/rhosp

Debugging Tools https://docs.google.com/document/d/1VZhje7ZN9sk4E31fYVrPxpqMJGz5ZhHRfhte_RYMXxg/edit#

Review.rdoproject.org dashboard: https://review.rdoproject.org/grafana/?orgId=1&var-datasource=default&var-server=registry.rdoproject.org.rdocloud&var-inter=$__auto_interval_inter

CentOS pre-release rpm updates for minor releases http://mirror.centos.org/centos/7/cr/x86_64/Packages/

hackmd.io rh-openstack-dev
https://hackmd.io/team/rh-openstack-ci?nav=overview

Internal software factory: https://sf.hosted.upshift.rdu2.redhat.com

upstream rsync mirror logs: files.openstack.org/mirror/logs/rsync-mirrors/centos.log

TRELLO RETROSPECTIVE https://trello.com/b/0VFswmht/rdo-infra-retrospective?menu=filter&filter=label:UniSprint21

Internal Dashboard - https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/QE/view/OSP16/ OSP-10 - OSP-16

RHOS INFRA INFRARED ISSUES https://projects.engineering.redhat.com/issues/?filter=34183

CIX escalation https://mojo.redhat.com/docs/DOC-1098748#jive_content_id_CIX_Escalation_Automation_and_email_format

CIX board https://trello.com/b/j4IcIomh/production-chain-escalation

Nodepool image logs: https://softwarefactory-project.io/nodepool-log/

We may want to move this etherpad to something internal at this point

please add your (colored) name here: time to move to hackmd WDYT? +1 (either now - start of the sprint/rr - or in 3 weeks)
marios (baby blue) fhubik("green lantern") wznoinsk (orange)Amnon(Marrooned)
:::
## POST BELOW THIS

:::warning
Dates: 10 Jan 2021 - 01 Feb 2021
Tripleo CI team ruck|rover: Sagi, Amol
OSP CI team ruck|rover: < ruck rover>

Previous notes: [link](https://hackmd.io/R0kCgz_7SHSix_cNgoC9pg)
:::

### Issues to track on-going
put these issues in the spoiler.
:::danger
#### tripleo

gates:

check:

promotions:

1. ~~[#1914047 periodic-tripleo-ci-centos-8-containers-undercloud-minion-master fails because No such file or directory: '/home/zuul/network_data_undercloud.yaml](https://bugs.launchpad.net/tripleo/+bug/1914047)~~
- patch: https://review.opendev.org/c/openstack/python-tripleoclient/+/773379

2. [#1914046 periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-master fails on certificate validation](https://bugs.launchpad.net/tripleo/+bug/1914046)
- patch: n/a

3. [#1914043 Octavia TrafficOperationsScenarioTest tests fail or timeout](https://bugs.launchpad.net/tripleo/+bug/1914043)
- patch:
- https://review.rdoproject.org/r/#/c/31817/
- https://review.opendev.org/c/openstack/tripleo-quickstart/+/770840
- next is WIP

4. ~~[#1914041 Manila test fail in periodic scenario004: Invalid share protocol provided: CEPHFS. It is either disabled or unsupported. Available protocols: ['NFS']](https://bugs.launchpad.net/tripleo/+bug/1914041)~~
- patch: https://review.rdoproject.org/r/31767

5. [#1914396 Scenario-007 periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset030-master fails because of "Property ContainerCrondImage not assigned"]()
- patch: @ramishra is working on this, probably: https://review.opendev.org/c/openstack/python-tripleoclient/+/773885

6. [#1914174 [ussuri] test_delete_server_while_in_building_state tempest test fails randomly](https://bugs.launchpad.net/tripleo/+bug/1914174)
- patch: n/a
:::

:::danger
#### OSP

:::

### Date

## Feb 01
[#1914061 CI: content provider job train centos7 pass when containers failed to build](https://bugs.launchpad.net/tripleo/+bug/1914061)

## Jan 25 - Jan 29
- Tempest volume tests filures
- https://bugs.launchpad.net/tripleo/+bug/1913383

- Ara installation is failing
- ~~https://bugs.launchpad.net/tripleo/+bug/1913046~~
- ~~https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/772325~~

- Destination directory /home/zuul/workspace/logs does not exists
- https://bugs.launchpad.net/tripleo/+bug/1913077
- https://review.opendev.org/c/openstack/tripleo-ci/+/772372

## Jan 18 - Jan 22
- Mirros are down
- ~~https://bugs.launchpad.net/tripleo/+bug/1912177~~

- Tempest test [Victoria] FloatingIpTestCasesAdmin.test_two_vms_fips
- https://bugs.launchpad.net/tripleo/+bug/1912171

- Python deps error in content provider
- ~~https://bugs.launchpad.net/tripleo/+bug/1912478~~
- ~~Cause: https://review.rdoproject.org/r/#/c/31573/~~
-

## Jan 7 - Jan 15
- ~~Tempest tried to run on overcloud [1911696](https://bugs.launchpad.net/tripleo/+bug/1911696)~~

- Revert OS Tempest
- ~~[770359](https://review.opendev.org/c/openstack/tripleo-quickstart/+/770359)~~
- ~~[770837](https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/770837)~~
## Jan 6th

- FS037-updates stein job fails consistenly.
~~https://bugs.launchpad.net/tripleo/+bug/1910399~~

Fix : https://review.opendev.org/c/openstack/tripleo-ci/+/769536

Testing : https://review.rdoproject.org/r/#/c/31487/

## Jan 5th

- ~~periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master (recent two failures)~~

https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main&job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master

test project passed - https://review.rdoproject.org/r/#/c/31424/
#### Tripleo

#### OSP