# Ruck Rover - 15 Apr 2022 - 21 Apr 2022 ###### tags: `ruck_rover` ###### Previous RR notes: https://hackmd.io/1lRiCS-oS3-J1ZYHZH3Xzg?both [Cockpit](http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1) [Downstream cockpit](http://tripleo-cockpit.lab4.eng.bos.redhat.com) ## HandOver Notes from previous week: * https://bugs.launchpad.net/tripleo/+bug/1968615 * https://bugs.launchpad.net/tripleo/+bug/1964129 * https://bugs.launchpad.net/tripleo/+bug/1968184 * https://bugs.launchpad.net/tripleo/+bug/1968732 * Upstream vanilla cs9 standalone is broken at validation check *~~ fix https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/837801~~ * RHOS-17 rhel-8 * ceph-tag bump to latest: ~~https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/402150~~ * RHOS17 RHEL9 * Fix with testproject: https://code.engineering.redhat.com/gerrit/c/testproject/+/402613 * https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-9-internal-rhel-9-build-push-upload-rhos-17/9c0af39/job-output.txt `package rdo-openvswitch-1:2.15-2.el9s.noarch requires network-scripts-openvswitch2.15, but none of the providers can be installed` * ~~https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/402643~~ * ~~https://review.opendev.org/c/zuul/zuul-jobs/+/837850~~ merged * Not urgent: https://bugs.launchpad.net/tripleo/+bug/1960310 ## 21 April 2022 : #### Upstream * Testing failed component line jobs here: * https://review.rdoproject.org/r/c/testproject/+/36274 * network component lines having more failures in all releases: * checking in testproject : https://review.rdoproject.org/r/c/testproject/+/33791 * as bug reported [https://bugs.launchpad.net/tripleo/+bug/1969669] added tests to skipped list [https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/838819] and posted testproject [https://review.rdoproject.org/r/c/testproject/+/36478/9#message-69999234206b7a17775d3bd6af2576a8106498e0] having lot of tempest failures. (something weired) #### Downstream * woohooo 16.2 component line is all green * 17 rhel8 tempest component needs an eyes of tempest person * periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-tempest-rhos-17 - multiple tempest tests failure * ## 20 April 2022 : #### Upstream * Victoria promoted * Also affacting upstream NTP issue on overcloud nodes - Promotion Blocker: * https://bugs.launchpad.net/tripleo/+bug/1969611 * https://bugzilla.redhat.com/show_bug.cgi?id=2076756 * #### Downstream * OSP 17 - RHEL9 - promoted: 2022-04-20 14:23 - \o/ * master network line hasn't promoted in 12 days * https://bugs.launchpad.net/tripleo/+bug/1969669 * its duplicate of https://bugs.launchpad.net/tripleo/+bug/1968732 as per comment [https://bugs.launchpad.net/tripleo/+bug/1969669/comments/1] ## 19 April 2022 : #### Upstream Posted testproject for C8 wallaby failed jobs : https://review.rdoproject.org/r/c/testproject/+/33791 Reported a bug for openstack-tox-py36 : https://bugs.launchpad.net/tripleo/+bug/1969425 * Wallaby CS8: * https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/42058 - Skip fs035 - needs revert after promotion * ~~Promoter failed to push containers - we need help here friom akahat/bhagyashris~~ wallaby c8 promoted tox-molecule failing again: mirror issues https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-tox-molecule&project=openstack/tripleo-ci #### Downstream * Reported a bug for osp17 rhel9 (promotion blocker) : https://bugzilla.redhat.com/show_bug.cgi?id=2076450 * New bug for OSP17 on RHEL9 (All OVBs - NTP issue on overcloud nodes) - Promotion Blocker: https://bugzilla.redhat.com/show_bug.cgi?id=2076756 Also affacting upstream : https://bugs.launchpad.net/tripleo/+bug/1969611 ## 18 April 2022 : ##### Upstream * https://bugs.launchpad.net/tripleo/+bug/1969158 - blocking all master ovb jobs *~~https://review.opendev.org/c/openstack/tripleo-ansible/+/838097~~ * https://trello.com/c/pBfIvdGA/2458-cixlp1969158tripleociproa-master-ovb-jobs-are-failing-overcloud-deployment-unreachable-manage-firewall-rules * fix: ~~https://review.opendev.org/c/openstack/python-tripleoclient/+/838228~~ merged * Good run train: https://review.rdoproject.org/zuul/buildset/b88a7c5fb17b4127b4aa0d1e1dc07c60 * testproject: https://review.rdoproject.org/r/c/testproject/+/36719 * **Promoted on 18th** * Good run wallaby: https://review.rdoproject.org/zuul/buildset/56dd6efe0aee4b35916fd90a8719b8ca * testproject: https://review.rdoproject.org/r/c/testproject/+/33791 * **Promoted on 18th** - previous hash * CS9 wallaby multinode skiplist: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/838292 * Downstream pre fix: ~~https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/402879~~ * ~~https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/402890~~ * Wallaby CS8: * fs035 failing with different errors: * https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-wallaby * If we skip fs035, it will promote a previous hash (41fdd210ebf4873387efe6a1d8dc5ba6) ##### Downstream * OSP 17 rhel-8: https://code.engineering.redhat.com/gerrit/c/testproject/+/286307 * **7227cd0eb23fdee7e83d3002951ecd99 promoted** * OSP 17 rhel-9: * Still failing on "network-scripts-openvswitch2.15" even after zuul-jobs patch merged * 16.2 rhel-8: https://code.engineering.redhat.com/gerrit/c/testproject/+/276230