updates for week of 2024-11-18

= openqa - sometime

* openqa-a64-worker01.iad2.fedoraproject.org
* openqa-a64-worker02.iad2.fedoraproject.org
* openqa-a64-worker03.iad2.fedoraproject.org
* openqa-a64-worker04.iad2.fedoraproject.org
* openqa-p09-worker01.iad2.fedoraproject.org
* openqa-p09-worker02.iad2.fedoraproject.org
* openqa-x86-worker01.iad2.fedoraproject.org
* openqa-x86-worker02.iad2.fedoraproject.org
* openqa-x86-worker03.iad2.fedoraproject.org
* openqa-x86-worker04.iad2.fedoraproject.org
* openqa-x86-worker05.iad2.fedoraproject.org
* openqa-x86-worker06.iad2.fedoraproject.org
* qvmhost-x86-01.iad2.fedoraproject.org
* qvmhost-x86-02.iad2.fedoraproject.org

= copr - sometime

* vmhost-p08-copr01.rdu-cc.fedoraproject.org
* vmhost-p08-copr02.rdu-cc.fedoraproject.org
* vmhost-p09-copr01.rdu-cc.fedoraproject.org
* vmhost-x86-copr01.rdu-cc.fedoraproject.org
* vmhost-x86-copr02.rdu-cc.fedoraproject.org
* vmhost-x86-copr03.rdu-cc.fedoraproject.org
* vmhost-x86-copr04.rdu-cc.fedoraproject.org

= 2024-11-18 Monday - staging

* bvmhost-a64-01.stg.iad2.fedoraproject.org - kevin - done
* bvmhost-p09-01.stg.iad2.fedoraproject.org - kevin - done
* bvmhost-s390x-01.stg.s390.fedoraproject.org - kevin - done
* bvmhost-x86-01.stg.iad2.fedoraproject.org - kevin - done
* bvmhost-x86-02.stg.iad2.fedoraproject.org - jantill - done
* bvmhost-x86-03.stg.iad2.fedoraproject.org - jantill - done
* bvmhost-x86-05.stg.iad2.fedoraproject.org - jantill - done - sign-vault01.stg.iad2.fedoraproject.org problem?
* yeah, there's a misconfiguration in it's eth0, will look more
* vmhost-x86-01.stg.iad2.fedoraproject.org - jantill - done
* vmhost-x86-02.stg.iad2.fedoraproject.org - jantill - done
* vmhost-x86-05.stg.iad2.fedoraproject.org - jantill - done - ocp01.ocp.stg.iad2.fedoraproject.org problem?
* nope, the ocp hosts ansible has no access to, it's normal.
* vmhost-x86-06.stg.iad2.fedoraproject.org - jantill - done - ocp02.ocp.stg.iad2.fedoraproject.org problem?
* vmhost-x86-07.stg.iad2.fedoraproject.org - jantill - done - ocp03.ocp.stg.iad2.fedoraproject.org problem?
* vmhost-x86-08.stg.iad2.fedoraproject.org - jantill - done
* vmhost-x86-09.stg.iad2.fedoraproject.org - jantill - done
* vmhost-x86-11.stg.iad2.fedoraproject.org - jantill - done - centos-ipa-client01.stg.iad2.fedoraproject.org problem?
* vmhost-x86-12.stg.iad2.fedoraproject.org - jantill - done - centos-ipa-client02.stg.iad2.fedoraproject.org problem?
* normal, we have no access to the centos vm's

= 2024-11-19 Tuesday - non outage causing

* autosign02.iad2.fedoraproject.org - needs robosig pass - kevin - done
* backup01.iad2.fedoraproject.org - needs backup pass - kevin - done
* buildhw-a64-01.iad2.fedoraproject.org - jantill - done
* buildhw-a64-02.iad2.fedoraproject.org - jantill - done
* buildhw-a64-07.iad2.fedoraproject.org - jantill - done
* buildhw-a64-08.iad2.fedoraproject.org - jantill - done
* buildhw-a64-09.iad2.fedoraproject.org - jantill - done
* buildhw-a64-10.iad2.fedoraproject.org - jantill - done
* buildhw-a64-11.iad2.fedoraproject.org - jantill - done
* buildhw-a64-12.iad2.fedoraproject.org - jantill - done
* buildhw-a64-13.iad2.fedoraproject.org - jantill - done
* buildhw-a64-19.iad2.fedoraproject.org - jantill - done
* buildhw-a64-20.iad2.fedoraproject.org - jantill - done
* dedicatedsolutions01.fedoraproject.org - kevin - done
* ibiblio02.fedoraproject.org - kevin - done
* ibiblio05.fedoraproject.org - kevin - done
* internetx02.fedoraproject.org - kevin - done
* osuosl02.fedoraproject.org - kevin - done
* proxy05.fedoraproject.org - kevin - done
* retrace03.rdu-cc.fedoraproject.org - kevin - done
* sign-vault02.iad2.fedoraproject.org - needs vault pass - kevin - done
* storinator01.rdu-cc.fedoraproject.org - kevin - done
* bvmhost-x86-riscv01.iad2.fedoraproject.org - kevin - done
* vmhost-x86-cc02.rdu-cc.fedoraproject.org - jantill - done
* vmhost-x86-cc05.rdu-cc.fedoraproject.org - jantill - done
* vmhost-x86-cc06.rdu-cc.fedoraproject.org - jantill - done (quick update)
* maintainer_test group - kevin - done

= 2024-11-20 Wed

[x] Apply updates to everything - kevin in progress
[x] update status
[x] silence nagios
[x] disable backups on backup01
[x] disable updates pushed on bodhi-backend01
[x] move koji pkgs from f41-infra-stg to f41-infra
[ ] upgrade builders all to f41 and koji hubs - in progress

builders (need f41 upgrade): - kevin - in progress

bkernel01.iad2.fedoraproject.org
bkernel02.iad2.fedoraproject.org
buildhw-a64-03.iad2.fedoraproject.org - kevin - done
buildhw-a64-04.iad2.fedoraproject.org - kevin - done
buildhw-a64-05.iad2.fedoraproject.org - kevin - done
buildhw-a64-06.iad2.fedoraproject.org - kevin - done
buildhw-x86-01.iad2.fedoraproject.org - kevin - done
buildhw-x86-02.iad2.fedoraproject.org - kevin - done
buildhw-x86-03.iad2.fedoraproject.org - kevin - done
buildhw-x86-04.iad2.fedoraproject.org - kevin - done
buildhw-x86-05.iad2.fedoraproject.org - kevin - done
buildhw-x86-06.iad2.fedoraproject.org - kevin - done
buildhw-x86-07.iad2.fedoraproject.org - kevin - done
buildhw-x86-08.iad2.fedoraproject.org - kevin - done
buildhw-x86-09.iad2.fedoraproject.org - kevin - done
buildhw-x86-10.iad2.fedoraproject.org - kevin - done
buildhw-x86-11.iad2.fedoraproject.org - kevin - done
buildhw-x86-12.iad2.fedoraproject.org - kevin - done
buildhw-x86-13.iad2.fedoraproject.org - kevin - done
buildhw-x86-14.iad2.fedoraproject.org - kevin - done
buildhw-x86-15.iad2.fedoraproject.org - kevin - done
buildhw-x86-16.iad2.fedoraproject.org - kevin - done
bvmhost-a64-01.iad2.fedoraproject.org - kevin - done
bvmhost-a64-02.iad2.fedoraproject.org - kevin - done
bvmhost-a64-03.iad2.fedoraproject.org - kevin - done
bvmhost-a64-04.iad2.fedoraproject.org - kevin - done
bvmhost-x86-06.iad2.fedoraproject.org - kevin - done
bvmhost-x86-07.iad2.fedoraproject.org - kevin - done
bvmhost-p09-01.iad2.fedoraproject.org - kevin - done
bvmhost-p09-02.iad2.fedoraproject.org - kevin - done
bvmhost-p09-03.iad2.fedoraproject.org - kevin - done
bvmhost-p09-04.iad2.fedoraproject.org - kevin - done
bvmhost-p09-05.iad2.fedoraproject.org - kevin - done
bvmhost-s390x-01.s390.fedoraproject.org - needs upgrade to f41 - upgraded - kevin - done

non builders:

bvmhost-x86-01.iad2.fedoraproject.org - kevin - done
bvmhost-x86-02.iad2.fedoraproject.org - kevin - done
bvmhost-x86-03.iad2.fedoraproject.org - kevin - done
bvmhost-x86-04.iad2.fedoraproject.org - kevin - done
bvmhost-x86-05.iad2.fedoraproject.org - kevin - done
vmhost-x86-01.iad2.fedoraproject.org - might reinstall with rhel9 but need to migrate batcave01/bastion01 off while I do - ran out of time
vmhost-x86-02.iad2.fedoraproject.org - might reinstall with rhel9 if time permits - reinstalled with rhel9
vmhost-x86-03.iad2.fedoraproject.org - kevin - done
vmhost-x86-04.iad2.fedoraproject.org - kevin - done
vmhost-x86-05.iad2.fedoraproject.org - kevin - done
vmhost-x86-06.iad2.fedoraproject.org - kevin - done
vmhost-x86-08.iad2.fedoraproject.org - kevin - done
vmhost-x86-cc01.rdu-cc.fedoraproject.org - kevin - done
vmhost-x86-cc03.rdu-cc.fedoraproject.org - kevin - done
proxy3*/40 ( aws ) - kevin - done

[x] enable backups on backup01
[x] enable updates pushed on bodhi-backend01
[x] update status
[ ] unsilence nagios