owned this note
owned this note
Published
Linked with GitHub
# ARCHIVE: TripleO CI Planning meeting Notes - From Mar 2022 - Dec 2022
###### tags: `Meeting`
**History:**
* https://hackmd.io/O0vGx277QDeDWQVhhm66aw
* https://hackmd.io/RzlngcRmR72IJi7hfmVTww
**Gmeet:** meet.google.com/avd-ijsb-ejt
**Etherpad links for PTG**
* https://etherpad.opendev.org/p/antelope_ptg_tripleoci
* https://etherpad.opendev.org/p/tripleo-antelope-topics
## Team meeting pinglist
arxcruz, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, dviroel, rcastillo, jm1, rlandy|ruck, dasm, tengu
:::spoiler Gerrit ids
- amolkahat@gmail.com
- anbanerj@redhat.com
- arxcruz@{redhat|gmail}.com
- bshewale@redhat.com
- chkumar@redhat.com
- marios@redhat.com
- pojadhav@redhat.com
- rlandy@redhat.com
- sandyada@redhat.com
- svyas@redhat.com
- dviroel@redhat.com
- rcastillo@redhat.com
- jmeng@redhat.com
- dsmigiel@redhat.com
- cjeanner@redhat.com
:::
---
## 2022-11-15 TC/UA/PM planning for sprint 71
* RHEL 9.1
* RHOS 18 line (may not be ready)
* New ibm cloud node move
* Deprio not essential 17.1/18 or next gen
---
## 2022-10-25 TC/UA/PM planning for sprint 70
* Tempest EPIC (label - like INFRA)
* dashboard - arx cruz
* skip list toic should be part of epic (card that can be completed in this sprint)
* tempest cleanup ..still not done fully ..occurence of ussuri are remaining - soniya29
* tools for skiplist
* cli for skiplist ...arx and soniya29 needs a discussion
* Designate component
* rhos-18 line standup
* What from tooling needs to come into this sprint?
---
## 2022-10-04 TC/UA/PM planning for sprint 69
* rhos 17.1 rhel-8 -line rework
* possibly rhos-18 branching (probably next sprint)
---
## 2022-09-13 TC/UA/PM planning for sprint 68
* cockpit:
* we need to rethink how to deal with hosed cockpit for rdo stream and downsteam.
* OVB status: https://hackmd.io/ulFAL5DBRoGQB6eUuOpC1Q
* zed branching
* end of this sprint zed release for openstack https://releases.openstack.org/zed/schedule.html * Oct 03 - Oct 07 R+0 Zed release
* tripleo follows usually few weeks later, typically after ptg (October 17-20)
## 2022-08-24 TC/UA/PM planning for sprint 67
* Sandeep:
* Enable config-drive in downstream/c9 upstream
* Config-drive is not mounted in images built via virt-customize
* Also, need to config-drive for BMC node - done
TODO - new epic needs to add
* Ronelle:
* settle on POC for next gen (podified and external
* sandeep will add set of actions done in next sprint
* mixed rhel in downstream?
* 17.1 on rhel-8 component line
* TODO - new epic needs to add
* https://issues.redhat.com/browse/PCTOOLING-350
* how far are we from closing out allow list? can we push to get that completed - soniya?
* sanity check is pending for all fs
* tomorrow we will discuss regarding allow list presentation
* anything else we are close to closing out?
* rhos17.1 mini integration line
* allow list
* dashboard related to particular job (elastic recheck) from arx and ananya
* new vm for d/stream prod cockpit server (ananya and rafael)
* upgrading older vm to centos8 and replace docker with podman compose
* https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-1174
---
## 2022-08-03 TC/UA/PM planning for sprint 66
* OVB
* decouple ovb-manage from secrets
* https://docs.google.com/document/d/14GHgvDWoDpcNQKlQ5pS9My5qDcmhMFyXYUAfXZ2brX0/edit#heading=h.njdvdxedotnf
* investigate OVB stack on a single compute
* Tempest
* skiplist tooling
* skiplist cleanup
* RBAC - check services
* vexxhost resources for next gen
* move of some RDO lines to IBM cloud
## 2022-07-12 tc/ua/pm planning for sprint 65
* component pipeline epic for 17.1
* component/integration line for rhos17.1 on rhel8
* last cut of date for rhos17.0 on rhel8 is 28-July-2022
* dasm
* IBM Cloud - OVB qualifying (?)
* moving OVB to master - need to raise this
---
## 2022-06-21 tc/ua/pm planning for sprint 64
* 17.1 line for internal
---
## 2022-05-31 tc/ua/pm planning for sprint 63
[Sandeep]
* Worth to add dstat.html on overcloud?
* May be by default we disable that but can be overridden.
* https://logserver.rdoproject.org/91/839591/6/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/0b48aa7/logs/undercloud/var/log/extra/dstat.html.gz
* Updates in rhel9 repos didn't came via rhos-release - just complaning here(rhos-release 17 check jobs were not ready too so not completely delivery problem)
[Ronelle]
* Victoria tear down
* V -> W upgrade - We need to be mindful about victoria content-provider jobs during victoria eol.
* 16.2
* 16.2.4 (June)
* base image - container registry login - impact
* OVB
* reparenting open
* switch to c9
* boot mode finish
* SDK line ()
* nftables
* Next gen sync - probably have to look at testing an operator
* what can we deprio?
* Move reinstall job in backlog to priortize podified work
* fips/rbac
* (doug): Ade wants to merge his FIPS change on tripleo-ci, which enables FIPS on lots of jobs; we need to discuss next steps on FIPS jobs.
---
## 2022-05-10 tc/ua/pm planning for sprint 62
* Sandeep
* How to handle skipped-tempest jobs.
* ex: periodic-tripleo-ci-centos-8-standalone-skipped-tempest-train - we added these jobs when we runned skipped tests instead of whitelist tempest tests - Do we still need them?
* https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/tempest-skiplist-jobs.yaml
* to-do:-
* Remove from line intially
* Fix job/move to c9
* Come up with process - how to handle these jobs before adding them.
* Ronelle
* start tooling work for mixed rhel mode
* downstream registry move - bring this into active work
* collections - getting some focus for next two sprints - then will reassess
* Investigation - podifed control plane
* Podified Control Plane Weekly Sync meeting each Tuesday
---
## 2022-04-19 tc/ua/pm planning for sprint 61
* Sandeep:
* Request from marios to discuss below in planning mtg.
* https://review.rdoproject.org/r/c/rdo-jobs/+/41831/7#message-ef962cc7aafb377a786c37e30d004ec5e52ea5e2
* Doug shared possible improvement request from Cix.
* https://trello.com/c/YHL8MOrx/2454-cixlp1968615tripleociproa-tripleo-ci-centos-9-standalone-on-multinode-ipa-is-failing-ping-test
* https://bugs.launchpad.net/tripleo/+bug/1968615/
~~~
@card Please fix this validation task, name is "Check DNS works" so it should not even try ICMP! Also, more closer to customer scenarios would be CI using Validations for pre-flight checks.
~~~
* Change base image for 16.2
* https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/400128/3#message-e9e50f76d2b7cb8085e417dd7ce668314d739e0e
* Change DNS for downstream/remove hardcoding if possible
* Context: https://trello.com/c/MFE54n8b/2466-cixbz2076756osp17rhel9rhel9-osp17-ovb-jobs-failing-overcloud-deployment-at-ntp-sync-stage
~~~
<apevec> ysandeep (IRC): still using PHX2 (which is effectively gone) nameserver in PSI RDU2 is wrong, I'd like to understand why was that, is it set manually somewhere in OVB config?
<ysandeep> apevec, looks like we have hardcoded it: https://sf.hosted.upshift.rdu2.redhat.com/codesearch/?q=10.5.30.160
<ysandeep> apevec, 10.11.5.19 is the correct one, right?
<apevec> that's what neutron dhcp gives on one VM I checked
<apevec> it should not be hardcoded, IT could change nameservers
<apevec> nameserver 10.11.5.19
<apevec> nameserver 10.11.142.1
~~~
* mixed rhel mode
* teardown c7 train
* ansible collection
---
## 2022-03-29 tc/ua/pm planning for sprint 60
* Complete reparenting and c8 tear down
* Some monitoring for tool-box, Tool-box feed our dashboard.
* Baremetal jobs
* https://hackmd.io/vYnX-UFsRlWuTUaDD7tIbw
* Update coverage against rhos-release
* How is 2 person ruck/rover going? (consider a revote here?)
* PTG - mixed rhel mode (depends on PTG discussion)
* Registry move (moved up)
* OVB/libvirt/baremetal and boot modes - work out the supported test matrix
* does git pull work for dashboard (add task on board)
* freeze graph (reparenting) investigation
* redeploy overcloud on standalone
* Ceph:
* OVB ceph job
* Ceph daemon promotion pipeline
---
## 2022-03-08 tc/ua/pm planning for sprint 59
* Reparenting
* Downstream resource constraint
* If its going to take long to get more resources - we need to find some alternative:-
* Not run components line if no new content
* run 16.2 / 17 - on rhel8 on alternate days
* Run 17 on 9 daily
* Run 16.2/17 on rhel8 on alternate days
* 16.2 component line - 4 times per week
* Integration line run next day to component line run
* Integration line - 3 times a week
* 17 on rhel-8 - 3 times
* Integration line run next day to component line run
* Cut back on lines to run/watch and our load in general
* ussuri/victoria to three days a week
* ussuri EOL & teardown
* openstack regular
* 3rd party/rdo recheck options ('check-rdo'?)
* centos9 branchful jobs e.g. tripleo-ci-centos-9-containers-multinode-wallaby
* remove ci.centos - have one train, wallaby, master virt job elsewhere (PSI - node bug enough)
* train c7
* rethink relationship/commitment to RDO
* ffu upgrade job periodic version
* 822716: Add undercloud-ffu-wallaby job. | https://review.opendev.org/c/openstack/tripleo-ci/+/822716
* PTG planning
* April 4-8, 2022 - pls sign up
* https://hackmd.io/s9hZvlP-SKuR4fkE3kL8NA
* osp 18 planning - mixed mode rhel (decoupling)
* New Openstack deployment ci job - Network/vip/baremetal provisioning/ deployment in 1 step - **Can bring this in next sprint**.
---
## 2022-11-17 Unified Sprint 71 Planning
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
pojadhav, rlandy, marios, arxcruz, ananya, soniya29, ysandeep, bhagyashris,
:watch: (target +0:00) +0:04
### Team availability and PTO plans
#### Sprint team members Nov 17 to Dec 07
(it's 14 days - $your_PTO_day)
1. rlandy: 13 - Thanksgiving (24, 25) but will be here on Thursday
2. marios: 13 (will take one day pto tbd)
3. chandan:
4. Amol: 11 - PTO (3 Days)
5. Bhagyashri: 14 days
6. Pooja: 14
7. Sandeep: 14
8. Soniya: 8 (PTO from 29 Nov to 15 Dec)
9. arxcruz: 12
10. Ananya: 14
11. Douglas: 14 (out during Brazil matches on world cup :-))
12. Rafael: 13 days (holiday on the 21st)
13. Dariusz: 12 days (Thanksgiving: 11/24 - 11/25)
14. Jakob: 11 days (2022-11-25 PTO, 2022-11-28 PTO, 2022-12-05 PTO, 2022-12-08 PTO)
### Team availability at END OF THE YEAR SHUT DOWN (start date - end date)
1. rlandy: Dec 22 - Jan 2
2. marios: out Dec 26-30 at least (possibly/likely also following week)
3. chandan:
4. Amol: No plans yet.
5. Bhagyashri: No plans so far (2nd Jan holiday in India)
6. Pooja: Dec 22 - not decided yet
7. Sandeep: Out - 19th Dec to 23rd Dec
8. Soniya: Dec 22 - Jan 2
9. arxcruz: Dec 5 - Jan 1
10. Ananya: 25 Dec to 1 Jan
11. Douglas: no pto
12. Rafael: PTO week of the 19th
13. Dariusz: Company Shutdown: 12/23/22 - 01/02/23
14. Jakob: 2022-12-08 PTO, 2022-12-19 until EOY PTO, 3 additional days of PTO not decided yet
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
### Community call new time
* 1500 UTC - 20.30 IST (new time) - final call
* doug: i can check with ade/dougM to move Fips meeting (next week, both are on pto)
### Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-
18th Nov - 24th Nov | sandeep | ronelle
25th Nov - 1st Dec | pooja | ananya
2nd Dec - 8th Dec | marios | ronelle
9th Dec - 15th Dec | chandan | doug
16th Dec - 22nd Dec | amol | pooja
23rd Dec - 30th Dec | bhagyashri | sandeep
> next retrospective : Amol
:watch: (target: +0:15) +
### Ideas for improvement to sprint process
* card : Ansible-2.14 release broke the CI, Thank you Marios, ruck/rover for fixing that
* Action item : We decided not to do anything as we don't have next compose in advance for testing,
* card : quantity over quality promotions
* Action item :
* Not focusing on root cause for intermittent issues?
* Need more concrete examples.
* We improved a lot with ovb.
* Need more conversations later.
* tempest revisit - intermitent failures
* card : infra changes
* Action item :
* Q. Should we move our tools to OpenShift infra?
* Q. More team members helping on Infra side?
* Q. Re scope - divide in smaller tasks?
* Q. Make changes more testable.
* card : Balancing all the work asked of us - without having everyon run screaming
* Action item :
* Prioritize / de-prioritize
* ex. Should we add new component while a lot going on for Next Gen Initiative.
* TC/UA/PM decide priority for the team.
* card : Prow
* Action item :
* Limitation on what prow can provide us.
* Workarounds to do things for openstack operator.
* card : time zone changes
* Action item :
* Took 2 weeks to decide mtg timing.
* Make our meetings Async
* Make team meeting's time comfortable for everyone
* Standup should be quick, do we need longer mtgs?
* Difference in opinion
* Revisit what is scrum? Action Item.
### New topics or demos or education for community call
* [jm1]: How to deploy your own infra staging env
### New work item discovered by the team
* RHEL 9.1
* RHOS 18 line (may not be ready)
* New ibm cloud node move
* Deprio not essential 17.1/18 or next gen
### Words from PM (Ronelle/Chandan)
*
### Words from UA (Dariusz Smigiel)
*
:watch: (target: +1:00) +00:47
### Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
### Priority for this sprint on board
* RHEL 9.1
### General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-10-27 Unified Sprint 70 Planning
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
arxcruz, chandan, marios, jm1, dasm, akahat, ananya, rlandy, dviroel, soniya29
:watch: (target +0:00) +0:04
### Team availability and PTO plans
#### Sprint team members Oct 27 to Nov 16
(it's 14 days - $your_PTO_day)
1. rlandy: next gen plus one day
2. marios: 13 days (out 28th October) & ruck 1 week
3. chandan: 8 days (next gen meetup (7 -11), travelling on 4th)
4. Amol: 14 Days
5. Bhagyashri:
6. Pooja:
7. Sandeep:
8. Soniya: 13 days(1 pto on 10 nov )
9. arxcruz: 14 days
10. Ananya: 13 (holiday on 1 Nov)
11. Douglas: 12 (holidays on Nov 2nd, Nov 15th)
12. Rafael: 12 days (PTO on 28th and holiday on the 2nd)
13. Dariusz: 14 days
14. Jakob: 12 days (2022-10-31 PTO, 2022-11-01 public holiday)
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
### Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-
28th Oct - 3rd Nov | arx | doug
4th Nov - 10th Nov | marios | rafael
11th Nov - 17th Nov | soniya | amol
> next retrospective : ~~Sandeep Yadav~~ skipped
:watch: (target: +0:15) +
### Ideas for improvement to sprint process
* Scrum improvements
* blocked column - not there yet
* story not each card (marios: imo cant generalise this)
* Retro on scrum itself
### New topics or demos or education for community call
* Infra - testing in stage tenant
* Intro to podified and external compute
* setting up an operator
### New work item discovered by the team
* Tempest EPIC (label - like INFRA)
* ~~dashboard - arx cruz~~
* skip list topic should be part of epic (card that can be completed in this sprint)
* ~~tempest cleanup ..still not done fully ..occurence of ussuri are remaining - soniya29~~
* tools for skiplist
* cli for skiplist ...arx and soniya29 needs a discussion
* ~~Designate component (ananya) - current~~
* ~~rhos-18 line standup (delay for next sprint)~~
* ~~What from tooling needs to come into this sprint?~~
* ~~retiring rdo registry (dpawlik requests) - current~~
* check promoter
* get rid of ("centos") push jobs
* make sure nothing else is using it
* remove options/variables that reference rdo registry
* PTG work items: https://hackmd.io/v95AHalOTOuoC37nB8ijFQ?view
* Just adding OVB items now (current)
* Explore running component promote pipelines jobs from vm to pods via zuul (backlog)
* nice idea
* zed is coming (probably? [rhos-dev] TripleO Zed Branching and Release Upstream )
### Words from PM (Ronelle/Chandan)
*
### Words from UA (Dariusz Smigiel)
*
:watch: (target: +1:00) +00:47
### Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
### Priority for this sprint on board
### General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-08-08 Unified Sprint 69 Planning
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
pojadhav, arxcruz, bhagyashris, rcastillo, soniya29, ysandeep, rlandy, dasm
:watch: (target +0:00) +0:04
### Team availability and PTO plans
#### Sprint team members Oct 07 to Oct 26
(it's 14 days - $your_PTO_day)
1. rlandy: 10 days (out 10-11 Oct, 17-18th Oct)
2. marios: 14 days (out 28th/next sprint)
3. chandan: 13 days (Might swap public holidays)
4. Amol:
5. Bhagyashri: 11 days (24, 25 oct Holiday in India [Diwali]) (PTO- 26 oct to 1st Nov)
6. Pooja: 11 days (24,25 oct holiday, 26 to 28 oct PTO diwali festival)
7. Sandeep: 10 days (19th Oct, Out - 24th Oct to 28th Oct Week(24/25 is public holiday )
8. Soniya: 24,25 oct holiday diwali
9. arxcruz:
10. Ananya:
11. Douglas: 13 days (holiday on oct 12th)
12. Rafael: 14 days
13. Dariusz: 14 days
14. Jakob: 13 days (pto on 2022-10-24)
PTG schedule: https://etherpad.opendev.org/p/tripleo-antelope-topics
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
### Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-
7th Oct - 13th Oct | jakob | arx
14th Oct - 20th Oct | bhagyashri | ananya
21st Oct - 27th Oct | marios | rafael
> next retrospective : ~~Sandeep Yadav~~ skipped
:watch: (target: +0:15) +
### Ideas for improvement to sprint process
* finish discussion around sprint process/scrum
* watching third party check jobs
*
### New topics or demos or education for community call
* rhos 17 8-9 and 9-8 jobs
* zed strategy for collections
### New work item discovered by the team
* rhos 17.1 rhel-8 -line rework (mixed os job?)
* possibly rhos-18 branching (probably next sprint)
* need a registry (quay) for podified work - sandeep
* TO Do (rafael) - Try deployment using tripleo-quickstart on master on centos8 , 9 and rhel8 and 9...
Yatin have some workarounds in his local forks, His changes are not complete but a good starting point.
~~~
* We requires custom appliance https://download.libguestfs.org/binaries/appliance/appliance-1.46.0.tar.xz
* https://github.com/karelyatin/tripleo-quickstart and
* https://github.com/karelyatin/tripleo-quickstart-extras
~~~
### Words from PM (Ronelle/Chandan)
### Words from UA (Dariusz Smigiel)
:watch: (target: +1:00) +00:47
### Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
### Priority for this sprint on board
### General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-08-08 Unified Sprint 68 Planning
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
marios, rlandy, bhagyashris, soniya29, jm1,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members Sep 15 to Oct 5
(it's 14 days - $your_PTO_day -1 day of learning Fri 16th)
1. rlandy: 10 (out Sep 26-27, Oct 5)
2. marios: 13
3. chandan:
4. Amol:
5. Bhagyashri: 13 (Oct 5th - National holiday in India)
6. Pooja: 12 (19 Sep PTO and 5 Oct holiday)
7. Sandeep:
8. Soniya: 10 (5 oct + 3 PTO[not sure])
9. arxcruz:
10. Ananya: 13 (Holiday Oct 3)
11. Douglas: 9 (pto from sep 19th - 23th)
12. Rafael: 12 - Holiday on the 16th, PTO on 30th
13. Dariusz: 14
14. Jakob: 13 (day of german unity at 2022-10-03, subject to change)
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
16th Sept - 22nd Sept | amol | ronelle
23rd Sept - 29th sept | marios | ananya
30th Sept - 6th Oct | soniya | rafael
> next retrospective : Jakob Meng
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
* submit "review" topic to Community Meeting up for a discussion
* RR person needs to report every Monday/Thursday
* include info by default about CS8 jobs and their condition wrt IBM cloud performance ?
* Chandan gather info where to submit a bug report wrt IBM clouds issues
* OVB task to investigate intermittent issues
* let's meet as a team and discuss what we want to do with our workflow
* we have to start tracking stories at OSP board level. (Marios asked for anyone who is interested to contact him) marios working here for this coming cycle
* Ronelle to create/separate/convert a new HackMD account. The old one is connected to Wes. We might need to move all the content between accounts.
* Ananya to move the content between HackMD accounts.
* TC/UA are gonna prepare RR schedule for the next year, accomodating tenure in the Team
## New topics or demos or education for community call
* how we want to handle our scrum (marios)
* automation hackmd (jakob)
## New work item discovered by the team
* cockpit:
* we need to rethink how to deal with hosed cockpit for rdo stream and downsteam.
* OVB status: https://hackmd.io/ulFAL5DBRoGQB6eUuOpC1Q
* zed branching
* end of this sprint zed release for openstack https://releases.openstack.org/zed/schedule.html * Oct 03 - Oct 07 R+0 Zed release
* tripleo follows usually few weeks later, typically after ptg (October 17-20)
## Words from PM (Ronelle/Chandan)
## Words from UA (Dariusz Smigiel)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-08-08 Unified Sprint 67 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
rlandy, dasm, pojadhav, arxcruz, jm1, ananya, rcastillo, bhagyashris,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members Aug 25 to Sept 14
(it's 14 days - $your_PTO_days)
1. rlandy: 13 (labor day - Monday 5)
2. marios:
3. chandan:
4. Amol:
5. Bhagyashri: 12 - (31st aug public holiday, 1 PTO)
6. Pooja: 13 - 31 aug public holiday
7. Sandeep: 12(31st Aug - public holiday, 1 PTO - Friday(date - tbd))
8. Soniya: 13
9. arxcruz: i guess all days
10. Ananya: 8 (out from 29 Aug to 2 Sept)
11. Douglas: 13 (holiday on sept 7th)
12. Rafael: 14 days
13. Dariusz: 13 days (Labor Day - Monday)
14. Jakob: all days
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
* 26th Aug - 01st Sept | pooja | jakob
* 02nd Sept - 08th Sept | chandan | arx
* 09th Sept- 15th Sept | bhagyashris | jakob
> next retrospective : Dariusz Smigiel
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVPdFzXJI=/?share_link_id=393312271722
* shorter scrum meetings
* PM guy to talk with us (rlandy AI)
* Summary on long running CI Degraded cards.
* What's the issue, what has been done, where we go next (if possible)? Remove yourself from card when you are done RR.
* provide improvements to mitigate general CI issues
* infra as code, e.g. deployment script for the tools running on psi
+ [automate all the things](https://raw.githubusercontent.com/RogueDudes/roguedudes.github.io/master/assets/images/automate.jpg)
* take notes during meetings for later reference
* recording of community meetings (knowledge sharing sessions)
* areas of responsibility assigned to team members
* list of all the tools we have, and where they are
* confluence doc
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* how to do reviews and how we can improve (discussion)
* tempest allow list
* tooling/responsibility/documentation
## New work item discovered by the team
* Sandeep:
* Enable config-drive in downstream/c9 upstream
* Config-drive is not mounted in images built via virt-customize
* Also, need to config-drive for BMC node
* Ronelle:
* settle on POC for next gen (podified and external
* mixed rhel in downstream?
* 17.1 on rhel-8 component line
* https://issues.redhat.com/browse/PCTOOLING-350
* how far are we from closing out allow list? can we push to get that completed - soniya?
* sanity check is pending for all fs
* anything else we are close to closing out?
* rhos17.1 mini integration line
* allow list
* dashboard related to particular job (elastic recheck) from arx and ananya
* new vm for d/stream prod cockpit server (ananya and rafael)
* upgrading older vm to centos8 and replace docker with podman compose
* https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&projectKey=TRIPLEOCI&view=detail&selectedIssue=TRIPLEOCI-1174
## Words from PM (Ronelle/Chandan)
## Words from UA (Dariusz Smigiel)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
---
## 2022-08-08 Unified Sprint 66 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
marios, pojadhav, ananya, akahat, arxcruz, dasm, rlandy, chandan, dviroel
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members Aug 04 to Aug 24
(it's 13 days - $your_PTO_days - $Recharge day[12 Aug])
1. rlandy: 7 days - out Aug 14-18(19) and Aug 12
2. marios: 11 days (out 22Aug to 05 sep)
3. chandan: 13 (will swap holidays to other days)
4. Amol: 11 Days ( 2 Days out Not yet fixed)
5. Bhagyashri: 12 Aug - recharge day, 15 Aug - India independence day (might take one day PTO)
6. Pooja: 12 (17 aug PTO and 15 aug holiday and 12 aug recharge day)
7. Sandeep: 11 (12 Aug - recharge day, 15 Aug - India)
8. Soniya: 12 Aug + 15 Aug + 1/2 pto
9. arxcruz: 12
10. Ananya: 12
11. Douglas: 12 days (recharge aug 12th)
12. Rafael:
13. Dariusz: 10 days (2022-08-10 - 2022-08-11 PTO, recharge 2022-08-12)
14. Jakob: 7 (5 days PTO from 2022-08-15 to 2022-08-19, recharge day 2022-08-12)
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
* 05th Aug - 11th Aug | pooja | marios
* 12th Aug - 18th Aug | sandeep | rafael
* 19th Aug - 25th Aug | soniya | doug
> next retrospective : Rafael
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOhg1boY=/
* script to post automated testprojects if job has green history?
* explicit testing on each repo? we've spoken about checklists before
* how we do reviews and how we can improve them (refer to mails from jakob, marios and sandeep)
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* how to do reviews and how we can improve (discussion)
## New work item discovered by the team
* OVB
* decouple ovb-manage from secrets
* https://docs.google.com/document/d/14GHgvDWoDpcNQKlQ5pS9My5qDcmhMFyXYUAfXZ2brX0/edit#heading=h.njdvdxedotnf
* investigate OVB stack on a single compute
* Tempest
* skiplist tooling
* skiplist cleanup
* RBAC - check services
* vexxhost resources for next gen
* move of some RDO lines to IBM cloud
* 17.0 on rhel-8 to 17.1
* TO Do: add baremetal job card
## Words from PM (Ronelle/Chandan)
## Words from UA (Dariusz Smigiel)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
---
## 2022-07-14 Unified Sprint 65 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:** dasm, pojadhav, rlandy, arxcruz, ananya, rcastillo, chandan, marios, bhagyashris, akahat,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members July 14 to Aug 03
(it's 13 days - $your_PTO_days)
1. rlandy: 12 days (maybe 8) (21st will be out some time) Taking few days either this sprint or next - will update
2. marios: 12 days (out 22 Jul)
3. chandan: 13 days
4. Amol: 13 Days
5. Bhagyashri: 12 days (Might take one PTO)
6. Pooja:
7. Sandeep:10-13 (Might take PTO in Aug first week - not confirmed that)
8. Soniya:
9. arxcruz: 12, (Daugther is on vacation)
10. Ananya: 13
11. Douglas: 13
12. Rafael: 11 days, out on the 19th and 20th
13. Dariusz: 6 days, Ruck/Rover 5 days, 27-28 PTO
14. Jakob: 10-13 days ~~(might take PTO from 2022-07-26 to 2022-07-28)~~
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
05th Aug - 11th Aug | pooja | marios
12th Aug - 18th Aug | sandeep | rafael
19th Aug - 25th Aug | soniya | doug
> next retrospective : Rafael
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOrEN2ZU=/
* skiplist automation -- remove skipped tests with minimum human intervention
* ruck/rover pain points - knowledge sharing
* Updating the known failure patterns in ci health queries
* Put the reviewbot code in our repos
* We can have something like reviewbot for tempest reviews as well.
* Check which ci tools are missing/incomplete documentation
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* how to access/hold the node - sandeep - DONE
* How repos/mirrors are synced - chandan (will come up with flow diagram)
* Presentation about work on UEFI/PXE boot by dasm? (dasm, feel free to delete this line)
## New work items discovered by team
* component pipeline epic for 17.1 - to do
* component/integration line for rhos17.1 on rhel8
* last cut of date for rhos17.0 on rhel8 is 28-July-2022
* IBM Cloud - OVB qualifying
* As fs035 job is not doing great(most of the time after multiple tp it still fails then we remove the job from criteria, then promote it), So Can we split fs035 into standalone job ? - to do (add on sprint board)
* vaxxhost update - todo add card on board
## Words from PM (Ronelle/Chandan)
* rhos17.1, vex host update and IBM cloud
## Words from UA (Sandeep Yadav)
* Cedric - nftables - still need more work for ipv6
* Content-provider - rpm verify
* https://review.opendev.org/c/openstack/tripleo-heat-templates/+/845569
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-06-23 Unified Sprint 64 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:** dasm, pojadhav, rlandy, arxcruz, ananya
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members June 23 to July 13
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 12 - maybe 11 (July 4th - depends on when nephew returns from camp and I have to pick him up)
2. marios:
3. chandan: 10 days (will take ptos)
4. Amol: 11 days (2 Days PTO 7-8 July)
5. Bhagyashri: 12 days (one day PTO not yet fix)
6. Pooja: 9 (may be 4 days PTOs date not fixed yet)
7. Sandeep: 11 (Out on Jun 28th and 29th)
8. Soniya: 8 -(July 4th to July 8)
9. arxcruz: 12 (i'll take pto)
10. Ananya: 11 (out on 24 June and 8 July)
11. Douglas: 13
12. Rafael: 13
13. Dariusz: 12 (4th of July off)
14. Jakob: 13
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
27th June - 01st July | Amol | Jakob
01st July - 07th July | Sandeep | Rafael
08th July - 14th July | soniya | Doug
> next retrospective : Soniya
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOrEN2ZU=/
* people should take the review time to present your changes / lead calls
* rotate the lead for review calls
* Some place to put work notes eg the source, gitlab (must be behind VPN)
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* how to access/hold the node - sandeep
* tempest skiplist clean up - akahat
* may be we can discuss about improvement in the rr
* tooling and process
* operator/openshift testing
## New work items discovered by team
- Team meeting face to face ?
- Location
- Europe: Brno <3
- +1: arxcruz, chandan, akahat, soniya, pooja, sandeep, bhagyashris, rcastillo, doug,
- -1:
- USA
- +1: jm1, chandan, ananya, (depends on visa), arxcruz, bhagyashris (already have visa), soniya, sandeep, pooja, rcastillo, doug,
- -1:
- APAC (Singapore, Malaysia, HongKong, Japan?)
- +1: jm1, ananya,
- -1:
- UK (brexit might be a problem for visa)
- +1: ananya, chandan, soniya, sandeep, pooja
- -1:
- Collect logs collect info for cibyl
- 17.1 line:
- July 6th - stop imports to 17.0. All the stuff needs to be in. Promoted Wallaby line.
- DLRN opens imports to 17.1. Everything what's running downstream needs to be reevaluated to make capacity for 17.1
- https://issues.redhat.com/browse/PLTSOCP-2958 (Downstream registry alternative)
- images.paas.redhat.com
## Words from PM (Ronelle/Chandan)
## Words from UA (Sandeep Yadav)
* Takashi enabled heat/Horizon on tripleo-ci jobs
* https://review.opendev.org/q/topic:tripleo-ci-coverage
* Heat functional tests still requires work in os_tempest, takashi requested if tripleo-ci team
* We can pass this info to Eliad, he wanted to integrate for horizontal functional testing
* eliad is aware(ysandeep)
* ack!
*
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
## 2022-06-02 Unified Sprint 63 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:** chandan, pojadhav, ananya, bhagyashris, marios, rlandy, rcastillo, akahat, jakob,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members June 02 to Jun 22
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 12 (out Monday June 6)
2. marios: 11 (2 days out , 13th June public holiday & 1 other day tbd)
3. chandan: 11 (2 days out Jun 9, 10)
4. Amol: 13 Days
5. Bhagyashri: 13 days (No plan yet)
6. Pooja: 13 days
7. Sandeep: 11 (2 days out tbd)
8. Soniya:
9. arxcruz: 8 (holiday and summit)
10. Ananya: 12 (holiday on 6 Ju6ne)
11. Douglas: 12 (holiday on 16th)
12. Rafael: 13 days
13. Dariusz:
14. Jakob: 3 (vacation from 6th June to 17th June)
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
06th June -10th June | chandan | dariusz
13th June - 17th June | soniya | chandan
20th June - 24th June | pooja | arx
> next retrospective : Doug
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOwJcWJE=/
* need to consider victoria EOL vs wallaby upgrade jobs (ffu undercloud, & ?)
* dstat capture on overcloud nodes(ovb) - so we know perf situation there. - keep this in backlogs
* when bhagyashris is ruck|rover someone else must run the scrum/other calls
* do we want to change TC/UA
* [Responsibilities doc]( https://docs.google.com/document/d/1Mxs2RCljg-iC9np8azmmqv6Vf4a3DiE08E4actMT4yg/edit)
* change/rotate UA/TC
* +1:
* -1:
* volunters name:
* TC: pooja,
* UA: soniya
* tempest UA/TC:
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* [arx/chandan] tempest debug KT/demo - Done
* CI - openstack ansible module - Done
* how to access/hold the node - sandeep
* may be we can discuss about improvement in the rr
* tooling and process
* operator/openshift testing
## New work items discovered by team
[Sandeep]
* Worth to add dstat.html on overcloud? - keep this in backlogs
* May be by default we disable that but can be overridden.
* https://logserver.rdoproject.org/91/839591/6/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/0b48aa7/logs/undercloud/var/log/extra/dstat.html.gz
* Updates in rhel9 repos didn't came via rhos-release - just complaning here(rhos-release 17 check jobs were not ready too so not completely delivery problem)
[Ronelle]
* Victoria tear down
* V -> W upgrade - We need to be mindful about victoria content-provider jobs during victoria eol.
* 16.2
* 16.2.4 (June)
* base image - container registry login - impact
* OVB
* reparenting open
* switch to c9
* boot mode finish
* nftables
* Next gen sync - probably have to look at testing an operator
* what can we deprio?
* (ysandeep)Move reinstall job in backlog to priortize podified work
* fips/rbac
* (doug): Ade wants to merge his FIPS change on tripleo-ci, which enables FIPS on lots of jobs; we need to discuss next steps on FIPS jobs.
[Rafael/Jakob/Arx?]
* [TripleO (CI) and OpenStack SDK 1.0.0 / Ansible OpenStack collection 2.0.0](https://hackmd.io/tTRxGEqrTQWZGQsVteYIqQ)
## Words from PM (Ronelle/Chandan)
## Words from UA (Sandeep Yadav)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
### 2022-05-21 Unified Sprint 62 Planning
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
marios, chandan, arxcruz, akahat, ananya, dviroel, rlandy, dasm
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members May 12 to Jun 01
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 11 ( Recharge + memorial day)
2. marios: 12
3. chandan: 11 (May 26, 27 )
4. Amol: 12
5. Bhagyashri: 11 Days - May be 19th May PTO (20th May- Recharge day)
6. Pooja:
7. Sandeep: 12 (recharge day May 20th)
8. Soniya:
9. arxcruz: 12
10. Ananya: 13
11. Douglas: 12 (recharge day May 20th)
12. Rafael: 12 days
13. Dariusz: 10 (05/20, 05/30, 06/01)
14. Jakob:
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
16th May - 20th May | Sandeep | Jakob
23rd May - 27th May | Sandeep | Marios
30th May - 03 June | bhagyashri | ananya
> next retrospective : Pooja
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVO76qmI8=/
* Elastic Recheck
* sync between Ronelle, Dariusz, Amy and Ananya to decide who would maintain ER
* we can use ansible test for openstack collections
* Run ovb jobs in downstream - may be via testproject - make sure if nodeset are available, ipxe-uefi image available. - chandan
* Skiplist monitoring and cleanup - not promoting stable branches with skips
* keep separate meeting/sync
* Make sure everyone has access to vexxhost or other places
* add marios, sandeep and dasm
* anonymous suggestion ideas for improvement/pain whatever
* https://freesuggestionbox.com/pub/jbkgsun
* create suggestion box as above ^ for tripleo ci and keep the credentials in the bitwarden
* cons:
* it's external
* bring it up in the next retro
* https://source.redhat.com/groups/public/gss-lab-admin/admin_support_infrastructure_services_wiki/suggestion_box_use_cases
* The master container push quay job is running in the integration line, do we want to remove the push job for trunk.rdoproj ?
* improvement in thr rr
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* [arx/chandan/soniya] tempest debug KT/demo
* CI - openstack ansible module
* how to access/hold the node - sandeep
* may be we can discuss about improvement in the rr
* tooling and process
## New work items discovered by team
* Sandeep
* How to handle skipped-tempest jobs.
* ex: periodic-tripleo-ci-centos-8-standalone-skipped-tempest-train - we added these jobs when we runned skipped tests instead of whitelist tempest tests - Do we still need them?
* https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/tempest-skiplist-jobs.yaml
* to-do:-
* Remove from line intially
* Fix job/move to c9
* Come up with process - how to handle these jobs before adding them.
* Ronelle
* start tooling work for mixed rhel mode
* downstream registry move - bring this into active work
* collections - getting some focus for next two sprints - then will reassess
* Investigation - podifed control plane
* Podified Control Plane Weekly Sync meeting each Tuesday
* marios: removal of victoria standalone/undercloud upgrade jobs. & victoria EOL
## Words from PM (Ronelle/Chandan)
* FYI: - Next gen initiative:
* Director Operator GA
* Multi-RHEL version decoupling
* Podified Control Plane
* Compute Tier Adoption
* External Compute Management
* Unified Observability
## Words from UA (Sandeep Yadav)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
* reparenting
* collections
* clean up (eg remaining ussuri stuff)
* mixed rhel mode
* elastic recheck
* podified control plane
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
# 2022-04-21 Unified Sprint 61 Planning
**Sprint dates: Thu 2022-04-21 - Wed 2022-05-11**
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:** chandan, akahat, marios, rlandy, rcastillo, jakob, dasm, pojadhav
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members April 21 to May 11
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 13 days
2. marios: 10 days (22/25 apr easter & 1 more day out)
3. chandan: 12 days (3rd May)
4. Amol: 12 Days (2 may holidy)
5. Bhagyashri: 12 (2nd may holiday in India)
6. Pooja: 11 (2 may pto and 3 may holiday)
7. Sandeep: 11 (28th April - PTO, 03rd may Public holiday)
8. Soniya:
9. arxcruz: 13
10. Ananya: 13 (might take half day off on 6 May)
11. Douglas:
12. Rafael: 13 days
13. Dariusz: 13 days
14. Jakob: 13 days
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
25th Apr - 29th Apr | Bhagyashri | Doug
2nd May - 6th May | Soniya | Marios
09th May - 13th May | Sandeep | Dasm
> next retrospective : Pooja
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVO76qmI8=/
* reparenting stuff - will discuss in the separate meeting (multi parenting)
* When removing jobs from promoter criteria, have a bug or root cause analysis
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* [arx/chandan/soniya] tempest debug KT/demo
* CI - openstack ansible module
## New work items discovered by team
* Sandeep:
* Request from marios to discuss below in planning mtg.
* https://review.rdoproject.org/r/c/rdo-jobs/+/41831/7#message-ef962cc7aafb377a786c37e30d004ec5e52ea5e2
* Doug shared possible improvement request from Cix.
* https://trello.com/c/YHL8MOrx/2454-cixlp1968615tripleociproa-tripleo-ci-centos-9-standalone-on-multinode-ipa-is-failing-ping-test
* https://bugs.launchpad.net/tripleo/+bug/1968615/
~~~
@card Please fix this validation task, name is "Check DNS works" so it should not even try ICMP! Also, more closer to customer scenarios would be CI using Validations for pre-flight checks.
~~~
* Change base image for 16.2
* https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/400128/3#message-e9e50f76d2b7cb8085e417dd7ce668314d739e0e
* Change DNS for downstream/remove hardcoding if possible
* Context: https://trello.com/c/MFE54n8b/2466-cixbz2076756osp17rhel9rhel9-osp17-ovb-jobs-failing-overcloud-deployment-at-ntp-sync-stage
~~~
<apevec> ysandeep (IRC): still using PHX2 (which is effectively gone) nameserver in PSI RDU2 is wrong, I'd like to understand why was that, is it set manually somewhere in OVB config?
<ysandeep> apevec, looks like we have hardcoded it: https://sf.hosted.upshift.rdu2.redhat.com/codesearch/?q=10.5.30.160
<ysandeep> apevec, 10.11.5.19 is the correct one, right?
<apevec> that's what neutron dhcp gives on one VM I checked
<apevec> it should not be hardcoded, IT could change nameservers
<apevec> nameserver 10.11.5.19
<apevec> nameserver 10.11.142.1
~~~
* mixed rhel mode - may be next sprint
* teardown c7 train
* ansible collection
* Removing CentOS-8 usage from master jobs (c8 RDO master packages going away) eg molecule jobs in tripleo-ansible
* https://review.opendev.org/c/openstack/tripleo-ansible/+/838809
## Words from PM (Ronelle/Chandan)
* finish - clean up and reparenting
* start - investigation on new items - container native etc
* chandan
* take a look at dependency pipeline
*
## Words from UA (Sandeep Yadav)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
*
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
# 2022-03-31 Unified Sprint 60 Planning
**Sprint dates: Thu 2022-03-31 - Wed 2022-04-20**
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:** pojadhav, bhagyashris, marios, dviroel, rcastillo, rlandy, jakob,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members Mar 31 to April 20
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 7.5 days - out afternoon of April 14th to 22nd
2. marios: 13 days
3. chandan:
4. Amol:
5. Bhagyashri: 12 days (not planned yet) (15th april holiday)
6. Pooja: 11 (15th april- holiday and 1 PTO (if needed))
7. Sandeep: 8(out - 11th to 15th April)
8. Soniya:
9. arxcruz:
10. Ananya:
11. Douglas: 12 (holiday on april 15th)
12. Rafael: 12 days (holiday on april 15th)
13. Dariusz: 13
14. Jakob: 11 days (holiday on 15th april and 18th april)
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
04th Apr - 08th Apr | Amol | Dasm
11th Apr - 15th Apr | chandan | Jakob
18th Apr - 22nd Apr | Pooja | Rafael
> next retrospective : Chandan
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOBV0kFk=/
* next ruck|rover should join CIX on wednesday
* +1:
* -1:
* Two rr per week - is that working out?
* idea 1 : during release or in case of more work add one more people in the rr shift
* +1: ysandeep, bhagyashris, pojadhav
* -1:
* idea 2: next week rr team should involved if needs or may be the stand by team for current team or (active passive rr)
* +1: dasm, rlandy, marios, dviroel, rcastillo
* -1:
* ruck/rover training again? Helpful to anyone?
* +1: dasm, jakob, rcastillo
* -1:
* **Action Steps**:
* More access and ownership of tools - adding CIX tool owners (IST - chandan/sandeep, marios, rlandy)
* add rr person and hackmd on channel #tripleo and #oooq
* https://review.opendev.org/c/openstack/project-config/+/834199 merged
* reviewebot should be on production server/toolbox
* ruck/rover training
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* [arx/chandan/soniya] tempest debug KT/demo
*
## New work items discovered by team
* Complete reparenting (downstream) and c8 tear down
* freeze graph (reparenting) investigation
* Some monitoring for tool-box, Tool-box feed our dashboard.
* Baremetal jobs
* https://hackmd.io/vYnX-UFsRlWuT
DD7tIbw
* Update coverage against rhos-release
* Registry move (moved up)
* How is 2 person ruck/rover going? (consider a revote here?)
* OVB/libvirt/baremetal and boot modes - work out the supported test matrix
* does git pull work for dashboard (add task on board) - Done
* redeploy overcloud on standalone (e.g. podman collection issues)
* OVB ceph job (add under #849)
* PTG - mixed rhel mode (depends on PTG discussion) - Hold thill PTG discussion
## Words from PM (Ronelle/Chandan)
* RedHat associate survey result
## Words from UA (Sandeep Yadav)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
* reparenting and tear down
* tear down of ussuri
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---
# 2022-03-10 Unified Sprint 59 Planning
**Sprint dates: Thu 2022-03-10 - Wed 2022-03-30**
https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both
* TripleO-CI 2022 planning:
* https://hackmd.io/gONRxsVRTFGw2pZIWLxTPA
**Attendees:**
rlandy, ananya, chandan, marios, bhagyashris, rcastillo,
:watch: (target +0:00) +0:04
## Team availability and PTO plans
### Sprint team members Mar 10 to Mar 30
(it's 13 days - $your_PTO_days) including recharge
1. rlandy: 11 days (off 03/17 and maybe 03/18 or another day)
2. marios: 12 (1 day out, 25th March holiday in Cy.)
3. chandan: Not sure (travelling on 14th, will be in pune from 22nd Mar till 01 Apr)
4. Amol: 8 days (5 days PTO)
5. Bhagyashri: 11 days (may be out for 1 day (22nd march), 18th Match public holday )
6. Pooja: 11 (1 PTO and 18th march public holiday)
7. Sandeep: 10 (18th March public holday, 24th /25th march)
8. Soniya: 13 days
9. arxcruz: 12
10. Ananya: 6 (out on 11, 23-31 March)
11. Douglas: 12 (out on 25th)
12. Rafael: 12 days (holiday on the 21st)
13. Dariusz: 13
14. Jakob: 13
> Total team days (14 days for 11 team members (+2 in RR shift)):
> 11*13 / 143 (100% of total capacity)
## Ruck / Rover
> New ruck / rover:
https://docs.google.com/spreadsheets/d/1-p0MU38u4NAOqNC_fPIgmRfcrCrSftdbf8CLA9K_JuI/edit#gid=1931857401
Dates | Ruck | Rover
-|-|-|
14th Mar - 18th Mar | doug | chandan
21st Mar - 25th Mar | arx | pooja
28th Mar - 01st Apr | amol | chandan
> next retrospective : Bhagyashri
:watch: (target: +0:15) +
## Ideas for improvement to sprint process
> Retrospective cards: https://miro.com/app/board/uXjVOHGVr9E=/
* Use tracker for controlling state of our jobs
* What can we cut from our load?
* Utilize script, like rrcockpit more.
* "shadowing" of more experienced person
* Integration between JIRA and review list
* as we are always keep things similar in upstream/downstream. RHEL-9 integration jobs got added into existing files only. so file is becoming huge. so lets keep rhel-9 integration jobs seperate for better visibility.
* micro learning sessions
**Notes from retro**
* 3 people rr?
* switching RR every week - does it help?
* How to make RR more effective
* Tracking jobs/fix - chat+trello+lp+irc - too many sources to go through
* How to efficiently identify efficiently which service the error is from in tempest debug
* Assign bug to the right team
* Topic for KT?
* Go back to hackmd/ gsheet?
* Few repos have few cores - difficult to get stuff merged
* distributed team degendent on too many f2f interactoins
:watch: (target: +0:45) +
## New topics or demos or education for community call
[training schedule](https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ)
* [arx/chandan/soniya] tempest debug KT/demo
* [jm1] Ansible in-depth sessions
*
## New work items discovered by team
* Reparenting [chandan/amol - pooja]
* centos9 branchful jobs e.g. tripleo-ci-centos-9-containers-multinode-wallaby
* Downstream resource constraint
* If its going to take long to get more resources - we need to find some alternative:-
* Not run components line if no new content
* run 16.2 / 17 - on rhel8 on alternate days
* Run 17 on 9 daily
* Run 16.2/17 on rhel8 on alternate days
* 16.2 component line - 4 times per week
* Integration line run next day to component line run
* Integration line - 3 times a week
* 17 on rhel-8 - 3 times
* Integration line run next day to component line run
* c8/wallaby teardown (lining up after the reparenting)
* & depends on switch to import c9 wallaby d/stream
* ussuri/victoria to three days a week d/stream as well (everything)
* ussuri EOL & teardown
* openstack regular
* 3rd party/rdo recheck options ('check-rdo'?)
* Removing jobs which are not monitored or unmaintained
* ffu upgrade job periodic version
* 822716: Add undercloud-ffu-wallaby job. https://review.opendev.org/c/openstack/tripleo-ci/+/822716
* PTG planning
* April 4-8, 2022 - pls sign up
* https://hackmd.io/s9hZvlP-SKuR4fkE3kL8NA
* osp 18 planning - mixed mode rhel (decoupling)
## Words from PM (Ronelle/Chandan)
## Words from UA (Sandeep Yadav)
:watch: (target: +1:00) +00:47
## Sprint board Review
https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-743
:watch: (target: +1:45) +
## Priority for this sprint on board
* EL9
* cleanup
## General discussion of sprint scope/topics
:watch: (target: +2:00) +
### End Of Meeting
---