owned this note
owned this note
Published
Linked with GitHub
# Velero Community Meeting and Open Discussion Notes
_This doc is meant to serve as the "one doc to rule them all" for Velero community meetings and open discussions._
_Join our [Google Group](https://groups.google.com/forum/#!forum/projectvelero) to get updates on the project and invites to community meetings._
_**Community meeting schedule**:_
- Bi-weekly community meeting alternating every week between Beijing Friendly timezone and EST/Europe Friendly Timezone ([Google Calendar](https://calendar.google.com/calendar/embed?src=6e41fca3d22f24b2890fdbfc6b17f75dd97885a8d9ed9dab642355bdee598add@group.calendar.google.com), [iCal](https://calendar.google.com/calendar/ical/6e41fca3d22f24b2890fdbfc6b17f75dd97885a8d9ed9dab642355bdee598add%40group.calendar.google.com/public/basic.ics))
- Join us at [Zoom Link](https://broadcom.zoom.us/j/94416678753?pwd=YkptN1k4M2lrUTdGbitNTmorODcvUT09)
- Beijing/US friendly - we start at 8am Beijing Time(bound to CST) / 8pm EDT(7pm EST) / 5pm PDT(4pm PST) / 2am CEST(1am CET) - [Convert to your time zone](http://www.thetimezoneconverter.com/?t=09:00&tz=PT%20%28Pacific%20Time%29)
- US/Europe friendly - we start at 10am ET(bound to ET) / 7am PDT(7am PST) / 4pm CEST (3pm CET) / 10pm/11pm CST - [Convert to your time zone](http://www.thetimezoneconverter.com/?t=17:00&tz=PT%20%28Pacific%20Time%29)
_You can find recordings of these meeting [on YouTube](https://www.youtube.com/playlist?list=PL7bmigfV0EqQRysvqvqOtRNk4L5S7uqwM)._
Archives of older meeting notes
* https://hackmd.io/@jonasrosland/SyV22skpL - Archive 2019
* https://hackmd.io/ukRqw4IxRNeXFwoYmp4iJQ - Archive 2020
* [Achived notes 2021](https://github.com/vmware-tanzu/velero/wiki/Velero-Community-Meeting-and-Open-Discussion-Notes--2021)
* https://hackmd.io/or-hIzhbRwaB-vjsxs-qnw - Archive 2022
* https://hackmd.io/Jq6F5zqZR7S80CeDWUklkA - Archive 2023
Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)
_If you have anything you'd like to put on the agenda, please do so below for the next meeting:_
## RoadMap - on-going
Link: https://hackmd.io/iQy7XmPOT0y8lrCuAFL4PQ
# Oct 9, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Wenkai Yin (Broadcom)
- Tiger Kaovilai (Red Hat)
- Yunqian Chen (Dell)
### Status
1.15: Preparing RC (Oct 11), RC1 issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.15-rc.1
1.16: Collecting and reviewing candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.16-candidate
- Scott
- podified datamover SELinux fix
- https://github.com/vmware-tanzu/velero/pull/8255
- We need a configurable option, since there are two different SELinux fixes, depending on scenario
- "none": default value, no selinux fix
- "no-relabeling": This sets `spc_t`, which works in most SELinux scenarios, but does not work when Restricted pods are being used
- "no-readonly": This removes "readOnly=true" from pod.spec.volumes, which works for Restricted pods, but does not work in cases where the cloned PVC has ROX access mode (as is the case for ceph shallow copy)
- Shubham
- Need reviews on
- Add Backup warning for inclusion of NS managed by ArgoCD
- https://github.com/vmware-tanzu/velero/pull/8257
- Minor fix PRs:
- https://github.com/vmware-tanzu/velero/pull/8245
- Tiger
- Documenting S3 Compatible issues: https://github.com/vmware-tanzu/velero/issues/8265
- Will add backupRepository invalidation of pre-existing BSLs on velero startup https://github.com/vmware-tanzu/velero/issues/8279
- We already do this on BSL update/create when velero server is running
- Helps with BackupRepositories containing stale information
- feedback:
- if object store is down, or something is deleted we want to invalidate backup repository.
- only invalidate bsls we know are modified, by checking generation annotation added to backupRepo etc.
- verify if this only affects restic
- for review:
- [Multiarch make container](https://github.com/vmware-tanzu/velero/pull/8252)
- [Allow make local to work without docker in path #8056](https://github.com/vmware-tanzu/velero/pull/8056)
### Discussion topics
- Discuss PR https://github.com/vmware-tanzu/velero/pull/8255
- Discuss issue https://github.com/vmware-tanzu/velero/issues/8259
# Oct 1, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Mateus Oliveira (Red Hat)
- Tiger Kaovilai (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Michal Pryc (Red Hat)
- Raghuram Devarakonda (CloudCasa)
- Wes Hayutin (Red Hat)
### Status
1.15: Post FC manual testing, RC1 is on Oct 11th
1.16: Collecting candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.16-candidate
Holiday of Beijing team Oct 1st~7th
- Scott
- SELinux fix for podified datamover
- https://github.com/vmware-tanzu/velero/pull/8255
- Shubham
- Debugging podified datamover for SELinux envs
- Add Backup warning for inclusion of NS managed by ArgoCD
- https://github.com/vmware-tanzu/velero/pull/8257
- Minor fix PRs:
- https://github.com/vmware-tanzu/velero/pull/8245
- Tiger
- [Multiarch make container](https://github.com/vmware-tanzu/velero/pull/8252)
- [Allow make local to work without docker in path #8056](https://github.com/vmware-tanzu/velero/pull/8056)
- PR reviews/GH Discussions ([namespace deletion tracking #8233](https://github.com/vmware-tanzu/velero/pull/8233))
### Discussion topics
- Mateus
- Velero developer experience NEEDS to be improved!
August 14 https://github.com/vmware-tanzu/velero/pull/8114#issuecomment-2288564023
August 29 https://github.com/vmware-tanzu/velero/pull/8146#issuecomment-2317757552
September 21/25 https://github.com/vmware-tanzu/velero/pull/8027
https://github.com/vmware-tanzu/velero/pull/8126
https://github.com/vmware-tanzu/velero/pull/8127
https://github.com/vmware-tanzu/velero/pull/8236
- Posible solution: There is alaready a BOT in slack that tells maintainers to review PRs, but it does not tell which ones. We could prioritize by creation date. Also filter "ready" PRs using below filter (which can give false positives, because of codecov error, and is missing rebase conflict)
`is:pr is:open draft:false status:success review:required sort:created-asc`
https://docs.github.com/en/search-github/searching-on-github/searching-issues-and-pull-requests
https://github.com/marketplace/actions/label-conflicting-pull-requests
-
# Sep 25, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Xun Jiang (Broadcom)
- Tiger Kaovilai (Red Hat)
- Wenkai Yin (Broadcom)
- Yunqian Chen (Dell)
### Status
1.15: Post FC manual testing, RC1 is on Oct 11th
1.16: Collecting candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.16-candidate
Holiday of Beijing team Oct 1st~7th
- Scott
- ItemBlockAction addition to velero-plugin-example
- https://github.com/vmware-tanzu/velero-plugin-example
- Implements IBA plugin and includes test data to demonstrate an ItemBlock with 2 pods and pre/post hooks
- Privileged pod fix for podified data mover (needed for OpenShift and possibly other kubernetes environments that also need privileged node agent)
- https://github.com/vmware-tanzu/velero/pull/8243
- New installer and node agent server flag
- Ideally we'd get this merged before 1.15 release, since this fixes a datamover regression in some environments.
- Tiger
- Looking at prior designs affecting [Data mover Micro Service -- support NFS/local-volume/host-path volume as target BSL #8190
](https://github.com/vmware-tanzu/velero/issues/8190) interested in performance of local volumes.
- Shubham
- Draft PR up for backupPVC config e2e: https://github.com/vmware-tanzu/velero/pull/8227
- Some fix PRs:
- [Remove multiple single quotes from Velero backup.status.validationErrors field #8245](https://github.com/vmware-tanzu/velero/pull/8245)
- [Add labels to maintenance job pods #8246](https://github.com/vmware-tanzu/velero/pull/8246)
### Discussion topics
- Daniel
- Use velero to backup and restore Windows workload?
# Sep 17, 2024 (US/Europe)
### Attendees
- Shubham Pampattiwar (Red Hat)
- Michal Pryc (Red Hat)
-
### Status
1.15: FC on Sep 11 2024
- Shubham
- Working on e2e for backupPVC config feature
### Discussion topics
# Sep 11, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Tiger Kaovilai (Red Hat)
- Scott Seago
- Shubham Pampattiwar (Red Hat).
- Daniel Jiang (Broadcom)
- Wenkai Yin (Broadcom)
- Wes Hayutin (Red Hat)
- Steven Ren (Broadcom)
### Status
1.15: FC on Sep 11. Open issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+milestone%3Av1.15
- Yonghui
- Data mover micro service tasks
- Functional testing - done
- Doc changes https://github.com/vmware-tanzu/velero/pull/8144
- Xun
- Repository Job Maintenance configration: done
- Modify repository and node-agent configuration parameter name, and add them in the install CLI: https://github.com/vmware-tanzu/velero/pull/8201
- Deprecate velero server's repo maintenance related parameters (httpsl
- Tiger
- Ready for review
- Implemented [Retry completion status patch for backup and restore resources #8068](https://github.com/vmware-tanzu/velero/pull/8068) v1.15 Milestone
- [Add new-changelog to Makefile #8104](https://github.com/vmware-tanzu/velero/pull/8104)
- [Allow make local to work without docker in path #8056](https://github.com/vmware-tanzu/velero/pull/8056)
- [Add additional keys from BSL secret to credentials file store #7943](https://github.com/vmware-tanzu/velero/pull/7943)
- [Ensure install pkg do not import cloud providers. #8180](https://github.com/vmware-tanzu/velero/pull/8180)
- Ready to merge (2 acks)
- [Upgrade to robfig/cron/v3 to support time zone specification #7793](https://github.com/vmware-tanzu/velero/pull/7793)
- need to update [Add controller name to periodical_enqueue_source #8198](https://github.com/vmware-tanzu/velero/pull/8198) per feedback
- last week looked into NFS support for kopia velero backups (same as [issue 8190](https://github.com/vmware-tanzu/velero/issues/8190))
- Scott
- Backup perf improvements work
- Third PR ItemBlock model and backup workflow changes merged:
- https://github.com/vmware-tanzu/velero/pull/8102
- Doc and velero-plugin-example updates have been started, PRs later this week
- Shubham
- BackupPVC Config
- Work on a testplan/test cases
- Will start on E2E test
- PR reviews for Velero 1.15 FC issues
### Discussion topics
- Yonghui
- Do we have further comments on https://github.com/vmware-tanzu/velero/issues/8136?
- Velero integrates Kopia by commits
- Velero doesn't rely on Kopia upstream releases
- Velero doesn't rely on Kopia upstream compatibility policy
- Velero doesn't upgrade repo format automatically, it is dangerous
- When uploader (resource/volume) data format changes, a full backup will be created
- When repo format changes, a new repo will be created and a full backup will follow
- Shubham
- Allow resource status restore in a more granular way: https://github.com/vmware-tanzu/velero/issues/8204
# Sep 3, 2024 (US/Europe)
### Attendees
- Daniel Jiang (Broadcom)
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Anshul Ahuja(Microsoft)
- Yunqian Chen (Dell)
- Wes Hayutin (Red Hat)
- Michal Pryc (Red Hat)
- Tiger Kaovilai (Red Hat)
### Status
- Daniel
- velero.io migrated to my personal account under netifly atm.
- Updated the FC date to Sep 11th
- A few issues labeled as "defer-candidate"
- Scott
- Backup perf improvements work
- Third PR ItemBlock model and backup workflow changes:
- https://github.com/vmware-tanzu/velero/pull/8102
- Some reviews are in, responded to comments, will update PR today.
- Will start on docs PR this week
- Anshul
- Need quick review on https://github.com/vmware-tanzu/velero/pull/8174
- Shubham
- backup PVC config
- PR merged for Apply backupPVCConfig to backupPod volume spec
- Issue closed for 1.15: https://github.com/vmware-tanzu/velero/issues/7356
- PR reviews
- Mpryc
- Do we want to discuss ? https://github.com/vmware-tanzu/velero/issues/8136
- Need to respin velero image to do some more testing around: https://github.com/vmware-tanzu/velero/pull/8133
- Tiger
- ready for reviews:
- [Add status patching retry configuration design. #8063
](https://github.com/vmware-tanzu/velero/pull/8063)
- will update implement PR to match current design
- [Upgrade to robfig/cron/v3 to support time zone specification #7793
](https://github.com/vmware-tanzu/velero/pull/7793)
# Aug 28, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Scott Seago (Red Hat)
- Wes Hayutin (Red Hat)
- Tiger Kaovilai (Red Hat)
- Yunqian Chen (Dell EMC)
### Status
1.14.1 GA ON 26th
1.15: FC 2nd Sep. Opening issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+milestone%3Av1.15
- Yonghui
- Data mover micro service tasks
- Functional testing
- Resource Configuration for data mover pods https://github.com/vmware-tanzu/velero/pull/8143
- Doc
- Xun
- Repository maintenance Job Configuration: In Progress.
- Scott
- Backup perf improvements work
- Third PR ItemBlock model and backup workflow changes:
- https://github.com/vmware-tanzu/velero/pull/8102
- Ready for review
- Will start on docs PR this week
- Shubham
- Apply backupPVC Config to backupPod volume spec PR: https://github.com/vmware-tanzu/velero/pull/8141
- Tiger
- ready for reviews:
- [Add status patching retry configuration design. #8063
](https://github.com/vmware-tanzu/velero/pull/8063)
- [release-1.14: Allow make local to work without docker in path #8057
](https://github.com/vmware-tanzu/velero/pull/8057)
- [Upgrade to robfig/cron/v3 to support time zone specification #7793
](https://github.com/vmware-tanzu/velero/pull/7793)
- [Support install label and annotations on velero CLI installation resources #6152
](https://github.com/vmware-tanzu/velero/pull/6152)
### Discussion topics
Need review:
- https://github.com/vmware-tanzu/velero/pull/8133
# Aug 20, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Matthew Arnold (Red Hat)
- Wes Hayutin (Red Hat)
- Michal Pryc (Red Hat)
- Anshul Ahuja (Microsoft)
- Tiger Kaovilai (Red Hat)
- Daniel Jiang (Broadcom)
- Yunqian Chen (Dell)
### Status
(from last meeting)
1.14.1: tentative release on 26th Aug. Running E2E & manual tests for issue fixes
1.15: FC is on 26th Aug. Opening issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+milestone%3Av1.15
- Scott
- I was sick last week, so not much progress. Resuming this work now that I'm back.
- Backup perf improvements work
- Second PR:implementing IBA plugins corresponding to the internal BIA plugins (PVC for Pod, PV for PVC, etc.)
- https://github.com/vmware-tanzu/velero/pull/8054
- Merged last week
- Third PR ItemBlock model and backup workflow changes:
- https://github.com/vmware-tanzu/velero/pull/8102
- Currently in Draft, awaiting rebase
- Also in Draft until I do some more manual testing
- Shubham
- Worked on backup PVC configuration feature
- Implementation merged: https://github.com/vmware-tanzu/velero/pull/8109
- Docs PR is up: https://github.com/vmware-tanzu/velero/pull/8119
- Velero 1.15 PR reviews
- Michal
- One small PR ready for review: https://github.com/vmware-tanzu/velero/pull/8133
- Tiger
- Ready for review:
- [Add status patching retry configuration design. #8063](https://github.com/vmware-tanzu/velero/pull/8063) v1.15 milestone
- [Allow make local to work without docker in path #8056](https://github.com/vmware-tanzu/velero/pull/8056)
### Discussion topics
- Scott
- golang version upgrade (1.22.2->1.22.6)
- PR doesn't mention which CVEs (https://github.com/vmware-tanzu/velero/pull/8118 )
- Do we know what the minimal version upgrade is which fixes them?
- Not a concern for 1.14.1 (1.22.6 is fine), but relevant to downstream products
- Is golang v1.22.5 good for downstream?
- This is the milestone of Golang v1.22.6. There is no outlined security fix yet. https://github.com/golang/go/issues?q=milestone%3AGo1.22.6+label%3ACherryPickApproved
- Matthew
- Regarding https://github.com/vmware-tanzu/velero/issues/8095 (Include additional helpful information in default DataUpload/DataDownload display.)
- Is there any way to get actual bytes moved from Kopia? We do not want to count bytes that were skipped from incremental backups/deduplication.
- Anshul
- Bump up the discussion around deprecation process in https://github.com/vmware-tanzu/velero/issues/8076 Please add your thoughts in the issue for offline discussion.
# Aug 14, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Scott Seago (Red Hat)
- Yunqian Chen (Dell EMC)
- Shubham Pampattiwar (Red Hat)
- Xun Jiang (Broadcom)
- Jiaolin Yang (Broadcom)
- Wenkai Yin (Broadcom)
- Tiger Kaovilai (Red Hat)
### Status
1.14.1: tentative release on 26th Aug. Running E2E & manual tests for issue fixes
1.15: FC is on 26th Aug. Opening issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+milestone%3Av1.15
- Yonghui
- Data mover micro service tasks
- Smoke testing
- Functional testing
- Scott
- Backup perf improvements work
- Second PR:implementing IBA plugins corresponding to the internal BIA plugins (PVC for Pod, PV for PVC, etc.)
- https://github.com/vmware-tanzu/velero/pull/8054
- Has one ack, awaiting additional ack/merge
- Third PR ItemBlock model and backup workflow changes:
- https://github.com/vmware-tanzu/velero/pull/8102
- Currently in Draft, awaiting merge of second PR and rebase
- Also in Draft until I do some more manual testing
- Xun
- v1.14.1 E2E testing.
- Shubham
- Add support for backup PVC configuration
- PR is up: https://github.com/vmware-tanzu/velero/pull/8109
- Tiger
- Ready for review:
- [Add status patching retry configuration design. #8063](https://github.com/vmware-tanzu/velero/pull/8063) v1.15 milestone
- [Allow make local to work without docker in path #8056](https://github.com/vmware-tanzu/velero/pull/8056)
- Download API design
- [NFS volume with root_squash doc](https://github.com/vmware-tanzu/velero/issues/8107)
### Discussion topics
- Yonghui
- 1.15 status sync up, can we meet the FC or do we need some delay?
# Aug 6, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Anshul Ahuja (Microsoft)
- Daniel Jiang(Broadcom)
- Wes Hayutin (Red Hat)
- Michal Pryc (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Tiger Kaovilai (Red Hat)
### Status
1.14.1: tentative release on 26th Aug. 1 open issue left, https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: Reached to feature freeze on 28th July. FC is on 26th Aug.
- Scott
- Backup perf improvements work
- Second PR:implementing IBA plugins corresponding to the internal BIA plugins (PVC for Pod, PV for PVC, etc.)
- https://github.com/vmware-tanzu/velero/pull/8054
- Next up will be ItemBlock model and backup workflow changes.
- Tiger
- Ready for review:
- Add status patching retry configuration design. #8063
https://github.com/vmware-tanzu/velero/pull/8063
- https://github.com/vmware-tanzu/velero/pull/8056
- Download API design
- Shubham
- PR reviews
- Will start working on Allow setting the /spec/accessModes of a PVC created for the CSI snapshot data movement once dm micro service is merged https://github.com/vmware-tanzu/velero/issues/7747
### Discussion topics
# Jul 31, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Tiger Kaovilai (Red Hat)
- Scott Seago (Red Hat)
- Jiaolin Yang (Broadcom)
- Wes Hayutin (Red Hat)
- Wenkai Yin (Broadcom)
- Yunqian Chen (Dell)
### Status
1.14.1: tentative release on 26th Aug. 1 open issue left, https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: Reached to feature freeze on 28th July. FC is on 26th Aug.
- Yonghui
- Data mover micro service tasks
- Backup repository configuration
- Xun
- Support running E2E test cases parallelly
- Repository maintenance Job configuration implementation
- Tiger
- Opened design PR for status patching retry [#8063](https://github.com/vmware-tanzu/velero/pull/8063)
- Scott
- Backup perf improvements work
- First (of 4) implementation PRs is for the ItemBlockAction plugin type
- https://github.com/vmware-tanzu/velero/pull/8026 (Has 2 acks already, I think one more review requested)
- Second PR:implementing IBA plugins corresponding to the intermal BIA plugins (PVC for Pod, PV for PVC, etc.)
- https://github.com/vmware-tanzu/velero/pull/8054 (draft until 8026 merges since it depends on that PR)
- Next up will be ItemBlock model and backup workflow changes.
### Discussion topics
- Yonghui
- Do we start to deprecate Restic in 1.15? and how?
- Velero generated clients deprecation also meets the similar situation.
- Restic deprecation initiative was started long before the deprecation policy was merged. Do we strictly follow the policy and start over for Restic deprecation process?
- (Scott) Most likely we should follow the policy, since Restic deprecation was the main motivator to create the policy. 2 releases post-deprecation to remove support for new backups with Restic, but we will need to continue to support Restic restores for longer since some users have longer backup retention policies.
- 1.15 warning in the backup/installation/open an issue, but backup still succeed; in 1.17, remove backup; in 1.19 remove restore
- Wes/Scott
- Red Hat is currently testing some of various kopia hashing/splitting algorithms re:https://github.com/vmware-tanzu/velero/issues/7620
- Wondering if we find anything significant re: performance if we'd be open to reconsider allowing kopia hashing / splitting algorithm configuration in v1.15 or it has to be $next release.
# Jul 23, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Mateus Oliveira (Red Hat)
- Tiger Kaovilai (Red Hat)
- Michal Pryc (Red Hat)
- Daniel Jiang (Broadcom)
### Status
1.14.1: tentative release on 26th Aug (delayed). Issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: feature freeze on 28th, candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.15-candidate
- Scott
- Backup perf improvements work
- Design PR merged (thanks for the reviews!)
- First (of 4) implementation PRs is for the ItemBlockAction plugin type
- https://github.com/vmware-tanzu/velero/pull/8026 (ready for review)
- Next PR will be implementing IBA plugins corresponding to the intermal BIA plugins (PVC for Pod, PV for PVC, etc.)
- Shubham
- Velero 1.14.1 issues
- PR reviews
- Tiger
- Designs
- Velero Download API
- Retry patch on restore
### Discussion topics
- Daniel
- https://github.com/vmware-tanzu/velero/issues/8018
- Do we wanna revert the change?
# Jul 17, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Yunqian Chen (Dell)
- Xun Jiang (Broadcom)
- Jiaolin Yang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Scott Seago (Red Hat)
- Wenkai Yin (Broadcom)
### Status
1.14.1: tentative release on 26th Aug (delayed). Issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: feature freeze on 28th, candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.15-candidate
- Yonghui
- Data mover micro service tasks
- Need help on code review, need one more reviewer
- Scott and Shubham will help
- Backup repository configuration design https://github.com/vmware-tanzu/velero/pull/7963
- Backup PVC configuration design https://github.com/vmware-tanzu/velero/pull/7982
- Scott
- Backup perf improvements work
- https://github.com/vmware-tanzu/velero/pull/7628
- Design PR has 3 acks, and all feedback is responded to ready to merge?
- I started phase 1 impl work today.
- Shubham
- Backup is marked as waitingForPluginOperationsPartiallyfailed when VolumeSnapshotContent has an error
- Issue link: https://github.com/vmware-tanzu/velero/issues/7356
- PR: https://github.com/vmware-tanzu/velero/pull/8023
- Expose PVPatchMaximumDuration timeout for custom configuration
- Issue link: https://github.com/vmware-tanzu/velero/issues/8020
- Draft PR: https://github.com/vmware-tanzu/velero/pull/8021
- Xun
- Repository maintenance job configuration design
- E2E enhancement taks
- Tiger
- Velero Download API
- Studied more about ingress controllers on KinD and EKS
- PRs ready: [#7793](https://github.com/vmware-tanzu/velero/pull/7793) [#7913](https://github.com/vmware-tanzu/velero/pull/7913) [#7942](https://github.com/vmware-tanzu/velero/pull/7942)
### Discussion topics
- Tiger
- [Velero didn't retry on failed Restore CR status update, causing the CR to remain stuck in "InProgress"
#7207](https://github.com/vmware-tanzu/velero/issues/7207)
Velero had trouble connecting to the API server, but eventually, the restore was successful. After the connection was restored, it didn't attempt to update, causing the restore CR to be stuck at "In progress" indefinitely.
- we had discussed [retry](https://github.com/vmware-tanzu/velero/pull/7845) or [requeue](https://github.com/vmware-tanzu/velero/pull/7863) last time.
- suggestions:
- establish backup/restore window
- what if we don't know when api will go down?
- restart velero pod to trigger mark as failed
- other in-progress killed
- requeue
- complicates future reconciler updates (ex: [cancel](https://github.com/vmware-tanzu/velero/pull/7863#discussion_r1636304591), parallel backups)
- retry until patch is successful - simpler vs requeue
- reuse existing configurable timeouts
- create design to cover UX changes
# Jul 9, 2024 (US/Europe)
### Attendees
- Mateus Oliveira (Red Hat)
- Scott Seago (Red Hat)
- Michal Pryc (Red Hat)
- Wes Hayutin (Red Hat)
- Tiger Kaovilai (Red Hat)
- Anshul Ahuja (Microsoft)
- Shubham Pampattiwar (Red Hat)
- Yonghui Li (Broadcom)
### Status
- Tiger
- Slack
- Design Velero Server Download API
### Discussion topics
- [Michal] Design for backup repository configurations proposed by Lyndon-Li: https://github.com/vmware-tanzu/velero/pull/7963
- Scott
- Requesting final reviews on backup performance improvements, since Phase 1 needs to be implemented in Velero 1.15
- https://github.com/vmware-tanzu/velero/pull/7628
- Plugin memory leak
- https://github.com/vmware-tanzu/velero/issues/7925
- Initially reported on Azure, but we're seeing it with AWS as well
- Shubham
- Requesting reviews on [Skip PV patch step in Restore workflow for WaitForFirstConsumer VolumeBindingMode Pending state PVCs](https://github.com/vmware-tanzu/velero/pull/7953)
# Jul 3, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Scott Seago (Red Hat)
- Tiger Kaovilai (Red Hat)
- Jiaolin Yang (Broadcom)
- Wenkai Yin (Broadcom)
### Status
1.14.1: tentative release on 5th Aug. Issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: feature freeze on 28th, candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aopen+is%3Aissue+label%3A1.15-candidate
- Yonghui
- Data mover micro service tasks
- Backup repository configuration design https://github.com/vmware-tanzu/velero/pull/7963
- Shubham
- Updated PR [Skip PV patch step in Restore workflow for WaitForFirstConsumer VolumeBindingMode Pending state PVCs](https://github.com/vmware-tanzu/velero/pull/7953)
- PR reviews
- Tiger
- [Enable SDKv2 s3 debug logs](https://github.com/vmware-tanzu/velero-plugin-for-aws/pull/207)
- [Design: Download server for Velero client](https://github.com/vmware-tanzu/velero/issues/7432)
- Xun
- E2E enhencement
- 1.15 and 1.14.1 issues fix
### Discussion topics
- [Xun]
- [issue: How to handle non-existing namespace in the backup namespace filters](https://github.com/vmware-tanzu/velero/issues/7928)
- [proposal PR 7695](https://github.com/vmware-tanzu/velero/pull/7965)
- Scott
- Requesting final reviews on backup performance improvements, since Phase 1 needs to be implemented in Velero 1.15
- https://github.com/vmware-tanzu/velero/pull/7628
# Jun 25, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Michal Pryc (Red Hat)
- Anshul Ahuja (Microsoft)
- Mateus Oliveira (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Tiger Kaovilai(Red Hat)
- Wes Hayutin (Red Hat)
### Status
1.14: GA on 17th. Some 1.14.1 issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: Collecting requirements, candidates reviewing https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3A1.15-candidate
- Scott
- https://github.com/vmware-tanzu/velero/pull/7899
- Fix for unschedulable pods for DM
- Shubham
- Will update PRs for 1.4.1 issues
- https://github.com/vmware-tanzu/velero/issues/7866
- https://github.com/vmware-tanzu/velero/issues/7356
### Discussion topics
- [Anshul] https://github.com/vmware-tanzu/velero/pull/7924
- [Michal] https://github.com/vmware-tanzu/velero/issues/7620
- [Wes] - Deprecation Policy https://github.com/vmware-tanzu/velero/pull/5532
- [Wes] - upcoming k8s features - VolumeSnapshotGroups && CSI block CBT. Any discussion required in upcoming meetings?
# Jun 19, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Daniel Jiang (Broadcom)
- Scott Seago (Red Hat)
- Xun Jiang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Wes Hayutin (Red Hat)
- Tiger Kaovilai (Red Hat)
- Jiaolin Yang (Broadcom)
### Status
1.14: GA on 17th. Some 1.14.1 issues https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3Atarget%2F1.14.1
1.15: Collecting requirements, candidates reviewing https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3A1.15-candidate
- Yonghui
- Data mover micro service design https://github.com/vmware-tanzu/velero/pull/7576
- Issue https://github.com/vmware-tanzu/velero/issues/7896
- Daniel
- Fixed the bug in RC2, Released v1.14.0
- Xun
- Worked on v1.14.0 RC and GA tasks
### Discussion topics
- Yonghui
- About the Changing PVC selected-node feature https://velero.io/docs/v1.14/restore-reference/#changing-pvc-selected-node. https://github.com/vmware-tanzu/velero/issues/7890. Deprecate or enahnce? --- document it only works for Immediate volumes in 1.14.1; deprecate it in 1.15 and follow the deprecation policy
- Daniel
- Discuss the timeline for v1.15.0 https://github.com/vmware-tanzu/velero/wiki/1.15-Roadmap
- Scott
- Problems with DM "fail early"
- https://github.com/vmware-tanzu/velero/issues/7898
- Certain conditions are considered "unrecoverable" by velero:
- ImagePullBackoff
- Failed or Unknown pod phase
- Pending pod with "unschedulable" condition
- The "unschedulable" condition isn't necessarily "unrecoverable". In fact, it's a normal condition of the pod while the PVC isn't yet bound to the PV during provisoning phase. Most Storage Classes seem to work fine here, but if the storage drive takes longer to provision PVs, then velero may end up canceling on the DU/DD before the provisioner has time to provision and bind the PVC. We're seeing this right now with Ceph volumes
- Two possible solutions:
- Don't consider "unschedulable"/Pending unrecoverable. This allows provisioning to complete normally, even when slow. Downside is if "unschedulable" isn't resolved (i.e. in cases where there's no node available), then we take 30 minutes to time out. Linked draft PR implements this approach
- Still consider "unschedulable" to be unrecoverable, but only after polling until timeout -- a shorter timeout than the overall DM 30 minutes, probably more like 2 minutes.
# Jun 11, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Raghuram Devarakonda (CloudCasa)
- Mateus Oliveira (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Tiger Kaovilai (Red Hat)
- Michal Pryc (Red Hat)
- Anshul Ahuja (Microsoft)
- Wes Hayutin (Red Hat)
### Status
1.14: RC2 was created
1.15: Collecting requirements, candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3A1.15-candidate
- Shubham:
- Created PR for [Add Restore err in Finalizing PV Patch phase if SC VolumeBindingMode is WaitForFirstConsumer](https://github.com/vmware-tanzu/velero/pull/7869) for issue https://github.com/vmware-tanzu/velero/issues/7866
### Discussion topics
- [API Server temporary outage Requeue/Retry patching Completion phase discussion](https://github.com/vmware-tanzu/velero/pull/7845)
- To unstuck backup status if last status patch call fails
- Yonghui will follow up
- We could store Complete/PartiallyFailed in-memory to patch next reconcile for already uploaded backups
- Retry is still potential solution
- can add in downstream?
# Jun 5, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Daniel Jiang (Broadcom)
- Xun Jiang (Broadcom)
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Jiaolin Yang (Broadcom)
- Tiger Kaovilai (Red Hat)
- Wenkai Yin(Broadcom)
### Status
1.14: RC1 was created, running manually tests on issue fixes, will create RC2
1.15: Collecting requirements, candidates https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+label%3A1.15-candidate
- Yonghui
- Follow up comments/discussions on data mover micro service design https://github.com/vmware-tanzu/velero/pull/7576
- Daniel
- Fix issue 7849 (targeting v1.14 RC2)
- Prepare for RC2
- Planning v1.15
- Xun
- Test v1.14-rc.1
- Verify checked-in fixes.
- Tiger
- [Retry backup/restore completion/finalizing status patching #7845](https://github.com/vmware-tanzu/velero/pull/7845)
- solutions from call:
- requeue & mark as failed
- restart velero pod to trigger mark as failed
- set backup windows to avoid issue
### Discussion topics
- Daniel
- The DCO check issue:
- https://github.com/dcoapp/app/issues/211
- Shall we hold PRs for a few days?
- https://github.com/vmware-tanzu/velero/pull/7793
- Tiger - update docs
# May 28, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Mateus Oliveira (Red Hat)
- Raghuram Devarakonda (CloudCasa)
- Tiger Kaovilai (Red Hat)
- Michal Pryc (Red Hat)
- Wes Hayutin (Red Hat)
### Status
- Scott
- Updated backup performance enhancement design PR, responded to comments
- https://github.com/vmware-tanzu/velero/pull/7628
- A few updates to the design forthcoming, in response to recent comments
- Shubham
- PR reviews and testing for velero 1.14
### Discussion topics
# May 22, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Jiaolin Yang (Broadcom)
- Tiger Kaovilai (Red Hat)
- Wes Hayutin (Red Hat)
- Yunqian Chen (Dell)
### Status
1.14.0: Preparing RC. Fixing problems with some corner cases for VolumePolicyExtension https://github.com/vmware-tanzu/velero/pull/7794
### Discussion topics
# May 14, 2024 (US/Europe)
### Attendees
- Shubham Pampattiwar (Red Hat)
- Michal Pryc (Red Hat)
- Raghuram Devarakonda (CloudCasa)
- Anshul Ahuja (Microsoft)
- Mateus Oliveira (Red Hat)
- Scott Seago (Red Hat)
- Tiger Kaovilai (Red Hat)
- Daniel Jiang (Broadcom)
- Sachin Singla (Red Hat)
- Wenkai Yin (Broadcom)
### Status
- Shubham
- Work on addressing feedback on Removal of snapshotVolumes flag necessity for volume policy snapshot action https://github.com/vmware-tanzu/velero/pull/7786
### Discussion topics
- Scott
- Backup performance enhancement design discussion
- https://github.com/vmware-tanzu/velero/pull/7628
- Responded to the last issue comment after last week's discussion. I'm not sure we need a lengthy discussion this week until the recent comment has been read through, but if there are specific questions today, we can go through them.
# May 8, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jiang (Broadcom)
- Ming Qiu (Broadcom)
- Scott Seago (Red Hat)
- Shubham Pampattiwar (Red Hat)
- Danfeng Liu (Broadcom)
- Tiger Kaovilai (Red Hat)
- Wenkai Yin(Broadcom)
- Shawn Hurley (Red Hat)
- Jiaolin Yang (Broadcom)
### Status
1.14.0: Testing and preparing for rc
- Yonghui
- Manual test and RC issue fixes
- Xun
- Manual test and bug fix.
- Ming
- Manual test and bug fix.
- Shubham
- Documentation PR for Volume Policy Extension: https://github.com/vmware-tanzu/velero/pull/7779
- Work on fixing (add more logs when a volume is skipped) [https://github.com/vmware-tanzu/velero/issues/7774]
### Discussion topics
- Daniel
- Discuss the date for rc.1 (late May)
- Scott
- Backup performance enhancement design discussion
- https://github.com/vmware-tanzu/velero/pull/7628
- Will respond point-by-point to the most recent comment later this week, but first we should probably have a discussion here, as some things may be getting lost in the back-and-forth comments.
# Apr 30, 2024 (US/Europe)
### Attendees
- Scott Seago (Red Hat)
- Raghuram Devarakonda (CloudCasa)
### Status
- Scott
- Updated backup performance enhancement design PR, responded to comments
- https://github.com/vmware-tanzu/velero/pull/7628#issuecomment-2083819288
- Link goes to last comment, summarizing current issues with a follow-on response to each.
- We should probably schdule a separate meeting to discuss at some point next week.
### Discussion topics
# Apr 24, 2024 (China/US)
### Attendees
- Yonghui Li (Broadcom)
- Xun Jaing (Broadcom)
- Scott Seago (Red Hat)
- Jiaolin Yang (Broadcom)
- Shubham Pampattiwar (Red Hat)
- Wes Hayutin (Red Hat)
- Tiger Kaovilai (Red Hat)
- Wenkai Yin(Broadcom)
- Danfeng Liu (Broadcom)
- Ming Qiu (Broadcom)
### Status
1.14.0: FC in this week, will launch post-FC manual testing
- Yonghui
- PR reviews and prepare test cases
- Xun
- Write manual test cases
- Daniel
- Prepare for FC
- Scott
- Updated backup performance enhancement design PR, responded to comments
- https://github.com/vmware-tanzu/velero/pull/7628
- See last few comments, thanks to Lyndon for the detailed response
- I think we agree on the use cases that need this design vs. those that don't.
- Regarding the remaining two points of disagreement listed, I think we can agree on the first point -- relaxing the v3-for-all-plugins requirement.
- On the second point, we still need the plugin API change to meet additional requirements (see the comments for details)
- Shubham
- Worked on Extend Volume Policies Impl PR: https://github.com/vmware-tanzu/velero/pull/7664
- Tiger
- Researching TLS certificates for [Design: Velero client download APIServer](https://github.com/vmware-tanzu/velero/pull/7344)
- Slack user support
### Discussion topics
- Xun
- [Data-only restore](https://hackmd.io/MIp_MAFXRoatsx0KANpDLA?view) discussion
- Daniel
- https://github.com/vmware-tanzu/velero/issues/7356
- Moving it out of v1.14?
- Discuss the requirement for restoring ownerReference. Does RH users have such requirement?