# Velero Community Meeting and Open Discussion Notes - Archive

_This is an archive of previous meeting notes, you can find the current meeting notes [here](https://hackmd.io/Jq6F5zqZR7S80CeDWUklkA)_

# June 9, 2020

### Status Updates
- ashish:
- Allowing all pod volumes to be backed up using restic by default, without requiring annotation on the pod. [PR 2611](https://github.com/vmware-tanzu/velero/pull/2611)
- Exclude: host path volumes, volumes mounting default service account tokens and volumes excluded through "exclude" annotation
- Review and discussion of the volume snapshot progress proposal
- Focussing on internal build setup.
- steve
- on community support this week
- updating & testing a community-contributed PR to support `aad-pod-identity` for Azure (https://github.com/vmware-tanzu/velero/pull/2602, https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/51) (thanks @gitirabassi for the code!)
- log a warning instead of an error if an additional item doesn't exist during backup (https://github.com/vmware-tanzu/velero/pull/2595)
- nrb
- More reviewing on [reporting progress on volume snapshotting](https://github.com/vmware-tanzu/velero/pull/2543)
- https://github.com/vmware-tanzu/velero/pull/2610
- Plan to follow up on KubeBuilder PR review this week
- Also want to follow up on the restore hooks PR
- Can other maintainers look at [the tagging scripts PR](https://github.com/vmware-tanzu/velero/pull/2592)?
- Been doing work on some internal projects the last week
- carlisia
- BSL resource conversion to kubebuilder PR is ready for review: https://github.com/vmware-tanzu/velero/pull/2561
- Wrapping up new BSL controller, just need to add tests

### Discussion Topics
- Vishnu:
- Thanks to maintainers for review comments on this PR https://github.com/vmware-tanzu/velero/pull/2543. Would like to discuss on next step and pending items from me related to this PR.
- [steve] finalize naming & CR lifecycle (who creates?)
- Phuong:
- We would like to propose a change to allow caller to specify an order to backup items of the same type. More generic than https://github.com/vmware-tanzu/velero/issues/1917 which only for PVC.
- In backup spec, have a map of type to strings of specific names (e.g. PVC -> names of PVCs)
- Next step - submit a design doc PR based on https://github.com/vmware-tanzu/velero/blob/master/design/_template.md
- [steve] [restore hooks design PR](https://github.com/vmware-tanzu/velero/pull/2465)
- @marccampbell will you be able to address open comments/questions?

### Contributor Shoutouts
- @cblecker - when creating a backup from a schedule, allow a default name (https://github.com/vmware-tanzu/velero/pull/2569)
- @vitta - Thanks for being super responsive on PR 2543!

# June 2, 2020

### Status Updates
- michael
- Discuss the community roles in [Velero Governance](https://github.com/vmware-tanzu/velero/blob/master/GOVERNANCE.md#community-roles)
- nrb
- Added a draft PR for automating our release process
- Reviewed some community PRs, specifically [reporting progress on volume snapshotting](https://github.com/vmware-tanzu/velero/pull/2543)
- Working on some internal Velero-related projects
- On community support this week
- ashish
- Moving all our plugin repos to use go modules
- Decommission Travis and switch to using github actions for our CI and release
- Have you tried the new CSI volume snapshotting feature in 1.4. [This blog post](https://velero.io/blog/csi-integration/) should help you get started.
- Reviewed some PRs on the restore hook and the volume snapshot progress reporting proposal added comments.
- stephanie
- discuss up-vote and down-vote on feature requests, and announcement of 'go-live' for that capability later today
- carlisia
- community support and catching up on PRs last week
- Addressing code reviews for https://github.com/vmware-tanzu/velero/pull/2561 (Convert manifests + BSL api client to kubebuilder)
- jonas
- Introducing Abbie, Tony, Duffie, Matyas, and Mike

### Discussion Topics
- michael
- Discuss the community roles in [Velero Governance](https://github.com/vmware-tanzu/velero/blob/master/GOVERNANCE.md#community-roles)
- Action Item - Carlisia to prep a PR for a reviewer role. Let her know if you're interested in being a reviewer!
- carlisia
- Modernize the [Velero code base/tests](https://github.com/vmware-tanzu/velero/issues/2597)
- abbie
- Documentation style guide
- kevin leffew
- Kubernetes backup to the decentralized cloud via Velero and StorJ
- https://twitter.com/kleffew94/status/1262382842086141953
- https://forum.storj.io/t/kubernetes-backup-via-velero/6879

### Contributor Shoutouts

# May 26, 2020

### Status Updates
- steve
- finalizing things for v1.4; one bug-fix (thanks @ashish for catching) - https://github.com/vmware-tanzu/velero/pull/2560
- bug in using custom CA cert for restic restores: https://github.com/vmware-tanzu/velero/issues/2562
- spent some time brainstorming on multi-tenancy
- ashish
- 1.4 testing using cluster-api as the workload to backup
- Working on a blog post about get started with using CSI snapshotting. [PR#2553](https://github.com/vmware-tanzu/velero/pull/2553).
- nrb
- 1.4 testing last week
- Was off Thursday/Friday
- Planning to do the v1.4.0 release today, pending bug fixes
- carlisia
- on community support this week
- PR out for initial kubebuilder migration: https://github.com/vmware-tanzu/velero/pull/2561
- short video on how I use Goland for PR reviews: https://www.loom.com/share/a60b72518f5c453b97e797f6a5ba39f8
- need to do lots of PR reviews

### Discussion Topics
- stephanie
- we are looking to add an up-vote/down-vote capability to feature requests in the velero backlog as a way to more easily quantify what features the community is more interested in as a whole
- we've filed the issue here: https://github.com/vmware-tanzu/velero/issues/2574
- it could look [something like this](https://gist.github.com/jonasrosland/7986668be2e8c7d4019e6f2027d8d5a4)
- we will be working to get this implemented and open this as an opportunity to provide quick feedback on features that you are most interested in - let us know what you think

### Contributor Shoutouts

# May 19, 2020

### Status Updates
- [ashish]
- Community support last week.
- Quite a few restic related issues/ mostly questions.
- Migrating our plugin repos to use go modules:
- [velero-plugin-for-microsoft-azure](https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/43)
- [velero-plugin-for-gcp](https://github.com/vmware-tanzu/velero-plugin-for-gcp/pull/32)
- [velero-plugin-for--aws](https://github.com/vmware-tanzu/velero-plugin-for-aws/pull/45)
- Moving our CI from travis to Github Actions:
- Started with [velero-plugin-for-microsoft-azure](https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/44). Once this is merged other plugins and velero core should be straight forward.
- Testing 1.4 release
- Testing CSI in Azure
- More testing this week.
- Started on blog post for CSI velero integration. PR this week.
- Update our [helm charts to support Velero feature flags](https://github.com/vmware-tanzu/helm-charts/pull/106)
- Started working on a [Octant plugin for velero](https://github.com/ashish-amarnath/octant-velero-plugin) over the weekend.
- Not fully functional just- scaffolding.
- more to com
- PRs, ideas and suggestions welcome!
- [carlisia]
- k8s Slack #velero channel now has a @velero-maintainers user group
- Migration of BSL CRD to kubebuilder:
- All CRD manifests, and generation of manifests ported to kubebuilder (simpler to do all of them imo, but optional)
- BSL api client and code generation ported to kubebuilder
- Current status:
- basic CRUD works on BSL and backup
- need to fix failing tests
- steve
- on community support this week
- getting ready for 1.4 release
- 1.5+ planning
- stephanie
- 1.5 release planning
- velero roadmap planning
- nrb
- [1.4 testing](https://docs.google.com/spreadsheets/d/150ltwrI6mgxGHhFHGyeR-fPszZdkT96G3thZM3uZWj4/edit?usp=sharing)
- Blog post for v1.4.0
- Some reviews
### Discussion Topics
- vitta
- Would like to have a high level walk through of this PR https://github.com/vmware-tanzu/velero/pull/2543 and the procedure of next steps
- cblecker
- [Non-existent items should not cause backup to be PartiallyFailed](https://github.com/vmware-tanzu/velero/issues/1878)
- areed / marccampbell
- Discussion of RestoreHooks proposal @ https://github.com/vmware-tanzu/velero/pull/2465
- Governance Model review
- I may be gone to at another meeting by the time this comes up. folks can view the PR and comment.
- PR at https://github.com/vmware-tanzu/velero/pull/2541

# May 12, 2020
The [v1.4.0-beta.1](https://github.com/vmware-tanzu/velero/releases/tag/v1.4.0-beta.1) release is out! Please try it out **in your non-critical environments** and give us feedback.

### Status Updates
- [carlisia]
- Lotsa PR reviews
- Moving our BSL CRD to a kubebuilder CRD + controller (Vince Prignano has been offering guidance)
- Next:
- move BSL logic out of the controller
- add handlers to create/update
- [ashish]
- You can now supply feature flags to Velero using the Velero CLI. Read more about it [here](https://velero.io/docs/v1.4-pre/customize-installation/#enable-features)
- Getting CSI integration with Velero ready to ship. Take a look at the [CSI page on our website](https://velero.io/docs/v1.4-pre/csi/)
- Backup syncing: include CSI API objects
- Backup deletion: cleaning up storage snapshots on backup deletion.
- Set up Github actions to build and push container images for velero-csi-plugin. Hoping to do this for all our repos.
- steve
- finalizing things for v1.4.0-beta.1
- starting to look at 1.5 planning
- nrb
- Writing the v1.4 blog post
- Catching up reviews that I pushed out in order to get the beta out; particularly want to get a look at the restore hooks document this week
- Will be testing v1.4.0-beta.1 against a few different platforms and versions of Kubernetes to verify the overall package
- Some docs PRs to get in for the GA release

### Discussion Topics
- stephanie
- Review community feature reqeust for backing up restic volumes by default
- Detailed product requirements are available and we will be providing a review of the three main use cases during this meeting.
- You can find the product requirements here: https://drive.google.com/file/d/1i5IQfuOtsHhGuYiiTrCZ6zjVhtKWLRqV/view?usp=sharing
- And, sample annotations to illustrate the main product use cases are here (these are also included in the UI/UX section of the requirements doc): https://gist.github.com/skriss/dccc494aea67a47473e184c18aac9af6

- vitta
- Backup/Restore progress for operations performed by velero plugins
- In similar lines, if plugin have their own CRs (similar to PVB, PVR), how to get those CRs backed up from source cluster and get them synced at destination cluster regularly?
- Finalizers on Backup CRs to protect data from getting deleted

### Contributor Shoutouts

# May 5, 2020
- ### Status Updates
- steve
- updated container base images to `ubuntu:focal`
- fixed a CRD restore issue related to unstructured conversion functions
- fixed an issue with unresolvable includes/excludes
- updated plugin server code to ignore unrecognized flags, and added special handling for `--features` flag in Velero
- reviews
- carlisia
- continuing with the new BSL: controller (https://github.com/vmware-tanzu/velero/pull/2490); New: added `ValidationFrequency` / `LastValidationTime`, adding validation on BSL create/update events, using status/phase to validate backups
- ashish
- CSI work:
- Deleting CSI objects and cleaningup storage snapshots on backup deletion
- Syncing in CSI objects during backup sync-in. Mainly to ensure they are deleted on backup deletion/ expiry.
- Testing.
- Fixup in persisting backup [here](https://github.com/vmware-tanzu/velero/blob/master/pkg/controller/backup_controller.go#L578)
- PR reviews
- Investigate why we are [unable to install ca-certificate package on ARM builds](https://github.com/vmware-tanzu/velero/issues/2466)
- nrb
- Almost done with CRD back up work in https://github.com/vmware-tanzu/velero/pull/2478. Want to grab a few more samples today if I can
- specifically want to get prometheus objects as mentioned in https://github.com/vmware-tanzu/velero/issues/2370
- Reviewing CSI work, need to finish up the describe output too
- On community support this week
- Will be handling the v1.4 release
- Will be on Crossplane's [TBS YouTube series](https://www.youtube.com/playlist?list=PL510POnNVaaYFuK-B_SIUrpIonCtLVOzT) Thursday with Carlisia
- ### Discussion Topics
- [carlisia]
- Want to add a Tilt setup for rapid development for 1.5. Here's an example from the cluster api team: https://cluster-api.sigs.k8s.io/developer/tilt.html

- ### Contributor Shoutouts
- @jaygridley - [Azure] add support for static storage account keys with restic (https://github.com/vmware-tanzu/velero/pull/2455)
- @jones-paul1525 - [AWS] update AWS SDK to enable some new auth methods (https://github.com/vmware-tanzu/velero-plugin-for-aws/pull/41)
- @dunglas - [Helm chart] Add support for secret env vars (https://github.com/vmware-tanzu/helm-charts/pull/99)
- @austinbv - [Helm chart] Add documentation for having separate providers (https://github.com/vmware-tanzu/helm-charts/pull/100)
- @hasheddan [Velero core] Reviewing #2490 for CRD handling

# April 28, 2020
- ### Status Updates
- steve
- finalized backup progress PR
- fixed issue with unresolvable includes/excludes
- reviews
- [stephanie] - update on where we are currently with the velero 1.4 release
- https://github.com/vmware-tanzu/velero/milestone/23
- https://github.com/vmware-tanzu/velero-plugin-for-csi/milestone/2
- [carlisia]
- Adding tests to the new BSL controller (https://github.com/vmware-tanzu/velero/issues/1967)
- Recorded a tutoria to show the build/run/test workflow for Velero: https://www.youtube.com/watch?v=Aiz9M4aVFdA
- On community support this week
- [nrb]
- Was out sick late last week, not a ton of updates from me. Spent yesterday replying to things I'd missed
- Need to get 2373 reviewed and merged this week so we can get CRD restore fixes started
- Will also make a test of using the v1beta1 client approach
- Will be on Brett Fisher's YouTube channel this Thursday at 1pm ET - https://youtu.be/pRgap975b5E
- [ashish]
- Community support this past week
- Reviewing some PRs and getting CSI closer to the beta ship

- ### Discussion Topics
- [steve] demo of backup progress
- [stephanie] - can we document how to execute backup and recovery in an airgapped environment?
- [nrb] - this is partially documented at https://velero.io/docs/v1.3.2/on-premises/#on-premises-environments, though it's incomplete since there's a lot of possible options in airgapped/on-prem environments
- [from timh] Perhaps we can reuse some of the docs over at [Sonobuoy](https://sonobuoy.io/docs/master/airgap/)
- [carlisia] Question: should we (RE)consider not crashlooping for when there's no BSL? This issue was posed here: https://github.com/vmware-tanzu/velero/issues/1967#issuecomment-620208525
- [marccampbell] Custom Restore Hooks proposal: https://github.com/vmware-tanzu/velero/pull/2465

- ### Contributor Shoutouts
- @raghavendrabhat - clarify wording in `velero restore describe` for included namespaces (https://github.com/vmware-tanzu/velero/pull/2449)
- @mynktl - skip `VolumeSnapshotLocation` validation for backups when `--snapshot-volumes=false` (https://github.com/vmware-tanzu/velero/pull/2450)

# April 21, 2020
- ### Status Updates
- [stephanie] Introducing Velero's new PM!
- [nrb]
- Outlined our approach to versioning the backup file format https://velero.io/docs/master/output-file-format/#output-file-format-versioning ([PR](https://github.com/vmware-tanzu/velero/pull/2436))
- Finished up PR 2323, Velero master will now upload CSI snapshot information for use by client-side commands (such as `velero backup --details`)
- Started in on [2448](https://github.com/vmware-tanzu/velero/pull/2448), which will add the client-side info.
- Investigated issue [2383](https://github.com/vmware-tanzu/velero/issues/2383), where CRDs are reporting errors about fields being duplicated in versions yesterday.
- This is a result of the "fix" for v1beta1 -> v1 CRD restores in Velero v1.3.0. More in discussion time.
- Will be on the [Brett Fisher](https://www.youtube.com/BretFisherDockerandDevOps) show next week talking about Velero
- [steve]
- was on community support
- CSI reviews & testing
- [draft PR](https://github.com/vmware-tanzu/velero/pull/2440) & testing for backup progress
- [carlisia]
- wip: bsl/vsl/velero readiness: https://github.com/vmware-tanzu/velero/issues/1967
- presented Velero to Brazilian meetup
- [ashish]
- CSI bug fixes and testing
- Community support this week
- Sharing a link to the survey we sent out 3w ago. If you've not had a chance to look at this, please do. Survey is available [here](https://docs.google.com/forms/d/e/1FAIpQLSeUBYHH4ObH0T4lbyUKLl0bSYZNKq1_LCWYsMIuHnlC7ifCCQ/viewform).

- ### Discussion Topics
- [marccampbell] Willingness / timeline for custom restore hooks? https://github.com/vmware-tanzu/velero/issues/2116
- [mayank] ~~patch release for plugin velero.io/change-pvc-node-selector~~
- I had a discussion about this on slack with Steve. It won't be a good idea to have a patch release for the above plugin since it's not a bug-fix.
- [nrb] Possible fixes for 2383
- 1) if the object is truly a v1beta1 CRD, re-fetch it using a v1beta1 client in the plugin
- 2) Use the API server's internal representation & [conversion functions](https://github.com/kubernetes/apiextensions-apiserver/blob/c47e10e6d5a3d95d427c5bee109d934602f0861e/pkg/apis/apiextensions/v1/zz_generated.conversion.go#L306) to get the correct version on restore. If we keep this in the backup tarball, this has ramifications for the backup file format
- Essentially 3 versions of CRDs in Go code:
- v1beta1.CustomResourceDefinition
- v1.CustomResourceDefinition
- apiextensions.CustomResourceDefintion <- this one is internal to the API server, and is version-independent.
- 3) Merge #2373 and try v1 CRD, if it fails, try applying v1beta1
- Action items:
- Get #2373 merged
- Try 1 & 2 for v1.4
- investigate 2 for long term implementation. Problem with it is that it may trigger a Velero v2 as the internal CRD representation isn't directly restorable
- To prevent this kind of thing in the future: [document regression test scenarios](https://github.com/vmware-tanzu/velero/issues/2447), [stand up e2e kind tests](https://github.com/vmware-tanzu/velero/issues/2131), and begin automating.
- [carlisia] - [Tilt](https://tilt.dev/)
- Demo of running Tilt with Velero
- Walkthrough of the setup

- ### Contributor Shoutouts
- @hasheddan for pointing out the CRD conversion functions!
- @TomaszKlosinski for providing the elasticsearch & kibana CRD issues

Helm
- @tareqhs - added quotes to `extraEnvVars` to support special chars
- @yurinnick:
- for making our chart Helm 3 compatible!
- allowing multiple backup/snapshot providers
- fixed timeout chart-testing parameter in the chart
- prioritize location provider over global provider
- @ahmadhajali - enable specifying docker image by digest in addition to tag
- @limed fixing toYaml generation

# April 14,2020
- ### Status Updates
- [carlisia]
- reviewing + testing of Helm PRs
- Broke down new install CLI work into issues, see epic: https://github.com/vmware-tanzu/velero/issues/2419
- wip: bsl/vsl/velero readiness: https://github.com/vmware-tanzu/velero/issues/1967
- presenting/demo'ing Velero at a CNCF (online) meetup: https://www.meetup.com/Cloud-Native-Talks-Brazil/events/269858787/
- [steve]
- community support this week
- lotta PR reviews
- did some testing with WIP CSI plugins, reported a couple bugs
- bunch of cleanup on the https://github.com/vmware-tanzu/velero-plugin-example repo, hoping to apply similar changes to the AWS/Azure/GCP ones too
- continued on backup progress idea
- [nrb]
- [CSI upload PR](https://github.com/vmware-tanzu/velero/pull/2323) should be done & ready for review now
- Tackling some CRD issues this week, mainly https://github.com/vmware-tanzu/velero/issues/2383 & https://github.com/vmware-tanzu/velero/issues/2370
- Started working on https://github.com/vmware-tanzu/velero/issues/1970, but ran into https://github.com/vmware-tanzu/velero/issues/2429
- ### Discussion Topics
- [nrb] When do we increment the backup format version? Refer to [this comment](https://github.com/vmware-tanzu/velero/pull/2373#discussion_r403182400)
- PR that added backup version: https://github.com/vmware-tanzu/velero/pull/1117
- AI - Nolan to document when we increment backup format versions (most likely following semantic versioning)
- Current PR changes are backwards compatible, so they're a patch version in semantic versioning parlance
- [dymurray/sseago] Race condition with AdditionalItems https://github.com/vmware-tanzu/velero/issues/1350
- We haven't seen others asking for this feature, but willing to let the RH team lead with a design doc on this
- [nrb] I see this as a generically useful tool, +1 to RH taking the lead here
- [dymurray/sseago] Restoring PVs that already exist (related https://github.com/vmware-tanzu/velero/issues/2170)
- [nrb] Is this a specific case of https://github.com/vmware-tanzu/velero/issues/1977?
- data-only restores https://github.com/vmware-tanzu/velero/issues/504
- ~~Could the PV rename mechanism work here?~~ I was thinking of the [StorageClass remapping](https://velero.io/docs/v1.3.2/restore-reference/#changing-pv-pvc-storage-classes)
- [carlisia] should "liveness" mean "ready", and should we use a liveness check to check for readiness: https://github.com/vmware-tanzu/velero/pull/2382
- Kubernetes definitions of readiness/liveness - https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-startup-probes/
- [marccampbell] Willingness / timeline for custom restore hooks? https://github.com/vmware-tanzu/velero/issues/2116
- [mayank] patch release for plugin velero.io/change-pvc-node-selector
- ### Contributor Shoutouts
- @duyanghao - docs on community project to automatically annotate *all* volumes for restic backup

# April 7, 2020
- ### Status Updates
- [nrb]
- On community support this week
- Reviews
- Pushed up an example of readiness probes for Velero at https://github.com/vmware-tanzu/velero/pull/2382
- Talked to Steve and Ashish about revisiting the Velero CSI plugin data flow/data model
- Continued testing with CSI integration at https://github.com/vmware-tanzu/velero/pull/2323. Will likely require some changes given we're revisiting our data model
- Seeing some more CRD issues crop up, though not all around versioning - https://github.com/vmware-tanzu/velero/issues/2370 & https://github.com/vmware-tanzu/velero/issues/2383
- Looks like some schema restriction errors that need to be investigated further
- Worked with Rafael and Carlisia on a presentation for his work to the data protection working group
- [steve]
- [released v1.3.2](https://github.com/vmware-tanzu/velero/releases/tag/v1.3.2)
- discussion/reviews on CSI integration
- install/config UX design review
- investigating ways to report backup progress (https://github.com/vmware-tanzu/velero/issues/20)
- PSA: looks like we're hitting https://github.com/kubernetes/kubernetes/issues/86149 - manifests as a ~15-second delay at the start of every backup
- [carlisia]
- Addressed code reviews on CLI PR - close to wrapping that and starting to implement
- Fixed the yaml/kustomize examples
- [ashish]
- Have a few PRs in the pipeline for CSI. Close to opening this up for wider review in the community. This is coming soon.
- Survey that we announced last week is now live and available [here](https://docs.google.com/forms/d/e/1FAIpQLSeUBYHH4ObH0T4lbyUKLl0bSYZNKq1_LCWYsMIuHnlC7ifCCQ/viewform). Call to community action!

- ### Discussion Topics
- [carlisia] DEMO of deploying Velero using Kustomize - Files: https://github.com/carlisia/velero/tree/c-cli-design/design/CLI/PoC
- [brito-rafa]
- Handling multiple API Group versions during restore (related to PR #2373)
- Default (today)
Restore Source Cluster Preferred Version
- Target-Version Mode (proposed - feature flag?)
Triggered by detection the target cluster runs a different K8s version from the source backup cluster (see PR #2346 collecting cluster k8s version during backup). Restore objects based on target cluster apiGroup preferred version.
- Next step: Please look at the PR, and then Rafael will put together a design proposal

- ### Contributor Shoutouts
- @rochfordk - docs to clarify backup TTL (https://github.com/vmware-tanzu/velero/pull/2399)
- @mansam - add `--cacert` flag to CLI commands (https://github.com/vmware-tanzu/velero/pull/2364)
- @mynktl - add selected-node remapping plugin (https://github.com/vmware-tanzu/velero/pull/2377)

# March 31, 2020
- ### Status Updates
- [nrb]
- Testing https://github.com/vmware-tanzu/velero/pull/2323 with review feedback
- Adds the `--features` flag into the plugin framework for plugins now, still bugs to chase down (informer cache issues)
- Led to https://github.com/vmware-tanzu/velero-plugin-for-gcp/pull/23
- I created https://github.com/nrb/velero-csi-env based on Ashish's script for setting up his host path driver
- Reviewed https://github.com/vmware-tanzu/velero/pull/2373
- [steve]
- lot of reviews (CSI, cacert, Azure storage keys)
- started looking at two-stage snapshot + backup process again (more discussion below)
- [carlisia]
- Community support this week + PR reviews + triaging new issues
- Tested new Helm 3 chart with helm2 and helm3, PR merged.
- Might write a blog post about how to connect Velero with a service
- Community: please review the CLI install/config redesign PR: https://github.com/vmware-tanzu/velero/pull/2202
- [ashish]
- CSI
- Update on [VolumeSnapshotRef.UID issue](https://github.com/kubernetes-csi/external-snapshotter/issues/274)
- Discussion w/ CSI folks on the usage of secrets in volumesnapshotclass and volumesnapshotcontents
- WIP
- Opened [Issue 2371](https://github.com/vmware-tanzu/velero/issues/2371): Which VolumeSnapshotContents to include in the backup
- Building a catalog of buleprints/workflows for backing up and restoring stateful applications/databases. Survey to go out shortly.
- [brito-rafa]
- Will quickly screenshare and show an example of how a backup tar ball does look like with all API Groups and versions (as [PR #2373](https://github.com/vmware-tanzu/velero/pull/2373) )

- ### Discussion Topics
- Seems there is a high interest in backing up volumes by default. Should/could we prioritize this? ]
Here's a request to add an operator to our docs: https://github.com/vmware-tanzu/velero/issues/2375
Here's a related issue: https://github.com/vmware-tanzu/velero/issues/605
Here's another: https://github.com/vmware-tanzu/velero/issues/1871
- [steve] two-stage snapshot + backup process design (https://github.com/vmware-tanzu/velero/issues/1519)
- **Problem Statement**
- Velero does not wait/check for snapshots to be made durable/restorable
- A backup marked as completed may still be at risk if the snapshot data is not made durable
- A restore may fail if its backup’s snapshots are not yet ready to be restored from
- **Things to Consider**
- Do we want to solve this for Velero snapshots? CSI snapshots? Both?
- There’s potentially a difference between “durable” and “ready to restore” that needs to be modeled
- With EBS/GCP, the snapshot can’t be restored until it’s been made durable by replicating the data to object storage, so they’re effectively the same thing
- With the vSphere plugin and maybe the OpenEBS plugin, a local snapshot can be restored from, even if it hasn’t yet been made durable
- Should Velero actively drive the upload process, or should it passively check for upload status as reported by an external component?
- We don’t want to block the Velero backup queue while waiting for snapshot data to be made durable
- We need to keep the timespan between pre- and post-hooks as short as possible, i.e. data replication should take place outside of hook execution
- Since it may take a significant amount of time to make a snapshot durable, we need to be able to handle pod restarts, network interruptions, etc. gracefully.
- [nolan] v1.3.2 release this week
- https://github.com/vmware-tanzu/velero/pull/2350 for plugin dir in object storage
- Anything else?
- [Mayank] can we upgrade from 1.0.0 to 1.3.1? https://kubernetes.slack.com/archives/C6VCGP4MT/p1585647294073200
- [Dylan] Concurrent Backup/Restores
- https://github.com/vmware-tanzu/velero/issues/487

- ### Contributor Shoutouts
- @mansam for adding support for custom cert bundles (https://github.com/vmware-tanzu/velero/pull/2353, https://github.com/vmware-tanzu/velero-plugin-for-aws/pull/34 and more)
- @jaygridley - Azure: support using static storage keys (https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/32)
- Shoutout to Jonas for adding search to our docs!

- Helm chart
- @yurinnick for making the chart Helm 3 compatible (https://github.com/vmware-tanzu/helm-charts/pull/81)
- @yurinnick for fixing timeout chart-testing parameter (https://github.com/vmware-tanzu/helm-charts/pull/85)
# March 24, 2020
- ### Status Updates
- [ashish]
- Working on CSI
- Discussion on [VolumeSnapshotRef.UID should be cleared on volumesnapshot deletion](https://github.com/kubernetes-csi/external-snapshotter/issues/274)
- May have to rethink the restore scenario as there are some logic that depends on how volumesnapshotcontents are named.
- Coming w/ alternative approach here, plan for the week
- BackupItemAction plugin to for CSI volumesnapshots, created outside of Velero.
- WIP [PR #31](https://github.com/vmware-tanzu/velero-plugin-for-csi/pull/31)
- //TODO: link issue here
- Building a catalog of SOPs for backing up and restoring datastores. Help us prioritize during discussion:
- mySQL: Single pod/ HA?
- Cassandra
- MariaDB
- MS SQL?
- PostgreSQL
- MongoDB
- [brito-rafa]
- In progress code to backup multiple API Group versions (instead of only preferred APIGroups)
- Table of preferred group version and supported groups
- Quick demo of horizontalautoscaler item: v1 versus v2beta2
- Collect any ideas and feedback from the community
- [steve]
- did some CSI snapshot testing on Azure
- lot of support & reviews
- gonna have to rebase https://github.com/vmware-tanzu/velero/pull/2317 at a quiet time
- [carlisia]
- CLI revamp design doc ready for another round of reviews: https://github.com/vmware-tanzu/velero/pull/2202
- Testing PR to update the Velero Helm chart to version 3: https://github.com/vmware-tanzu/helm-charts/pull/81
- [nolan]
- Need to reply to reviews on https://github.com/vmware-tanzu/velero/pull/2323
- Also need to set up CSI test beds, didn't actually run this code yet
- Last week was mostly spent doing internal presentation stuff
- Testing and documenting Helm 2 chart behavior with Velero
- Releases restored before Tiller aren't "adopted"
- ### Discussion Topics
- [Cyril] Cassandra backups and missing features
- https://github.com/vmware-tanzu/velero/issues/2361
- [Mayank] restoreItemAction plugin to clear/update 'selected-node' in PVC, which are created by scheduler for dynamic provisioning.
- Code https://github.com/mynktl/velero-plugin/commit/a03a74004bf0482537649ae4b390cbd2ee9e2ac5
- steve: :+1: to PR into core (detailed code review still to be done)
- [Nolan] Kubernetes 1.18 comes out today, if anyone has bandwidth to try Velero v1.3.1 with it, that would be awesome!

# March 17, 2020
## Agenda
- ### Status Updates
- [ashish]
- More CSI work and getting couple of test and cleanup PRs merged.
- Preparing for a talk on Velero with Nolan
- Brought up issues from last week in upstream volumesnapshot working group meeting. More discussions will happen on these.
- [VolumeSnapshotRef.UID should be cleared on volumesnapshot deletion](https://github.com/kubernetes-csi/external-snapshotter/issues/274)
- More discussions on this in the data protection working group
- [Relation between VolumeSnapshotContent and VolumeSnapshot should be 1:many](https://github.com/kubernetes-csi/external-snapshotter/issues/273)
- Effectively won't fix as there are reasonable workarounds
- [Lifecycle of VolumeSnapshot Kubernetes objects should be decoupled from that in the storage system](https://github.com/kubernetes-csi/external-snapshotter/issues/272)
- More discussions on this will happen in the issue.
- [steve]
- shipped v1.3.1
- finalized [Azure blob chunking code](https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/30)
- starting to look at two-stage snapshot/backup issue again (https://github.com/vmware-tanzu/velero/issues/1519)
- [carlisia]
- CLI PR good to review: https://github.com/vmware-tanzu/velero/pull/2202 (look at the TODO list, working on the last 2 items)
- [Nolan]
- Prepping talk with Ashish
- More work on https://github.com/vmware-tanzu/velero/pull/2323 for uploading CSI resources to object storage
- Allows us to show these snapshots in the client output & do imports w/ the backups if we need
- Discussions w/ Ashish on the snapshot issues he mentioned
- [brito-rafa]
- new labels for the backups #2342
- Examples:
velero.io/source-cluster-k8s-major-version=1
velero.io/source-cluster-k8s-minor-version=14
velero.io/source-cluster-k8s-version=v1.14.10

- ### Discussion Topics
- [steve] add `plugins/` top-level dir to backup storage locations to allow plugins to write arbitrary data to bucket -- https://github.com/vmware-tanzu/velero/issues/2344
- [Mayank] restoreItemAction plugin to clear/update 'selected-node' in PVC, which are created by scheduler for dynamic provisioning. Code https://github.com/mynktl/velero-plugin/commit/a03a74004bf0482537649ae4b390cbd2ee9e2ac5
- [Antony] How can we control ordering of resource backups and restores?
- We don't currently have the mechanisms to do this in Velero
- StatefulSets don't have proper support; we need to special case them, but it's not a generalized solution
- Antony to file an issue and we can brainstorm solutions
- [Sam Lucidi] Custom CA support
- Working on how to get certificate bundle on the pods
- Both plugins and restic need access to it, but have slightly different paths to that data.

- ### Contributor Shoutouts

# March 10, 2020
## Agenda
- ### Status Updates
- ashish
- CSI Integration
- Use Velero to backup and restore using the v1beta1 Snapshot APIs
- Backup and restores- in-cluster restores and cluster migration. Live demo of this later.
- Created some issues:
- Upstream external snapshotter:
- [VolumeSnapshotRef.UID should be cleared on volumesnapshot deletion](https://github.com/kubernetes-csi/external-snapshotter/issues/274)
- [Relation between VolumeSnapshotContent and VolumeSnapshot should be 1:many](https://github.com/kubernetes-csi/external-snapshotter/issues/273)
- [Lifecycle of VolumeSnapshot Kubernetes objects should be decoupled from that in the storage system](https://github.com/kubernetes-csi/external-snapshotter/issues/272)
- Velero:
- [Ensure restored workloads can be backed up](https://github.com/vmware-tanzu/velero/issues/2324)
- [Ensure backup and restore of volumesnapshots created outside of velero work](https://github.com/vmware-tanzu/velero/issues/2326)
- [Repeated backup of the same CSI workload should not leave orphan resources](https://github.com/vmware-tanzu/velero/issues/2325)
- I'll add more details into the issues in the Velero repo.
- See our progress in the [velero-plugin-for-csi](https://github.com/vmware-tanzu/velero-plugin-for-csi) repo and feel free to jump in and contribute.
- carlisia
- Was out last week
- On support rotation this week
- Catching up on PR reviews
- Pushed an update to the CLI PR containing yaml and kustomize files that properly create/update a velero deployment (https://github.com/vmware-tanzu/velero/pull/2202/commits/bda5099153c588477c80494f1782147108031b51)
- jonas
- Plugins page is live!
- https://velero.io/plugins/
- nolan
- PR #2232, fixing CRD int/float conversions on backup.
- Thank you to guyguy333 and NissesSenap for the reports, data, and testing!
- Tracked down nodePort validation error (issue #2308), will require some more thinking
- Started working on uploading CSI artifacts to object storage
- Need to review Unprioritized backlog to help build roadmap, missed that last week
- steve
- finalized refactoring of restore/discovery code (https://github.com/vmware-tanzu/velero/pull/2248)
- working on refactoring to move logic out of controllers
- merged https://github.com/vmware-tanzu/velero/pull/2299
- WIP https://github.com/vmware-tanzu/velero/pull/2317
- worked on implementing blob chunking in azure plugin: https://github.com/vmware-tanzu/velero-plugin-for-microsoft-azure/pull/30
- lots of reviews
- ### Discussion Topics
- v1.3.1 patch release
- https://github.com/vmware-tanzu/velero/pull/2322
- nrb and skriss will try to get v1.3.1 out today
- Important for users of v1.3.1 to upgrade, but it's largely based on what CRDs users have; if there are numeric fields, they will see this bug
- Update from Dylan Murray - actively working on https://github.com/vmware-tanzu/velero/issues/2332 before tackling client & install issues

- ### Contributor Shoutouts
- guyguy333 and NissesSenap for reports, data, and testing for issue 2319/PR 2322
- betta1 for the detailed reproduction case on issue 2308

# March 03, 2020
## Agenda
- ### Status Updates
- [steve]
- shipped v1.3.0!
- [GitHub release](https://github.com/vmware-tanzu/velero/releases/tag/v1.3.0)
- [blog post](https://velero.io/blog/velero-1.3-voyage-continues/)
- getting go 1.14/modules PR ready (https://github.com/vmware-tanzu/velero/pull/2214)
- working on moving code out of controllers, into packages -- starting with backup & restore
- https://github.com/vmware-tanzu/velero/pull/2299
- more PRs to come
- will finalize refactoring of restore/discovery code (https://github.com/vmware-tanzu/velero/pull/2248)
- [nolan]
- On community support this week
- Worked through my review backlog yesterday
- Reviewed Xing Yang's ExecutionHook KEP upstream
- Going to pick up some CSI work this afternoon - namely syncing VolumeSnapshots & VolumeSnapshotContents into object storage so we can use it in client commands and syncing them into clusters
- Will be on Bret Fisher's YouTube show talking about Velero on 4/30.
- [ashish]
- Was on community support last week.
- Discovered a missing feature of importing snapshots with the csi-hostpath-plugin and implemented that in this PR [Discover existing snapshots on disk](https://github.com/kubernetes-csi/csi-driver-host-path/pull/161) int he csi-hostpathplugin repo.
- Making progress on the CSI integration work.
- CSI blogpost that I wanted to put together already exists at [here](https://kubernetes.io/blog/2019/12/09/kubernetes-1-17-feature-cis-volume-snapshot-beta/)
- (carlisia's on PTO)
- [jonas] Finishing up the plugins page
- ### Discussion Topics
- [nolan] Backlog grooming
- Michael has asked us to review our "Unprioritized backlog" in [ZenHub](http://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?repos=99143276) and form a rough roadmap for 1.5 and beyond
- Tag @skriss and/or Michael for any issues you'd like us to take a look at in the next 6-9 months

- ### Contributor Shoutouts
- Helm/Velero chart: https://github.com/vmware-tanzu/helm-charts/pulls?q=is%3Apr+is%3Aclosed

# Feb 25, 2020
## Agenda
- ### Status Updates
- [steve]
- community support last week
- shipped [v1.3.0-beta.2](https://github.com/vmware-tanzu/velero/releases/tag/v1.3.0-beta.2) with a couple more fixes
- updating `v1.3` blog post
- [carlisia]
- Slow progress with the CLI design/PoC
- Caught up on PRs that requested my review
- Intention for the week: go over other helm+velero PRs
- Stretch: go over issues and give feedback
- On PTO next week
- [nolan]
- Got PR #2264 finished
- Reviewed Ashish's PR for CSI updates
- Will be at KubeCon EU
- Need to follow up on https://github.com/kubernetes/kubernetes/issues/87675 from Scott Seago
- [ashish]
- Working on integration of CSI snapshot APIs into the [csi-plugin-for-velero](https://github.com/vmware-tanzu/velero-plugin-for-csi).
- [This PR](https://github.com/vmware-tanzu/velero-plugin-for-csi/pull/16) implements backup support for volumes backed by CSI drivers.
- This was demo'd for the team internally and we will have a demo for the community in the coming weeks.
- Will be continuing work on the restore scenario.
- On community support this week
- Also want to get started on a blogpost about setting up an environment that supports CSI external-snapshotter APIs.
- ### Discussion Topics
- @dymurray Restic Restore Failures with OpenShift (https://github.com/vmware-tanzu/velero/issues/1981)
- @dymurray Custom CA bundle design update (https://github.com/vmware-tanzu/velero/pull/2259)
- ### Contributor Shoutouts
- @jenting - back up PVs to correct location with restic (https://github.com/vmware-tanzu/velero/pull/2244)
- Helm/Velero chart: https://github.com/vmware-tanzu/helm-charts/pulls?q=is%3Apr+is%3Aclosed

# Feb 18, 2020
## Agenda
- ### Status Updates
- [steve]
- returning from 4-day weekend
- on community support this week
- [carlisia]
- Have yaml files that get installed with kustomize working
- Had a meeting to go over kutomize and questions:
- Next step: getting updates to be patched w/ kustomize
- Need to catch up with PR reviews today
- [nolan]
- Two CRD proposals up on PR https://github.com/vmware-tanzu/velero/pull/2264
- Returning to CSI testing with Ashish this week
- [ashish]
- making progress on the velero plugin for CSI
- PRs to [switch to go modules](https://github.com/vmware-tanzu/velero-plugin-for-csi/pull/15)
- PR incoming for the backup flow.
- Release from plugin repos to switch from `nobody:nobody` to `nobody:nogroup`. Current beta release of Velero is incompatible with the existing releases of the plugins in certain linux distros.
- ### Discussion Topics
- [steve] v1.3.0 status
- need to finalize approach for https://github.com/vmware-tanzu/velero/pull/2264
- [m2] Discuss cleanup request https://github.com/vmware-tanzu/velero/issues/1977
- [m2] Update on custom CA support https://github.com/vmware-tanzu/velero/pull/2259

- ### Contributor Shoutouts

# Feb 11, 2020
## Agenda
- ### Status Updates
- [steve]
- shipped `v1.3.0-beta.1`, working on blog post
- put up draft PR with refactor of restore code related to CRDs
- some testing
- [carlisia]
- community support last week
- updated CLI revamp PR: https://github.com/vmware-tanzu/velero/pull/2202#issuecomment-577229282
- POC for installing with kustomize
- [nolan]
- On community support this week
- Moved last week, was out
- Back to working on CRDs, troubleshooting [#2249](https://github.com/vmware-tanzu/velero/issues/2249). Will go more in depth in discussion topics
- Need to work with Ashish on CSI support
- [ashish]
- Update on memory leak [#2069](https://github.com/vmware-tanzu/velero/issues/2069)
- Fixed with Steve's change and `v1.3.0-beta.1` has the fix. Please consider upgrading.
- CSI update
- Using CSI hostpath-plugin driver to validate Velero
- Successfully setup an environment with hostpath-plugin driver using beta snapshot APIs
- Blogpost?
- [jonas]
- Implemented an [ADOPTERS.md](https://github.com/vmware-tanzu/velero/blob/master/ADOPTERS.md) file for public user statements
- Working on a /plugins page
- ### Discussion Topics
- [carlisia] CRD/api/k8s versioning issues: https://github.com/vmware-tanzu/velero/labels/versioning
- [Visual summary of #2249](https://docs.google.com/presentation/d/1IbuWwbdYCFaQHRepjCsf_fQyVjjBt8yl94eL-Pcbb1s/edit?usp=sharing)
- [dymurray] [Add design doc for Custom CA support for S3 BSLs](https://github.com/vmware-tanzu/velero/pull/2259)
- ### Contributor Shoutouts
- @markrity - docs update to point to new Helm chart repo (https://github.com/vmware-tanzu/velero/pull/2209)
- @jnaulty - add Restore API docs (https://github.com/vmware-tanzu/velero/pull/2240)
- @mynktl - allow VolumeSnapshotter plugin to rename PV via SetVolumeID function (https://github.com/vmware-tanzu/velero/pull/2216)
- @jenting - ongoing beta testing, bug-fixing
- @betta1 - Thank you for providing information to narrow down memory leak

# Feb 4, 2020
## Agenda
- ### Status Updates
- Steve
- prepping for `v1.3.0-beta.1` release - will be pushed out later today
- need to see if we should release new versions of the cloud provider plugins
- working on some refactoring in the restore code related to restoring CRDs
- Ashish
- Coming back from community support
- Checking in on https://github.com/vmware-tanzu/velero/issues/2069
- Have some troubleshooting steps
- Carlisia
- On community support
- CLI install redesign - https://github.com/vmware-tanzu/velero/pull/2202#issuecomment-577229282
- Nolan on PTO

- ### Discussion Topics
- [carlisia] Drop CRDs manifest but install CRDs by velero install? https://github.com/vmware-tanzu/helm-charts/issues/44
- [jonas] Would it make sense to create an `ADOPTERS.md` file, where people and organizations can PR themselves in? Similar to [Linkerd](https://github.com/linkerd/linkerd/blob/master/ADOPTERS.md) and [Harbor](https://github.com/goharbor/harbor/blob/master/ADOPTERS.md)?
- [carlisia] How to best deprecate CLI cmds, add/remove the word `new`?: https://github.com/vmware-tanzu/velero/pull/2202#issuecomment-577229282
- [carlisia]

        velero [resource] [operation] [flags]

OR

        velero [operation] [resource] [flags]

https://github.com/vmware-tanzu/velero/pull/2202#issuecomment-581961860
- [dymurray] Unfortunately need to miss the community meeting today but hoping to have a design doc PR up by EOD tomorrow for https://github.com/vmware-tanzu/velero/issues/1027

- ### Contributor Shoutouts
- @jenting - prune unknown fields on Velero CRDs (https://github.com/vmware-tanzu/velero/pull/2187)
- @cpanato - allow `velero restore create --from-schedule` to work for schedules in other clusters (https://github.com/vmware-tanzu/velero/pull/2218)
- @cpanato - use GA topology labels on PVs by default (https://github.com/vmware-tanzu/velero/pull/2219)
- @koehn - fix panic in restic status updating for empty output (https://github.com/vmware-tanzu/velero/pull/2231)
- @shaneutt - add `arm`/`arm64` container builds (https://github.com/vmware-tanzu/velero/pull/2227)

# Jan 28, 2020
## Agenda
- ### Status Updates

- Nolan (have to leave early)
- Working CRD restore issues
- I think all we have left is the int64/float64 conversion on some CRDs raised by Scott Seago on https://github.com/vmware-tanzu/velero/pull/1937
- CSI update
- Currently AWS, GCP, and Azure aren't up-to-date on their CSI drivers, partially due to the newer v2.0.0 images requiring Kubernetes v1.17
- We're going to work on implementing Velero against the v2.0.0 codebase and v1beta1 CRDs and help update their drivers where we can, using the demo hostpath driver for now.
- Ashish (also have to leave early)
- Same update as Nolan on CSI
- Path forward:
- Test Velero against the hostpath plugin.
- Currently figuring out the deployment of a CSI driver:
- All the various sidecars that need to be used
- What should a deployment of the CSI driver look like:
- This information is a bit muddled/ fragmented across the various drivers.
- On community support this week:
- Getting caught-up on PRs and open issues
- [carlisia]
- All caught up on PR reviews except 1 for the helm-chart and 1 for the aws plugin
- Updated the resources page with latest videos/blog posts/podcast about Velero. New entries are welcome if anyone knows of resources not yet included.
- Contributed to discussions and revisions of a submission for VMware internal conference on a Velero related topic, submission is today
- Participated in the DP WG meeting, great start
- Back to updating CLI design doc after this meeting!
- Steve
- lots of PR reviews
- working with @nrb on sorting out CRD backup/restore issues

- ### Discussion Topics
- [steve] do we want to release a v1.3 soon-ish with the CRD fixes and the other [~70 commits](https://github.com/vmware-tanzu/velero/compare/v1.2.0...master) in master since v1.2, and push the CSI integration to v1.4 (can still keep to an end of March timeframe if feasible)?
- thinking here is that it's easier to release everything in master than cherrypicking a few things, and we have a decent # of commits built up already, which I don't really see a reason to hold back
- [Antony B] - What about https://github.com/vmware-tanzu/velero/issues/2069 ? Is that still 1.3 or 1.4?
- We'll review and see if we can fit it in for 1.3 or have to move it.
- [carlisia] Do we want to move https://github.com/vmware-tanzu/velero/pull/2214 (migrate to go 1.13 + modules) to "Ready for review"?
- This doesn't look like it'd be part of Velero: https://github.com/vmware-tanzu/velero/pull/2119 ([design] Proposal of triggering backups based on Kubernetes events)

- ### Contributor Shoutouts!
- @cpanato - CLI auto-completion docs (https://github.com/vmware-tanzu/velero/pull/2208)
- @Sh4d1 - bump restic version (https://github.com/vmware-tanzu/velero/pull/2210)

# Jan 21, 2020
## Agenda
- ### Status Updates
- Nolan
- Attended data protection working group kick off last week
- Notes from agenda: https://docs.google.com/document/d/15tLCV3csvjHbKb16DVk-mfUmFry_Rlwo-2uG6KNGsfw/edit?pli=1
- data protection WG google group: https://groups.google.com/forum/#!forum/kubernetes-data-protection
- Still working on https://github.com/vmware-tanzu/velero/pull/1937 - we need to re-arrange our restore logic so that it discovers new API groups as they're restored
- CSI updates
- Not much headway as I was working on support/1937 and Ashish was in orientation
- Need to coordinate with Ashish to get work started this week
- Steve
- on community support this week
- resync `velero_backup_last_successful_timestamp` metric on server restart (https://github.com/vmware-tanzu/velero/issues/1777)
- fix race condition in collecting restic restore results (https://github.com/vmware-tanzu/velero/issues/2121)
- looked at CRD restore issues with @nrb
- discussed install/config UX design with team
- Ashish
- In Palo Alto most of last week and not much of an update from my end.
- Unblocked on the GCP CSI driver to make progress on the snapshot APIs
- Some traction on the ExecutionHooks.
- Carlisia
- PR for CLI install changes: https://github.com/vmware-tanzu/velero/pull/2202

- ### Discussion Topics
- PR backlog - please catch up on reviews!
- [Mayank] In dynamic provisioning Kubernetes creates a volume with pvc-PVC_UID. Usually storage vendor(like openebs iscsi provisioning, not hostpath based storage vendor) creates resources to provision a volume with volume name and this way it is easy to relate resource to PV name.
If i am not wrong, with volumesnapshotter velero expects pv.spec.hostpath. Is it possible to add a support to consider PV name from volumesnapshotter also? - **will create GitHub issue**
- [Anthony Bett] Have you looked into application consistent backups

- ### Contributor Shoutouts!
- @jnaulty - restic permissions for config file/dir (https://github.com/vmware-tanzu/velero/pull/2199)
- @sseago - check for nil `LastMaintenanceTime` on restic repos (https://github.com/vmware-tanzu/velero/pull/2200)

# Jan 14, 2020
## Agenda
- ### Status Updates
- Steve
- working with Ashish on migrating to go modules
- merging multi-arch Docker support
- picked up an issue around gauge metrics resetting on pod restart (https://github.com/vmware-tanzu/velero/issues/1777)
- Nolan
- Working on identifying issues with CRD migration on 1.16 (https://github.com/vmware-tanzu/velero/issues/2159)
- CSI updates
- Working with Ashish to get him up-to-date on CSI
- Will need to produce a prerequisites document for Velero
- Support will be for external-snapshotter 2.0.0+, I think.
- Carlisia
- CLI revamp

- ### Discussion Topics
[carlisia]
https://github.com/vmware-tanzu/velero/issues/1910

- Some initial thinking to make the CLI more intuitive:
- Change the concept of "provider" to "plugin name" - see https://github.com/vmware-tanzu/velero/issues/1910#issuecomment-539215302
- Group what is now "install" commands that are conceptually "configuration" under a `velero config` command. Ex: ` -velero config --backup-location key1=value1,key2=value2 --snapshot-location key1=value1,key2=value2 ...`
- Group configuration of the default locations to under `velero config default-locations` Ex: `velero config default-location --storage-plugin <NAME> --bucket <NAME> --snapshot-plugin <NAME>`

Would be ideal to be able to add the flag `--default-backup-storage-location <NAME>` to under this `velero config default-locations` (Ex: `velero config default-locations --default-backup-storage <NAME> --default-volume-snapshots <provider1:location-01,provider2:location-02,...>`) command (right now it's under `velero server`.

- ### Contributor shoutouts!
- @jenting - don't log at error level if CPU/mem requirements aren't specified for the restic restore action (https://github.com/vmware-tanzu/velero/pull/2176)
- Helm location name fixes (https://github.com/vmware-tanzu/helm-charts/pull/26)
- Helm CRD label fix (https://github.com/vmware-tanzu/helm-charts/pull/31)
- @Prajyot-Parab - multiarch/ppc64le Docker support (https://github.com/vmware-tanzu/velero/pull/1768)

# Jan 07, 2020
## Agenda
- ### Status Updates
- [carlisia]
- backlog email/issues
- community support
- have to finish my CLI/UX design doc
- Steve
- post-vacation backlog
- final review on move to multi-arch docker manifests + ppc64le support
- looking at upgrade to k8s 1.17 deps, sorting out CLI table-printing changes
- ready to start helping out on CSI tasks, install/config UX discussions
- Nolan
- Data protection working group just merged! https://github.com/kubernetes/community/pull/4301#event-2928345421
- Reviewing backlog
- Need to re-review CSI plan, but ready to get started here
- Plan to take one last look at the [multi-arch docker manifests](https://github.com/vmware-tanzu/velero/pull/1768), but it should be ready for merge
- Resuming the move from Travis CI to GitHub Actions. Need to move container building for master commits and releases.
- Need to review some 1.16 migration issues (https://github.com/vmware-tanzu/velero/issues/2159)
- Ashish
- Picking up on [ExecutionHooks ongoing PR](https://github.com/kubernetes-sigs/execution-hook/pull/4) from Adnan and made some progress over the break. [ExecutionHook KEP](https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/20190120-execution-hook-design.md)
- Spoke to Xing to sync up on the [ApplicationSnapshot KEP](https://github.com/liyinan926/enhancements/blob/master/keps/sig-apps/20190326-stateful-application-api.md)
- Update on switch to go-modules [PR #2144](https://github.com/vmware-tanzu/velero/pull/2144)
- Looking to get started with working w/ Nolan on the CSI.

- ### Discussion Topics
- [carlisia] Support custom CA bundles? https://github.com/vmware-tanzu/velero/issues/1027
- We want to support this.
- AWS GO SDK supports using custom CA bundles. [See Doc](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-envvars.html)
- @dymurray can help out w/ investigation and work on this. Thank you @dymurray! :-)
- [jonas] CMS for velero.io, for blogs and docs? See https://www.netlifycms.org/ for example.
- @Jonas to demo for team.

- ### Contributor shoutouts!
- @cpanato - all the Helm help!!!
- @haoshuwei - add Alibaba credentials env var (https://github.com/vmware-tanzu/velero/pull/2166 and https://github.com/vmware-tanzu/helm-charts/pull/27)
- @jenting - fix log format bug (https://github.com/vmware-tanzu/velero/pull/2165)

# Dec 17, 2019

## Agenda
- ### Status Updates

- Carlisia
- community support last week
- cli UX proposal wip (https://github.com/vmware-tanzu/velero/issues/1910)
- going over all open issues
- Steve
- investigating/responding to outstanding GitHub issues
- CSI snapshot integration planning
- Nolan
- [CSI planning](https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?labels=csi&milestones=v1.3%232020-03-31&repos=99143276,112385197,213946861,190224441,214524700,214524630)
- Items are sorted in relative priority.
- Plan to have the beta CRD code compiling by EOW so we can hit the ground running in January.
- Issues with dependencies that I'm aware of should have that represented in ZenHub
- Documentation for CSI will go under a `CSI` section for now, so we don't have a ton of churn in our normal docs, but they'll need to be folded in as we get closer to GA
- Ashish
- Helm chart version [2.7.1](https://github.com/helm/charts/tree/master/stable/velero), now comes with prometheus metrics enabled by default.
- Some minor doc fixes around Getting Started.
- Move to use go modules. PR# [2144](https://github.com/vmware-tanzu/velero/pull/2144). Testing in-progress.
- Adnan
- Pushed a foundational PR for the ExecutionHook - https://github.com/kubernetes-sigs/execution-hook/pull/3

- ### Discussion Topics
- [carlisia] Investigating lane + label
- [DONE] AI(steve): get rid of Investigation swimlane, use label + New Issues
- [DONE] AI(steve): document support processes
- Check on Investigation label in all repos at the beginning of the week
- use Slack channel topic for on-call person/hours
- Kiran - one thing that helped OpenEBS was to have users report all issues into 1 repo, rather than multiple.
- One possibility - turn off issues on the plugin repos and direct people to the velero repo AFTER the new year
- [carlisia] Work to move move the Velero Helm chart into its own repo, and add compatibility with Helm 3: https://github.com/vmware-tanzu/velero/issues/2147
- [steve] Velero maintainers will be out of office for holidays ~Dec 21 - Jan 5
- ### Open Q&A - add your questions!
- ### How can you get involved?
- Let us know how you use Velero! https://github.com/vmware-tanzu/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @git001 - updated docs/setup cmds for restic on OpenShift
- @jnaulty - switch UUID libraries
- @cpanato - Great writeup on how to implement new [Helm 3 charts](https://github.com/vmware-tanzu/velero/issues/2147)

# Dec 10, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Nolan
- CSI update: addressing feedback from last week's meeting, learning upstream code to contribute tests
- Hope to have doc merged and break out work items this week
- Investigating moving over to GitHub Actions instead of Travis, may need to alter the Makefile/build process: https://github.com/vmware-tanzu/velero/issues/2104
- A reminder: you can add the [`velero-plugin`](https://github.com/topics/velero-plugin) GitHub topic to your repo to appear on the list automatically
- Carlisia
- Helm chart updated for Velero 1.2: https://github.com/helm/charts/tree/master/stable/velero
- Helm 3.0 compatibility + move to our own repo: https://github.com/vmware-tanzu/velero/issues/2088
- CLI UX improvement: https://github.com/vmware-tanzu/velero/issues/1910
- Steve
- Finalized v1.3 planning: https://github.com/vmware-tanzu/velero/milestone/22
- Looking at [potential memory leak](https://github.com/vmware-tanzu/velero/issues/2069) related to pre/post hooks
- Ashish
- Revisiting the docs organization.
- Looking over at [new-doc-outline](https://github.com/vmware-tanzu/velero/pull/1956)
- Adnan
- Revisiting issues with OpenAPIv3 structural schema in CRDs when installing in pre-1.14 clusters: https://github.com/vmware-tanzu/velero/issues/2077

- ### Discussion Topics
- nzoueidi: [Trigger Velero backups based on K8s events](https://github.com/vmware-tanzu/velero/issues/2111)
- Rather than scheduling or manually making backups, have velero trigger on changes in the cluster
- Is this something like a pre-event hook?
- More like post-creation or post-delete, do a backup
- Could be in or out of Velero as a controller
- Design document for being built in to Velero would be welcome!
- There is a [data protection working group forming](https://github.com/kubernetes/community/pull/4301) upstream that we plan to participate in. It overlaps with sig-storage and sig-apps. This came from discussions amongst the community at KubeCon. Special thanks to Xing Yang, Dave Smith-Uchida, and Adnan for getting this going!
- We are revisiting the way our docs are organized. If you have feedback around this please comment on [this PR](https://github.com/vmware-tanzu/velero/pull/1956)

- ### Open Q&A - add your questions!
- kiran:
- [CI/CD on Production like Environment using Velero](https://docs.google.com/document/d/1embTEJ_LIjkO8p4sm9ruypTNjt9XTLMeLwGk-DNBrJI/edit)
- Application consistent snapshots for PostgreSQL - recommended approach?

- ### How can you get involved?
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @dinesh - support `AWS_PROFILE` for restic (https://github.com/vmware-tanzu/velero/pull/2096)
- @shashank855 - updated restic docs for OpenShift 4.1+ (https://github.com/vmware-tanzu/velero/pull/2106)
- @cognoz - support private registries with custom port (https://github.com/vmware-tanzu/velero/pull/1999)

# Dec 03, 2019

`v1.2.0` is out! https://github.com/vmware-tanzu/velero/releases/tag/v1.2.0

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Steve
- Nolan
- Lots of discussions around DR at KubeCon
- DR working group spinning up within sig-apps
- CSI volume snapshots has moved to beta, software release should be done after Kubernetes 1.17 before end of year. Will be helping with updating tests
- Differences from alpha at https://www.youtube.com/watch?v=UdwiJRPRoho
- Carlisia
- @kubecon: NewStack interview about Velero + Dell's PowerProtect: https://thenewstack.io/back-up-restore-and-migrate-kubernetes-with-velero/
- Last updates to the Helm update for v1.2 (https://github.com/helm/charts/pull/18492)
- Going thru GH PRs and issues
- Should we cancel our community meetings for 12/24 and/or 12/31?
- The Podlets podcast launch!
- Adnan
- DP Working Group presentation: https://docs.google.com/presentation/u/1/d/1qwsu82cDNJ06NvXJ5yDl9fPn8Ub9Sf7n9QIvabTOYh0/edit?usp=sharing
- Attend SIG Storage meeting Thurs 9am PT for DP WG further discussion - https://docs.google.com/document/d/1-8KEG8AjAgKznS9NFm3qWqkGyCHmvU6HVl0sk5hwoAE/edit#heading=h.bag869lp4lyz
- Jonas
- [Community meetings](https://twitter.com/projectvelero/status/1197277395025137666?s=20) at KubeCon - what discussions were had?

- ### Discussion Topics
- v1.3 planning
- CSI snapshot integration
- [Release backlog](https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?repos=99143276,112385197)
- MayaData
- Consistency/Volume groups
- https://github.com/vmware-tanzu/velero/issues/505
- PVs on different nodes that all have to be orchestrated to be consistent at an app level
- Can Velero make use of an application's own operator for backups? Elastic has their own operator to do backups, could Velero call it?
- [Nolan]: This may be similar to the data populator idea...
- [Steve]: Maybe a backup item action plugin? There's probably still rough edges, so we'd have to explore
- Application snapshots that encompass more than 1 volume (e.g. elasticsearch)
- https://github.com/kubernetes/enhancements/pull/1051 - KEP for high level applications, encompassing everything for an app, not just volumes
- Point to point migration w/ Velero
- Right now we need an object store
- What if you could send directly to the target cluster w/ a Minio cluster in it?
- [Steve]: Approach seems doable, as long as the source cluster can reach the target via ingress/load balancer.
- [Nolan]: Seems like a documentation fix - we can document this process.
- Is there any roadmap item for direct point to point migrations (no object storage)?
- Use case is for moving an application between clusters, not DR (Kubernetes version upgrades, for example)
- Nothing currently, but something we could consider
- https://github.com/topics/velero-plugin

- ### Open Q&A - add your questions!

- ### How can you get involved?
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor Shoutouts
- KubeCon session: [How to Backup and Restore Your Kubernetes Cluster - Annette Clewett & Dylan Murray, Red Hat](https://www.youtube.com/watch?v=JyzgS-KKuoo)

# Nov 12, 2019

`v1.2.0` is out! https://github.com/vmware-tanzu/velero/releases/tag/v1.2.0

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Steve
- shipped release
- housekeeping on issues
- v1.3+ planning
- end of the year will be slower with KubeCon, holidays; v1.3 cycle may be longer than usual
- Nolan
- KubeCon talk/demo prep (https://kccncna19.sched.com/event/UaXR/csi-volume-snapshots-on-the-way-to-faster-and-better-backups-adnan-abdulhussein-nolan-brubaker-vmware)
- Planning to address Helm Chart PRs today/tomorrow
- KubeCon next week, out Nov 25-29
- Carlisia
- PTO yesterday
- secret project + blog post last week
- need to update Helm PR
- going to miss the Velero community lunch :(, will be at the diversity lunch + hack session
- I'm on community support this week, just realized it!
- Adnan
- KubeCon talk/demo prep
- Jonas

- ### Discussion Topics
- **Community lunch @ KubeCon San Diego**
- **Wednesday (11/20) @ 12:30pm** - come to the VMware booth or look for the Velero sign in the lunch area at the convention center
- Where to find the Velero team at KubeCon - At the VMware booth at times XYZ
- [Steve] Tues 2-4pm
- Helm support for v1.2 plugins may be a bit delayed due to KubeCon + US Thanksgiving

- ### Open Q&A - add your questions!

- ### How can you get involved?
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- For Velero 1.2.0:
- @betta1
- @lintongj
- @spiffcs
- @s12chung
- @boxcee
- @andyzhangx
- @sseago
- @Frank51
- @alexander-demichev

**THANK YOU!**

# Nov 05, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- `v1.2.0-beta.1` is out! https://github.com/vmware-tanzu/velero/releases/tag/v1.2.0-beta.1

- ### Status Updates
- Steve
- finalizing docs, some small bug fixes for v1.2
- Nolan
- KubeCon prep mostly, some reviews
- Carlisia
- Helm update for v1.2, testing. PR reviews, doc updates (yeay!), working on a secret project (blog post incoming)
- Adnan
- velero install --crds-only flag
- kubecon prep
- community support
- Jonas
- Investigating upgrade of the website to Jekyll 4.0, should make builds faster (hopefully)

- ### Discussion Topics
- Community lunch @ KubeCon San Diego - Wednesday (11/20) @ 12:30pm - come to the VMware booth or look for the Velero sign in the lunch area at the convention center
- Speaking of KubeCon - we're moving this meeting to 2pm EST (7pm UTC) next Tuesday
- https://github.com/vmware-tanzu/velero/issues/1910

- ### Open Q&A - add your questions!

- ### How can you get involved?
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!

# Oct 29, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- `v1.2.0-beta.1` is out! https://github.com/vmware-tanzu/velero/releases/tag/v1.2.0-beta.1

- ### Status Updates
- Steve
- Carlisia
- Updating Helm chart + documentation
- Adnan
- Testing v1.2.0-beta.1 on AWS
- Nolan
- Just back from vacation, catching up on in-flight work. Need to test the beta and new install instructions

- ### Discussion Topics
- [steve] https://github.com/vmware-tanzu/velero/issues/1878 - behavior of Velero when backing up e.g. a pod that has a mount of a nonexistent PVC
- [m2] what if Velero did a pre-flight check to check if everything can be backed up
- [Nolan] We have discussed a "2 pass" backup that enumerates all objects to be backed up and then actually back them up, but we haven't undertaken that work
- we should clarify "Failed" and "PartiallyFailed" - document this
- Failed should mean something that cannot be restored
- PartiallyFailed should mean something that can be restored, but may not result in a valid state
- [adnan] what happens if we try to backup the missing PVC with restic? The Pod won't be running so this should fail
- [steve] Helm chart

- ### Open Q&A - add your questions!
- Are there any plans to adopt and manage other third-party plugins? For example, we will be using the OpenStack Cinder plugin from Cisco. - Rob H

- ### How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!

# Oct 22, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Steve
- Carlisia
- Extraction of cloud providers from codebase: https://github.com/vmware-tanzu/velero/pull/1985
- MS Azure, AWS and Google plugins have their own repos: https://github.com/vmware-tanzu
-
- Adnan
- Jonas
- Change of blog post URLs to include `/blog`

- ### Discussion Topics
- [steve] plugin versioning (v1.0? v1.2? something else?)
- do we want to stay in sync with the Velero version?
- Starting with 1.0, will keep compatibility matrixes in each plugin's repo

- ### Open Q&A - add your questions!

- ### How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @rochfordk - docs diagram fix (https://github.com/vmware-tanzu/velero/pull/1982)
- @alexander-demichev - correctly update role bindings during restore with namespace remapping (https://github.com/vmware-tanzu/velero/pull/1974)
- @Frank51 - support `--no-default-storage-location` for `velero install` (https://github.com/vmware-tanzu/velero/pull/1931)
- @sseago - back up related CRDs if `IncludeClusterResources` is nil (auto) (https://github.com/vmware-tanzu/velero/pull/1831)

# Oct 15, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Carlisia
- 1 down, 2 to go: https://github.com/vmware-tanzu/velero-plugin-for-aws
- next: https://github.com/vmware-tanzu/velero/pull/1890
- Steve
- continuing to experiment with restic-based volume snapshotter
- working on docs
- Adnan
- Amanda
- KubeCon San Diego updates - minilab, opportunity for community to get hands on keyboards in SD.

- ### Discussion Topics
- [steve] plugin makefile/dockerfile - multi-stage build vs. go build cache support
- [Jonas] Guides as a separate docs item? See example: https://projectcontour.io/guides/
- [Jonas] Implement `/blog` on the website for a cleaner look?

- ### Open Q&A - add your questions!

- ### How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @andyzhangx - Azure china/germany support (https://github.com/vmware-tanzu/velero/pull/1938)

# Oct 08, 2019

Add your request, question or suggestion to [our issue list](https://github.com/vmware-tanzu/velero/issues)

- ### Status Updates
- Adnan
- Looking into errors creating custom resources in <v1.14 with structured schema CRDs [#1935](https://github.com/vmware-tanzu/velero/issues/1935)
- Carlisia
- image for aws plugin is (almost) up (https://console.cloud.google.com/gcr/images/heptio-images/GLOBAL/plugin-aws), working on moving documentation and testing it against a AWS cluster
- velero-plugin-example updated and moved to new GH org
- (draft) PR for extracting plugins rebased with the changes for the org move
- Nolan
- Waiting for CRDs to be ready before restoring CRs
- KubeCon talk prep
- Internal CNS/restic debugging
- Steve
- Azure china/germany support
- restic volume snapshotter prototype
- ### Discussion Topics
- [steve] restic as a volume snapshotter plugin
- Only able to back up PVs
- Bring your own repo?
- Right now Velero manages the repo lifecycle, does it make sense to keep doing this in the plugin approach?
- Adnan: What’s the historical reason behind not doing restic support in a plugin?
- Nolan: This uses a worker pod design - has it informed your thinking about our design proposal for worker pods?
- Adnan: In the worker pod, could we mount just the volume we want to back up, rather than all of them?
- Steve: it's difficult to run restic as a snapshot plugin without worker pods, but the design doc is different
- Steve: restore's easier, since it's a pod that mounts a PVC and repopulates it before giving it to the app
- Steve: It mounts a subdirectory for the pod that's using the PV now, but we may be able to narrow it down
- Adnan: Seems like we might be able to mount the PV directly
- Steve: It gets tricky; works for ReadWriteMany but not all volumes
- Adnan: Can't you mount ReadWriteOnce as read-only?
- Steve: was under the impression that we couldn't do that
- Adnan: ReadWriteOnce can only be mounted on a single node
- Steve: another approach would be a sidecar, but that requires adding a sidecar to every workload you want to back up. It restarts the pod and that's a downside
- ### Open Q&A - add your questions!
- ### How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @JWong101 - GKE workload identity support (https://github.com/vmware-tanzu/velero/pull/1810)
- @boxcee - Azure cross-subscription backups (https://github.com/vmware-tanzu/velero/pull/1895)
- @spiffcs - Schedule docs (https://github.com/vmware-tanzu/velero/pull/1925)

# Oct 01, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ### Updated Meeting Format
- ### Status Updates
- @nrb
- CI investigations
- adding support for `plugins` flag on `velero install` command
- @carlisia
- Blog post
- doc reorg
- extract plugins
- starting new plugin repos
- @steve
- sync controller updates
- experimenting with restic VolumeSnapshotter plugin
- ### Discussion Topics
- [steve] restic project health
- https://forum.restic.net/t/is-restic-dying/2103
- [nolan] should the designer and implementor of a feature be different people?
- [steve] not necessarily a policy, but may be useful
- [carlisia] the documents would need to be more detailed if this we do this; trend has been to be more general
- [carlisia] as the project grows, we may have specialists
- [steven wong] documents are useful for async communication and feedback and in larger projects
- [steven wong] if resolving major issues, allow the design in and move foward. Don't need to do every detail
- [Steven Wong] Is there a getting started guide for developers?
- Current docs: https://velero.io/docs/v1.1.0/start-contributing/
- Add proposing features to it
- [carlisia] `--plugins` flag on `velero install` - should it be required? Context: https://github.com/vmware-tanzu/velero/pull/1884)
- [Nolan] Velero's not really functional without any object storage, so it would need at least one. We can make this required for a beta and see how it works
- [carlisia] should we make the install command interactive?
- [Nolan] Let's add it to 1910 and discuss it! Only thing is that it should be optionally interactive, so it's still usable in scripts.
- [tim] app-centric approach to backups?
- [Nolan] This is a long-term view, but Velero should be able to use some sort of app definition like a Helm Release or an App CRD as a "root" object
and walk the graph of resources
- [steve] changing restic approach to be PV/VolumeSnapshotter-based
- ### Open Q&A
- Sorry this might be off-topic, but will the velero installer be able to do things like adding env vars, so people won't have to edit the deployment manifest to add env vars?
- [nolan] Let's definitely discuss this!
- [carlisia] See also this issue: https://github.com/vmware-tanzu/velero/issues/1910 - there's an item in there for this question.

- ### How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- [Help Wanted](https://github.com/vmware-tanzu/velero/labels/Help%20wanted) issues

- ### Contributor shoutouts!
- @spiffcs - fixing logging for backup of additional items

# Sept 3, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- [ZenHub - v1.2 milestone](https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?milestones=v1.2%232019-10-31&filterLogic=any&repos=99143276,112385197,150626909)
- [Carlisia] - Steps to move GH organization - https://github.com/heptio/velero/pull/1822
- [Carlisia] - Steps to extract plugins out of tree - https://github.com/heptio/velero/issues/1814

- ## What's coming up?

- ## Items for discussion
- https://github.com/heptio/velero/pull/1804 (two-stage snapshot API)
- https://github.com/heptio/velero/issues/1687 (keep status on restore)
- https://github.com/heptio/velero/issues/1027 (self-signed certs)
- https://github.com/heptio/velero/issues/1830 (including CRDs when using restrict)
- https://github.com/heptio/velero/issues/964 (waiting for a CRD to be ready before restoring the CRs)

- ## How can you get involved?
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!

- ## Contributor shoutouts!

- ## Community questions:

# August 20, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](https://youtu.be/WsLjG3DUvlk)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- v1.1-beta.x bug fixes - thanks for help from testers!
- [steve] https://github.com/heptio/velero/issues/192 - clone PV when remapping namespace
- [Nolan] https://github.com/heptio/velero/pull/1748 - Properly set namespace for invoking in-tree plugins
- [Carlisia] #vmwarecodehouse + Article about Velero
- ## What's coming up?
- v1.1 release - targeting Thursday
- [v1.2 scope definition](https://github.com/heptio/velero#workspaces/velero-5c59c15e39d47b774b5864e3/board?milestones=v1.2%232019-10-31&filterLogic=any&repos=99143276&showPipelineDescriptions=false) in progress
- continued work to bring restic integration to GA
- CSI snapshot integration
- move existing cloud provider plugins out of tree
- R&D for encryption at rest
- feature flags
- we're moving to monthly community meetings! (1st Tuesdays)
- ## How can you get involved?
- User survey closing soon! https://velero.io/survey
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!

- ## Contributor shoutouts!
- @betta1 - include object storage prefix in backup storage location map of config data
- Nicolas Kowenski - documentation fix for helm install commands
- @code-chris - docs fix for port-forwarding commands
- Dylan Murray and Scott Seago - testing beta.1 and finding bugs!
- ## Community questions:
-

# August 6, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- [adnan] `velero install` requests/limits
- [adnan] backup resource list
- [steve] https://github.com/heptio/velero/pull/1705 design doc for copying PVs when remapping namespaces during restore
- [carlisia] If you are going to VMworld, 3 sessions will be featuring Velero: https://my.vmworld.com/widget/vmware/vmworld19us/us19catalog?search=velero
- [carlisia] PR out that restores using PodVolumeBackups resources (instead of using pod annotations)
- ## What's coming up?
- v1.1.0-beta.1!
- ## How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in Slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- Take the [Velero user survey](https://velero.io/survey)

- ## Contributor shoutouts!
- @carthewd - add support for JSON log output (https://github.com/heptio/velero/pull/1654)

- ## Community questions:
-

# July 16, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- [Tom] Velero User Survey
- Launching soon!
- [Tom] Velero CNCF Webinar
- https://www.cncf.io/event/cncf-webinar-series-kubernetes-backup-and-migration-strategies-using-project-velero/
- [Steve] plugin to remap storage classes on restore - demo
- [Nolan] Our CSI support proposal is up! Please give us your feedback.
- https://github.com/heptio/velero/pull/1661
- [Steve] design proposal for running each backup/restore in its own worker pod - please provide feedback! (https://github.com/heptio/velero/pull/1653)
- [Carlisia] Restic stuff:
- 1) Adding the pod volume backup to object storage, have it synched, and use that as the backup source for pod volumes (as opposed to doing backups using the annotation on the pod): https://github.com/heptio/velero/issues/1169
- 2) "add restic stale lock checking": https://github.com/heptio/velero/issues/1511
- ## What's coming up?
- v1.1 release ~end of summer
- ## How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Good first issues: https://github.com/heptio/velero/labels/Good%20first%20issue
- Other help wanted: https://github.com/heptio/velero/labels/Help%20wanted
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!

- ## Contributor shoutouts!
- @ThoTischner - better documenting requirements for using Velero + restic on OpenShift
- @Prajyot-Parab - adding support for ppc64le
- @jwmatthews - bug fix in `velero version` command
- @tlkamp - add pod annotations flag to `velero install`

- ## Community questions:
-

# July 2, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- @nrb - CSI snapshot prototype plugins
- Please give it a test! https://github.com/heptio/velero-csi-plugin/
- Adding restic support for CSI volumes in the meantime
- @carlisia - back from KubeCon Shanghai, picking back up with Restic GA issues (see: https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?labels=restic%20-%20ga&repos=99143276,112385197,150626909&showLabels=false&showEstimates=false&showMilestones=false&showPipelineDescriptions=false&showReleases=false)
- @carlisia - demo a cluster migration
- ## What's coming up?
- https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?repos=99143276,112385197,150626909
- Velero CNCF Webinar - July 18, 2019 9:00a PDT
- ## How can you get involved?
- Velero User Survey
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!

- ## Community questions:
- Will the velero-csi-plugin eventually replace the blockstore plugin ? And the object store plugin for velero will evolve on its own ?

# June 18, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- [nolan] CSI snapshot plugin prototype demo
- [CSI prototype plugin](https://github.com/heptio/velero-csi-plugin/)
- [steve] https://github.com/heptio/velero/pull/1517 -- read-only storage locations demo
- [carlisia] Improving restic usability
- ## What's coming up?
- https://app.zenhub.com/workspaces/velero-5c59c15e39d47b774b5864e3/board?repos=99143276,112385197,150626909
- ## How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!

- ## Contributor shoutouts!
- @guilhem (https://github.com/heptio/velero/pull/1428) - support wildcards for includes/excludes
- @pranavgaikwad (https://github.com/heptio/velero/pull/1548) - add support for multiple AWS profiles in credentials file
- ## Community questions:
-

# May 7, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

You can find the video recording of this meeting [on YouTube](LINK)

Add your request, question or suggestion to [our issue list](https://github.com/heptio/velero-community/issues)

- ## What have we been working on?
- v1.0.0-beta.1 is out!
- https://github.com/heptio/velero/releases/tag/v1.0.0-beta.1
- Add PartiallyFailed phase for restores (#1389, @skriss)
- Add PartiallyFailed phase for backups, log + continue on errors during backup process (#1386, @skriss)
- Switch from restic stats to restic snapshots for checking restic repository existence (#1416, @skriss)
- Disallow bucket names starting with '-' (#1407, @nrb)
- Shorten label values when they're longer than 63 characters (#1392, @anshulc)
- Fail backup if it already exists in object storage. (#1390, @ncdc,carlisia)
- Install command: Use latest image tag if no version information is provided at build time (#1439, @nrb)
- GCP: add optional 'project' config to volume snapshot location for if snapshots are in a different project than the IAM account (#1405, @skriss)
- Azure: restore disks with zone information if it exists (#1298, @sylr)
- Replace config/ with examples/ in release tarball (#1406, @skriss)
- restic integration will be "beta" as of v1.0.
- stablizing and updating of the Helm chart
- CI/CD fixes
- CRD fixes
- Azure secret changes (using a secrets file instead of environment variables)
- ## What's coming up?
- v1.0.0 GA release - May 21
- Upgrade process -- https://heptio.github.io/velero/v1.0.0-beta.1/upgrade-to-1.0
- Post-1.0 planning
- CSI snapshot integration
- bringing restic integration to GA
- much more
- ## How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- Let us know what features you're interested in seeing in Velero 1.1+!

- ## Contributor shoutouts!
- @sylr - add support for Azure AZ disks
- @fabito - add validation to `velero backup download` command

- ## Community questions:
- None during meeting. See you in a couple of weeks!

# April 16, 2019

[Previous meeting notes](https://github.com/heptio/velero-community)

Recording: LINK

- ## What have we been working on?
- [first v1.0.0 alpha](https://github.com/heptio/velero/releases/tag/v1.0.0-alpha.1)!
- container image: `gcr.io/heptio-images/velero:v1.0.0-alpha.1`
- [Steve] revisions to backup/restore phases
- https://github.com/heptio/velero/issues/1371
- [Nolan] wrapping up install command and reviewing the v0.11.0 Helm chart
- [Carlisia] Plugin name collision and protobuf refactoring
- ## What's coming up?
- remaining must-have items for v1.0: https://github.com/heptio/velero/issues?utf8=%E2%9C%93&q=is%3Aopen+label%3A%22P1+-+Important%22++milestone%3Av1.0.0
- ## How can you get involved?
- Let us know how you use Velero! https://github.com/heptio/velero/issues/1327
- Join us in slack (Kubernetes - [#velero](https://kubernetes.slack.com/messages/velero)) and help answer fellow users' questions!
- Test out v1.0.0 alpha!
- Plugins interfaces have changed - try them out! (See https://github.com/heptio/velero-plugin-example/)
- Try the install command (See https://github.com/heptio/velero/pull/1376 for in-progress docs)
- Try the updated Helm chart (https://github.com/helm/charts/pull/12031)
- Backups made prior to v0.11.0 are not supported
- Migration support coming in v0.11.1 (https://github.com/heptio/velero/pull/1360)

- ## Contributor shoutouts!
- @amanw / James King - disable specific controllers via CLI flag
- @ipochi - update docs for restic + RancherOS
- @sseago - allow restore item actions to skip restoring an item
- @fabito - add prometheus metrics for backup deletion
- @faiq - add notice that current plugin examples are for master, not v0.11.0
- @josephgorse - working on the v0.11.0 Helm chart rename

- ## Community questions:
-