OpenEBS CSI Local PV Discussions Notes
Add your request, question or suggestion to our issue list
If you have anything you’d like to put on the agenda, please do so below for the next meeting:
Nov 29, 2021
Attendees: Pawan, Abhishek
- shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) – abhishek – design doc (https://docs.google.com/document/d/13D8Ht__66n66c5ZBThPwqhKjyJey0GFKVO3dgK3w8OA/edit) is in review (pawan/Vishnu)
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) – PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
- SCP node agent Design Doc for FK phase 2 – (pawan) in-progress
- volume scheduler for Flipkart – (shovan) explore – POC done, Shovan will raise a PR
- velero jr0dd feture request to not send backup to remote location.
- making snapshot available to the original pod – (yashpal/abhranil) – blocked
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal) – blocked
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) – PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- debugging end point – export pprof end point – (yashpal) agent was stuck and could not progress, need to have some debug endpoint.
Oct 25, 2021
Attendees: Pawan, Yashpal, Abhishek
- SCP node agent Design Doc for FK phase 2 – (pawan) in-progress
- volume scheduler for Flipkart – (shovan) explore – POC done, Shovan will raise a PR
- velero jr0dd feture request to not send backup to remote location.
- making snapshot available to the original pod – (yashpal/abhranil) – blocked
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal) – blocked
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) – abhishek – in-process
- debugging end point – export pprof end point – (yashpal) agent was stuck and could not progress, need to have some debug endpoint.
Oct 18, 2021
Attendees: Pawan, Aman, Abhishek
- SCP node agent Design Doc for FK phase 2 – (pawan) in-progress
- volume scheduler for Flipkart – (shovan) explore – design doc done, working on POC
- velero jr0dd feture request to not send backup to remote location.
- making snapshot available to the original pod – (yashpal/abhranil) – blocked
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal) – blocked
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) – abhishek
- register topology key from env for ZFS-LocalPV – (shubham) – merged
- handle topology key in e2e test cases – (aman) need to raise the PR – PR is not required as default behavior is to keep all the node labels as topology key. – done
Oct 11, 2021
Attendees: Pawan, Aman, Prateek
- SCP node agent Design Doc for FK phase 2 – (pawan) in-progress
- volume scheduler for Flipkart – (shovan) explore – design doc done, working on POC
- velero jr0dd feture request to not send backup to remote location.
- making snapshot available to the original pod – (yashpal/abhranil) – blocked
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal)
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)
- register topology key from env for ZFS-LocalPV – (shubham) PR is in review
- handle topology key in e2e test cases – (aman) need to raise the PR.
Oct 04, 2021
Attendees: Pawan, Aman, Shovan, Abhishek
- volume go missing issue on RHEL – done, user closed the issue
- SCP node agent Design Doc for FK phase 2
- volume scheduler for Flipkart – (shovan) explore – design doc done, working on POC
- velero jr0dd feture request to not send backup to remote location.
- making snapshot available to the original pod – (yashpal/abhranil) – blocked
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal)
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)
Sept 27, 2021
Attendees: Pawan, Aman
- Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch. – done
- merge the cherry pick PRs in LVM and ZFS LocalPV – done
- SCP node agent Design Doc for FK phase 2
- volume scheduler for Flipkart – (shovan) explore – design doc done, working on POC
- volume go missing issue on RHEL
- velero jr0dd feture request to not send backup to remote location.
- https://github.com/openebs/lvm-localpv/issues/140 – need to add –enable-capacity arg for csi-provisioner image(aman) – done
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal)
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
Sept 13, 2021
Attendees: Pawan, Aman, Shovan
- Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch.
- merge the cherry pick PRs in LVM and ZFS LocalPV – pending on Pawan
- SCP node agent Design Doc for FK phase 2
- volume scheduler for Flipkart – (shovan) explore – design doc done, working on POC
- raw block test cases for device-localpv – (aman) – in-review (satya) – merged
- CSI storage scheduling issue – need to change the csi-provisioner image for lvm, zfs and device localpv – merged
- https://github.com/openebs/lvm-localpv/issues/140 – need to add –enable-capacity arg for csi-provisioner image(aman) – done
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal)
- roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38) – done
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
Aug 30, 2021
Attendees: Pawan, Aman, Yashpal, Shovan, Sahil, Abhishek
Agenda: using device-localpv for FK phase 2
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- volume scheduler for Flipkart – (shovan) explore – design doc review is in progress
- raw block test cases for device-localpv – (aman) – in-review (satya)
- CSI storage scheduling issue – need to change the csi-provisioner image for lvm, zfs and device localpv
- https://github.com/openebs/lvm-localpv/issues/140 – need to add –enable-capacity arg for csi-provisioner image(aman)
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- CSI volume health monitoring - (pawan/yashpal) – on hold
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- merge device localpv with lvm – not started yet – (pawan)
- thin pool design discussion – (pawan/yashpal)
- roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38)
- propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
Aug 23, 2021
Attendees: Pawan, Sahil, Abhishek, Aman, Yashpal, Vishnu, Shovan
Agenda: https://github.com/openebs/lvm-localpv/issues/134
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- volume scheduler for Flipkart – (shovan) explore – design doc review is in progress
- raw block test cases for device-localpv – (aman) – in-progress
- CSI storage scheduling issue – need to change the csi-provisioner image for lvm, zfs and device localpv
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan/aman) – doc, contributor doc, adopters, setup etc – Done – (aman is working on adopters doc)
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- parted command issue – (Praveen) – done, yashpal already filed two issues
- performance testing for thick and thin volumes – done, need to document it. (pawan/aman) – documented
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) – parked for now
- merge device localpv with lvm – not started yet – (pawan)
- Fix Error Handling On Creation Failure – (pawan/akhil) – done
- thin pool design discussion – (pawan/yashpal)
Aug 16, 2021
Attendees: Pawan, Akhil
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- volume scheduler for Flipkart – (shovan) explore
- raw block test cases for device-localpv – (aman) – in-progress
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline) – parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan/aman) – doc, contributor doc, adopters, setup etc – in-progress – (aman is working on adopters doc)
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- parted command issue – (Praveen)
- performance testing for thick and thin volumes – done, need to document it. (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- Fix Error Handling On Creation Failure – (pawan/akhil)
- thin pool design discussion – (pawan/yashpal)
Aug 9th, 2021
Attendees: Pawan, Shovan, Aman, Akhil, Abhishek, Shubham,
- data migrartion from one node to other – (shovan) – working on operator – prototype is done – parked for now
- data populator design doc – (shovan) – parked for now
- volume scheduler for Flipkart – (shovan) explore
- device-localpv add upgrade test case – (aman) – done
- raw block test cases for device-localpv – (aman)
- lvm corruption issue – (prateek) – working design – (Todo: syncup offline)
- Testing the multi node scenarios
- Moving the disk across the Nodes
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan/aman) – doc, contributor doc, adopters, setup etc – in-progress – (aman is working on adopters doc)
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- parted command issue – (Praveen)
- performance testing for thick and thin volumes – done, need to document it. (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- Fix Error Handling On Creation Failure – (pawan/akhil)
- thin pool design discussion – (pawan/yashpal)
Aug 2nd, 2021
Attendees: Pawan, Shovan, Abhishek, Shubham, Aman, Akhil
- data migrartion from one node to other – (shovan) – working on operator – prototype is done
- data populator design doc – (shovan)
- volume scheduler for Flipkart – (shovan) explore
- e2e test case for device - will be doing manually for this release. – in review (satya) – basic provisioning and custom topology test cases and some chaos testing – done
- device-localpv add upgrade test case – (aman)
- lvm corruption issue – (prateek) – working design – (Todo: syncup offilen)
- Testing the multi node scenarios
- Moving the disk across the Nodes
- Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV – (abhishek) merged
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan/aman) – doc, contributor doc, adopters, setup etc – in-progress – (aman is working on adompters doc)
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- parted command issue – (Praveen)
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- refactoring PR for device localpv – (akhil) – merged
- Fix Error Handling On Creation Failure – (pawan/akhil)
- add test case for stale volume – (pawan/yashpal) megred
- thin pool design discussion – (pawan/yashpal)
July 26th, 2021
Attendees: Pawan, Shovan, Abhishek, Shubham, Sahil, Vishnu
- data migrartion from one node to other – (shovan) – working on operator – prototype is done
- data populator design doc – (shovan)
- volume scheduler for Flipkart – (shovan) explore
- e2e test case for device - will be doing manually for this release. – in review (satya) – basic provisioning and custom topology test cases and some chaos testing
- lvm corruption issue – (prateek) – working design – (Todo: syncup offilen)
- Testing the multi node scenarios
- Moving the disk across the Nodes
- Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV – (abhishek) in-review
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress – (aman is working on adompters doc)
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- parted command issue – (Praveen)
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- refactoring PR for device localpv – (akhil) – in reivew
- add test case for stale volume – (pawan/yashpal) in-review
- thin pool design discussion – (pawan/yashpal)
July 19th, 2021
Attendees: Pawan, Akhil, Shovan, Abhishek, Vishnu, Prateek, Shubham, Praveen, Sahil
- data migrartion from one node to other – (shovan) – working on operator – prototype is done
- data populator design doc – (shovan)
- e2e test case for device - will be doing manually for this release. – in review (satya) – basic provisioning and custom topology test cases and some chaos testing
- add doc for snapshotclass snapsize parameter – (pawan/prateek) – merged
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV – (abhishek) in-review
- Alert for issues on disk (shubham). explore on mapping disks to NPD. – in-progress (blocked on a PR) – merged
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- refactoring PR for device localpv – (akhil) – in reivew
- add test case for stale volume – (pawan/yashpal) in-review
- thin pool design discussion – (pawan/yashpal)
July 12th, 2021
Attendees: Pawan, Akhil, Shovan, Aman, Vishnu, Yashpal, Sahil
- data populators – (Shovan) sample populator – blog is in review by marketing team – published
- data migrartion from one node to other – (shovan) – working on operator – prototype is done
- data populator design doc – (shovan)
- e2e test case for device - will be doing manually for this release. – in review (satya) – basic provisioning and custom topology test cases and some chaos testing
- add doc for snapshotclass snapsize parameter – (pawan/prateek)
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV – (abhishek) in-review
- Alert for issues on disk (shubham). explore on mapping disks to NPD. – in-progress (blocked on a PR)
- CSI volume health monitoring - (pawan/yashpal) – on hold
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal) in-review
- pvc null issue for device localpv – debug (pawan/praveen) – akhil - merged
- thin pool design discussion – (pawan/yashpal)
July 5th, 2021
Attendees: Pawan, Akhil, Shovan, Aman, Shubham, Prateek, Abhishek, Sahil
- data populators – (Shovan) sample populator – blog is in review by marketing team – inprogress
- data migrartion from one node to other – (shovan) – working on design doc, working on operator
- e2e test case for device - will be doing manually for this release. – in review (satya)
- thin provisioning support for snapshots – (prateek) - merged – testing in progress (aman) – verified
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- monitoring for LVM LocalPV – PR is in review (yashpal, vishnu) – merged
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
- Alert for issues on disk (shubham). explore on mapping disks to NPD. – in-progress (blocked on a PR)
- CSI volume health monitoring - (pawan/yashpal) – on hold
- monitoring for device localpv - (abhishek/sahil/yashpal) – merged
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- add docs for snapsize for LVM LocalPV
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- refactoring device localpv – (akhil/praveen)
- add test case for stale volume – (pawan/yashpal) in-progress
- pvc null issue for device localpv – debug (pawan/praveen) – akhil - raise a PR
- pool metrics for LVM LocalPV – (abhishek/sahil) – in-review
- validation while deleting volumes and snapshots for ZFS – (akhil) on hold.
- thin pool design discussion – (pawan/yashpal)
June 28th, 2021
Attendees: Pawan, Abhishek, Shovan, Sahil, Aman, Vishnu, Yashpal, Shubham
- data populators – (Shovan) sample populator – blog is in review by marketing team – inprogress
- data migrartion from one node to other – (shovan) – working on design doc, working on operator
- e2e test case for device - will be doing manually for this release. – in progress
- thin provisioning support for snapshots – (prateek) - merged – testing in progress (aman)
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- monitoring for LVM LocalPV – PR is in review (yashpal, vishnu)
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
- Alert for issues on disk (shubham). explore on mapping disks to NPD. – in-progress
- CSI volume health monitoring - (pawan/yashpal) – on hold
- monitoring for device localpv - (abhishek/sahil/yashpal) – inprogress
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal) in-progress
- pvc null issue for device localpv – debug (pawan/praveen)
- pool metrics for LVM LocalPV – (abhishek/sahil) – in-review
- validation while deleting volumes and snapshots – in-review
June 21th, 2021
Attendees: Pawan, Shubham, Aman, Praveen, Abhishek, Shovan
- data populators – (Shovan) sample populator – blog is in review by marketing team – inprogress
- data migrartion from one node to other – (shovan) – working on design doc
- e2e test case for device - will be doing manually for this release. – in progress
- thin provisioning support for snapshots – (prateek) - in progress
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- monitoring for LVM LocalPV – PR is in review (yashpal, vishnu)
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
- Alert for issues on disk (shubham). explore on mapping disks to NPD.
- CSI volume health monitoring - (pawan/yashpal) – on hold
- monitoring for device localpv - (abhishek) – inprogress
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- make snapshot size configurable via snapshot class – SnapSize (% or absolute) in snapshotclass
- performance testing for thick and thin volumes – todo (pawan/aman)
- thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal) in-progress
- pvc null issue for device localpv – debug (pawan/praveen)
- pool metrics for LVM LocalPV – (abhishek/sahil) – in-progress
June 14th, 2021
Attendees: Abhishek, Abhranil, Yashpal, Praveen, Akhil, Shubham, Shovan, Prateek, Aman, Sahil, Pawan
- stale volume cleanup when inprogress volume gets deleted before provisioing succeed. – (yashpal)
- lib-csi PR merged. WIll update device-localpv – merged
- data populators – (Shovan) sample populator – blog is in review by marketing team – inprogress
- data migrartion from one node to other – (shovan) – working on design doc
- e2e test case for zfs - PR is in review. – merged
- e2e test case for device - will be doing manually for this release.
- lvm corruption issue – (prateek) – working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
- monitoring for LVM LocalPV – PR is in review (yashpal, vishnu)
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
- Alert for issues on disk (shubham). explore on mapping disks to NPD.
- CSI volume health monitoring - (pawan/yashpal) – will explore today.
- Device LocalPV docs(akhil) - in review (praveen) – merged
- monitoring for device localpv
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- make snapshot size configurable via snapshot class
- thin pool + snapshot, how we can reserve space for snapshot.
- performance testing for thin pool
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal) in-progress
June 7, 2021
Attendees: Shubham, Shovam Sahil, Akhil, Sai, Vishnu, Yashpal, Aman
- stale volume cleanup when inprogress volume gets deleted before provisioing succeed. – (yashpal)
- lib-csi PR merged. WIll update device-localpv
- data populators – (Shovan) sample populator – blog is in review by marketing team
- data migrartion from one node to other – (shovan) – started on prototyping
- e2e test case for zfs - PR is in review.
- e2e test case for device - will be doing manually for this release.
- lvm corruption issue – (prateek) in-progress
- Testing the multi node scenarios
- Moving the disk across the Nodes
- monitoring for LVM LocalPV
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
- Alert for issues on disk (shubham). explore on mapping disks to NPD.
- CSI volume health monitoring - (pawan/yashpal) – will explore today
- Device LocalPV docs(akhil) - in review (praveen)
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- add CSI Storage capacity scheduling for ZFS-LocalPV (shubham) - merged
- making snapshot available to the original pod – (yashpal/abhranil) – in-progress
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal) in-progress
- support online resize for btrfs – (sai) - merged
May 31st 2021
Attendees: Pawan, Shubham, Akhil, Shovan, Aman, Prateek
-
stale volume cleanup when inprogress volume gets deleted before provisioing succeed. – (yashpal) – in review (prateek, akhil, shubham, pawan)
-
data populators – (Shovan) sample populator – blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
-
data migrartion from one node to other – (shovan) – yet to start
-
master helm chart – https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) – PR raised – approved – merged
-
Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue – closed
-
e2e test case for lvm – in progress (aman)– done
-
e2e test case for zfs – pr in review (aman) – will be done by RC1
-
e2e test case for device – yet to start (aman) – yet to start
-
lvm corruption issue – (prateek) in-progress
-
monitoring for LVM LocalPV
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – in-progress
-
CSI volume health monitoring – (pawan/yashpal) – explore
-
Device LocalPV docs (akhil) – feature doc and CSI compatibility doc – in-progress
-
LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
-
add CSI Storage capacity scheduling for ZFS-LocalPV – (Shubham) – in-review (pawan/akhil)
-
making snapshot available to the original pod – (yashpal/abhranil) – in-progress
-
merge device localpv with lvm – not started yet – (pawan)
-
add test case for stale volume – (pawan/yashpal)
-
verify volume capability – (sai) – PR merged
-
wipefs when we are deleting the lvm volume – (sai) – merged
-
support online resize for btrfs – (sai) – in-progress
May 24th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Yashpal, Praveen, Sai
- stale volume cleanup when inprogress volume gets deleted before provisioing succeed. – (yashpal) – in review (prateek, akhil, shubham, pawan)
- data populators – (Shovan) sample populator – blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
- master helm chart – https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) – PR raised – approved – waiting on kiran to merge
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
- e2e test case for lvm – in progress (aman)
- e2e test case for zfs – pr in review (aman)
- e2e test case for device – yet to start (aman)
- lvm corruption issue – (prateek) in-progress
- make PV migration completely automatic – (pawan) – in design
- monitoring for LVM LocalPV
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – in-progress
- CSI volume health monitoring – (pawan/?) – explore
- an issue including list of metrics needed – (yashpal) – done
- Device LocalPV docs (akhil) – feature doc and CSI compatibility doc – in-progress
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc – in-progress
- add CSI Storage capacity scheduling for ZFS-LocalPV – (Shubham) – in-review (pawan/akhil)
- making snapshot available to the original pod – (yashpal/abhranil) – waiting for the backup team
- merge device localpv with lvm – not started yet – (pawan)
- add test case for stale volume – (pawan/yashpal)
- verify volume capability – (sai)
- wipefs when we are deleting the volume – (sai)
- support resize for btrfs – (?)
May 17th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Kiran, Abhishek, Abhranil, Yashpal, Sahil
- stale volume cleanup when inprogress volume gets deleted before provisioing succeed. – (yashpal) – inprogress
- data populators – (Shovan) sample populator – blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
- master helm chart – https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) – PR raised – review inprogress
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
- helm chart for LVM localPV – setup (prateek) – PR merged.
- make PV migration completely automatic – (pawan) – in design
- monitoring for LVM LocalPV
- logging (Ashish) – logs monitoring
- metrics () – add grafana chart – in-progress
- CSI volume health monitoring – (pawan/?) – explore
- an issue including list of metrics needed – (yashpal)
- Device LocalPV docs (akhil) – feature doc and CSI compatibility doc
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc
- add CSI Storage capacity scheduling for ZFS-LocalPV – (Shubham)
- making snapshot available to the original pod – (yashpal/abhranil)
- merge device localpv with lvm – not started yet – (pawan)
- merge e2e test cases in the repo for lvm/zfs. – (aman)
May 10th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Shovan
- thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize. – merged
- data populators – (Shovan) sample populator – blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
- master helm chart – https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) – PR raised
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
- helm chart for LVM localPV – setup (prateek)
- make PV migration completely automatic – (pawan)
- monitoring for LVM LocalPV (pawan) – add grafana chart – not started
- Device LocalPV docs (akhil) – feature doc and CSI compatibility doc
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc
- add CSI Storage capacity scheduling for ZFS-LocalPV – (Shubham)
- merge device localpv with lvm
- merge e2e test cases in the repo for lvm/zfs.
May 3rd 2021
Attendees: Pawan, Aman, Akhil, Shovan, Praveen, Shubham, Prateek
- thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
- data populators – (Shovan) sample populator – blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
- master helm chart – https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan)
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
- update go mod to 1.4.0 for lvm-localpv – (prateek) – merged
- check the snapshot when original volume has already been deleted – (akhil) merged
- support node migration of the lvm/zfs disks – (pawan). PR already raised for ZFS. pr merged for zfs.
- add helm chart for lvm localpv – (yashpal) – in review (akhil/shubham/prateek) – a new PR be raised with github workflow for helm lint and releaser (prateek)
- monitoring for LVM LocalPV (pawan) – add grafana chart – not started
- Device LocalPV docs (akhil) – feature doc and CSI compatibility doc
- LVM LocalPV docs (pawan) – doc, contributor doc, setup etc
- device localpv refactoring – Praveen
- add CSI Storage capacity scheduling for ZFS-LocaPV
- merge device localpv with lvm
April 26th 2021
Attendees: Pawan, Aman, Akhil, Shubham, Shovan
- data populators – (Shovan) sample populator – blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
- multi pool support for lvm (praveen/yashpal) – (pawan) merged.
- Need to update the docs (aman)
- thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
- update go mod to 1.4.0 for lvm-localpv – (prateek)
- check the snapshot when original volume has already been deleted – (akhil) in progress
- support node migration of the lvm/zfs disks – (pawan). PR already raised for ZFS.
- add helm chart for lvm localpv – (yashpal) – in review (akhil/shubham/prateek)
- monitoring for LVM LocalPV (pawan) – add grafana chart – not started
- Device LocalPV docs (akhil) – feature doc and CSI compatibility doc
- device localpv refactoring – Praveen
April 19th 2021
Attendees: Pawan, Aman, Prateek, Akhil, Shubham
- data populators – (Shovan) sample populator –
- Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
- multi pool support for lvm (praveen/yashpal) – (pawan) merged.
- thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
- check the snapshot when original volume has already been deleted – (akhil) – next release
- support node migration of the lvm/zfs disks – (pawan). PR already raised for ZFS.
- add helm chart for lvm localpv – (yashpal) – in review (akhil/shubham)
- monitoring for LVM LocalPV (pawan)
- Device LocalPV docs (akhil)
April 12th 2021
Attendees: Pawan, Prateek, shubham, Akhil, Shovan, Abhranil, Aman
- data populators – (Shovan) sample populator
- multi pool support for lvm (praveen/yashpal) – (pawan) review – pushed to next release
- thin provisioning for lvm volumes – prateek – merged
- check the snapshot when original volume has already been deleted – (akhil) – next release
- support node migration of the lvm disks – (pawan) – in progress
- add helm chart for lvm localpv – (yashpal)
April 5th 2021
Attendees: Pawan, Prateek, Aman, Akhil, Shovan, Praveen
- device localpv make kubegen issue – done
- ginko test cases for device localpv – done (akhil)
- add device support for volumes – done (praveen/akhil) in alpha
- multi pool support for lvm (praveen/yashpal) – (pawan) review
- thin provisioning for lvm volumes – prateek – in-review(pawan)
- bump k8s for zfs/lvm – in review (prateek) – done
- check the snapshot when original volume has already been deleted – (akhil) – next release
- support node migration of the lvm disks – (pawan) – in progress
- add helm chart for lvm localpv – (yashpal)
Mar 30th 2021
- device localpv make kubegen issue – akhil, pawan
- ginko test cases for device localpv – pawan
- add device support for volumes (provisioning/deprovisioning) – (pawan/praveen) inprogress
- multi pool support for lvm (praveen/yashpal) – (pawan) review
- test the device CSI driver and see if are we getting the grpc call – done
- making snapshots available to the source pod – investigation (praveen/pawan) – poc is done
- thin provisioning for lvm volumes – prateek – in-review(pawan)
- bump k8s for zfs/lvm – in review (pawan)
- check the snapshot when original volume has already been deleted – (akhil)
- support node migration of the lvm disks – (pawan)
Mar 19th 2021
- add device support for volumes (provisioning/deprovisioning) – (pawan/praveen) started
- multi pool support for lvm (praveen/yashpal) – (pawan) review
- add docs for lvm – how to add custom node label (akhil)
- test the device CSI driver and see if are we getting the grpc call – (pawan)
- making snapshots available to the source pod – investigation (praveen/pawan) – poc is done
- thin provisioning for lvm volumes – prateek
- bump k8s for zfs/lvm
- check the snapshot when original volume has already been deleted – (akhil)
- support node migration of the lvm disks – (pawan)
Mar 12th 2021
Attendees: Pawan, Aman, Akhil, Prateek
- support restore in an encrypted pool – merged
- setup ubuntu 20 to have encryption support – done
- iops throttling explore (Abhranil) – done – pending item : iops throttling for block devices
- add volume group capacity tracking – done
- add device support for volumes (provisioning/deprovisioning) – (pawan/praveen) started yet
- multi pool support for lvm (praveen/yashpal) – under-review
- add docs for lvm
- making snapshots available to the source pod – investigation (praveen/pawan) – poc is done
- thin provisioning for lvm volumes – prateek
- bump k8s for zfs
Mar 5th 2021
Attendees: Pawan, Aman, Akhil, Shubham Yashpal, Prateek
- support restore in an encrypted pool – in-Review (kiran) zfs is merged, velero PR is still pending
- setup ubuntu 20 to have encryption support – tested(aman)
- iops throttling explore (Abhranil) – done – pending item : iops throttling for block devices
- add volume group capacity tracking – done – in-review (pawan/akhil/prateek)
- e2e PR for LVM – done
- wait for volume to be created (zfs) – in-review (kiran) – pushed for next release
- return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 – done
- thin provisioning support for lvm volumes – (pawan/prateek) https://github.com/openebs/lvm-localpv/pull/30
- add device support for volumes (provisioning/deprovisioning) – (praveen) not started yet
- multi pool support for lvm/zfs (praveen/yashpal) not started yet – under-review
- making snapshots available to the source pod – investigation (praveen/pawan) – poc is done
Mar 2nd 2021
Attendees: Pawan, Aman, Akhil, Abhranil, Praveen, Yashpal, Prateek
- encryption backward compatibility test – done
- support restore in an encrypted pool – in-Review (kiran) zfs is merged, velero PR is still pending
- setup ubuntu 20 to have encryption support – tested(aman)
- iops throttling explore (Abhranil) – in-review (pawan/akhil) – lib-csi PR is merged
- add volume group capacity tracking – in-review (pawan/akhil/prateek)
- e2e PR for LVM – in review
- wait for volume to be created (zfs) – in-review (kiran) – pushed for next release
- return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 – in-review (pawan)
- thin provsioning support for lvm volumes – (pawan/prateek)
- add device support for volumes (provisioning/deprovisioning) – (praveen) not started yet
- multi pool support for lvm/zfs (praveen/yashpal) not started yet
- making snapshots available to the source pod – investigation (praveen/pawan)
Feb 19th 2021
Attendees: Pawan, Aman, Prateek, Abranil
- encryption backward compatibility test
- support restore in an encrypted pool – in-Review (kiran)
- setup ubuntu 20 to have encryption support
- iops throttling explore (Abhranil) – in-review (pawan/akhil) – lib-csi PR is merged
- add volume group capacity tracking – in-review (pawan/akhil)
- wait for volume to be created (zfs) – in-review (kiran) – pushed for next release
- return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 – in-review (pawan)
- thin provsioning support for lvm volumes – (pawan) – pushed for next release
- add device support for volumes (provisioning/deprovisioning) – (preveen) not started yet
- multi pool support for lvm/zfs (praveen/yashpal) not started yet
- making snapshots available to the source pod – investigation (praveen/pawan)
e2e:
- have basic test cases for provisioning/deprovisioning
- BDD test cases
Doc:
- Doc for provisioning/deprovisioning
- Resize
- raw block volume
- doc custom topology
- snapshot
Feb 12th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal
- iops throttling explore (Abhranil) – in-review (pawan/akhil)
- add volume group capacity tracking – in-review (pawan/akhil)
- capacity based scheduler for LVM – done
- snapshot support for LVM (akhil) – done
- wait for volume to be created (zfs) – in-review (kiran) – pushed for next release
- return proper error while creating the volume (yashpal/pawan)
- lvm volumes not visible on the host – (debug pawan/praveen/yashpal) – lvdisplay command has some issue – pvscan –cached
- thin provsioning support for lvm volumes – (pawan) – pushed for next release
- add device support for volumes (provisioning/deprovisioning) – not started yet
- multi pool support for lvm/zfs (praveen/yashpal)
- making snapshots available to the source pod – investigation (praveen/pawan)
Feb 5th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal, Prateek
- iops throttling explore (Abhranil) – in-progress
- snapshot support for LVM (akhil) – in-review (pawan)
- wait for volume to be created (zfs) – in-review (kiran)
- lvm volumes not visible on the host – (debug pawan/praveen/yashpal) – lvdisplay command has some issue – pvscan –cached
- look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity – (yashpal)
- thin provsioning support for lvm volumes – (pawan)
- capacity based scheduler for LVM
- add device support for volumes (provisioning/deprovisioning) – not started yet
- add clone support for LVM LocalPV – discuss Design
- multi pool support for lvm/zfs (praveen/yashpal)
Jan 29th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen
- snapshot support for LVM (akhil) – in-review (pawan)
- wait for volume to be created (zfs) – in-review (kiran)
- lvm volumes not visible on the host – (debug pawan/praveen) – lvdisplay command has some issue
- raw block volume support for LVM – in-review (akhil/kiran)
- look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity – (pawan/praveen)
- iops throttling explore (Abhranil) – in-progress
- thin provsioning support for lvm volumes – (pawan)
- add device support for volumes (provisioning/deprovisioning)
- add clone support for LVM LocalPV – discuss Design
- multi pool support for lvm/zfs (praveen)
Jan 25th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil,
- snapshot support for LVM (akhil) – in-progress – use latest CR
- add clone support for LVM LocalPV – To Do
- wait for volume to be created (zfs)– look at csi-provsioner for stale volume issue (corner case)
- lvm volumes not visible on the host – (debug pawan/praveen)
- raw block volume support for LVM – (pawan)
- look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity – (pawan/praveen)
- iops throttling explore (Abhranil) – in-progress
Jan 15th 2021
- LVM 0.1 release available
- wait for volume to be created – (pawan)
- lvm volumes not visible on the host – (debug pawan/praveen)
- snapshot support for LVM (akhil) – in-progress
- look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity – (pawan/praveen)
- iops throttling explore (Abhranil) – in-progress
- add clone support for LVM LocalPV – (pawan/akhil)
- lvm provisioner name : local.csi.openebs.io
Jan 8th 2021
- wait for volume to be created – (pawan)
- capacity based scheduler for LVM – (praveen)
- lvm volumes not visible on the host – (debug pawan/praveen)
- setup on debian - dependency checks ( pawan )
- move pkg/response to csi-resize
- snapshot support for LVM (akhil)
- resize PR review (praveen)
- look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity – (pawan/praveen)
- iops throttling explore (Abhranil)
Dec 30th 2020
Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil,
- backup and restore using different bucket – manual verification done
- blog on incremental backup/restore – in progress (pawan)
- migrate the e2e test cases to ZFS-LocalPV – in progress work started
- helm chart for ZFS Local PV – in progress ( pending review from Kiran/Prateek)
- setup on debian - dependency checks ( praveen / pawan )
- LVM CSI Driver – in progress
- extract the common packages into openebs/lib-csi ( pawan ) – done
- capacity based scheduler for ZFS-LocalPV (pawan)
- iops throttling explore
- lvm-driver : lvm volumes are not visible on the host – try lvrescan
- lvm name length, CSI sanity issue
- lvm resize support – (pawan)
Dec 18th 2020
Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil, Kiran
- blog on incremental backup/restore – in progress
- backup and restore using different bucket
- migrate the e2e test cases to ZFS-LocalPV – in progress - schedule a meeting on Monday
- helm chart for ZFS Local PV – in progress ( pending review from Kiran/Prateek)
- setup on debian - dependency checks ( praveen / pawan )
- LVM CSI Driver – in progress
- extract the common packages into openebs/lib-csi ( pawan )
- lvm-localpv
- capacity based scheduler for ZFS-LocalPV (pawan)
Dec 11th 2020
Attendees: Pawan, Aman
- blog on incremental backup/restore – in progress
- restore in diff ns – done
- incremental backup – done
- pvc clone testing – done
- refactor the README – in progress
- raise a pr in velero-plugin to fix change-pvc-node-selector config label
- readme PR review – Aman
Dec 4th 2020
Attendees: Pawan, Aman
- kustomize testing – done
- blog on incremental backup/restore – in progress
- code refactoring, no functionality will be added
- have to run a pipeline with the ci – done
- restore in diff ns – in review
- incremental backup – in review
- pvc clone testing – in review
- refactor the README – in progress
- raise a pr in velero-plugin to fix change-pvc-node-selector-config label
Nov 20th 2020
Attendees: Pawan, Aman
this release
-
code refactoring, no functionality will be added
-
document update
-
doc update : restore on a diff node
-
refactor the README
-
multi arch image testing – done
-
put the question in the velero channel regarding snapshotter error – no reply
-
kustomize testing – in progress
-
pvc clone testing – done
-
parallel upgrade testing – done
-
blog on incremental backup/restore – in progress
Nov 13th 2020
Attendees: Pawan, Aman
- multi arch image testing
- put the question in the velero channel regarding snapshotter error
- kustomize testing
- pvc clone testing
- parallel upgrade testing
- blog on incremental backup/restore
Oct 16th 2020
Attendees: Pawan, Aman
e2e test :
- incremental backup/restore (ee and community) - manual testing done
- restore on different node (ee and community) - manual testing done
- scheduled backup/restore - manual testing done
- full backup/restore - done
- upgrade testing : velero upgrade from 2.1.0 - to 2.2.0 and test the scheduled backup/restore
- test on s3 storage
- future goal : test on different cluster
Development:
- BDD for backup/restore
- multi arch build
- support NFS for ZFS-LocalPV
- CSI driver Sanity test
- deployment via kustomize
- any issue/bug fixes.
Oct 9th 2020
Attendees: Pawan, Aman, Giri
RC-1 Test cases test upgrade :
create schdedule backup/restore from old version and then upgrade to RC1.
- There should not be any issue
- restore should work for old as well as for the new backups
- check the storage directory size, the size should be less
- test on s3 storage
- future goal : test on different cluster
Automated
- restore in same namespace
- restore in other namespace
- schedule backup test cases
Sept 18th 2020
Attendees: Pawan, Aman, Kiran
-
create issues :-
-
deployment via kustomize
-
capacity based scheduling
-
grafana charts for ZPOOL capacity and component / driver status
-
recover volumes from cluster/node disaster recovery = when there are no backup of zfs volume CRs
-
Validations - stop from making accidental deletions (namespace or CR deletions) ( webhook or OPA is required )
-
Node is gone and disks are moved to new node. Recreate the PV. (new operator to auto-detect and recover)
-
Monitor and replace failed Disk (NDM )
-
Backup/Restore without velero dependency
-
CSI Driver test
-
Unit Test cases
-
Integration Tests
- Validations - stop from making accidental deletions (namespace or CR deletions)
-
E2e issues?
- volume count based scheduling
-
Possible Refacotring Ideas to support multiple (local) backends
- (approach 1) openebs/local-csi. take the code from ZFS Local PV and modularize. Add support for lvm, rawfile
- (approach 2)
- openebs/lib-storage-scheduling. code for picking up the node to provision storage. support volume count, capacity based.
- openebs/zfs-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
- openebs/rawfile-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
- openebs/dynamic-localpv = use the openebs/lib-storage-scheduling
Sept 11th 2020
Attendees: Pawan, Aman
- Backup and restore Development (as alpha feature)
- intial changes are merged
- add support to restore on different cluster
- add support for incremental backup/restore
- Backup and restore Development test cases update test cases on the wiki
Sept 4th 2020
Attendees: Pawan, Aman
- Backup and restore Development (as alpha feature) :
- velero side changes has been approved
- zfs-localpv side changes are under review)
- incremental backup/restore is under development
- e2e
- test case for upgrade – done
- backup and restore via velero (test plan @aman)
- node failure scenario (@aman) – done
- one yaml for all OS platform ubuntu, centos 7/8, k3s (if possible)
- 1.0 will be GA release – in-progress
- wiki page done (@aman)
Aug 28th 2020
Holiday
Aug 21st 2020
Attendees: Pawan, Aman
- backup and restore via velero (test plan @aman)
- node failure scenario (@aman) – in-progress
- 1.0 will have backup and restore and helm support – in-progress
- 1.0 will be GA release – in-progress
- roundoff fix testing – manual testing done
- wiki page inprogress (@aman)
Aug 14th 2020
Attendees: Pawan, Aman
- backup and restore via velero (test plan @aman)
- 0.9.1 release on 15th of Aug – done
- patch the fixes in 0.9x branch – done
- 1.0 will have backup and restore and helm support – in-progress
- 1.0 will be GA release – in-progress
- enable enterprise test case on centos clone on xfs – in-progress
- operator yaml testing on k8s 1.14 – done
- roundoff fix testing – manual testing done
- wiki page inprogress (@aman)
Aug 7th, 2020
Attendees: Pawan, Aman, Kiran, Vishnu
- 0.9.1 release on 15th of Aug
- patch the fixes in 0.9x branch
- 1.0 will have backup and restore and helm support
- 1.0 will be GA release
- enable enterprise test case on centos clone on xfs
- operator yaml testing on k8s 1.14
- roundoff fix testing
- wiki page inprogress (@aman)
July 31st, 2020
Attendees: Pawan, Aman
- wiki page inprogress (@aman)
- pipeline script needs to change to accomodate the path change
- backup/restore velero side changes are done
- compiling spl on centos 8, struct has been changed here, causing compilation failure
- zfs crash found in Optoro (seems to be version incompatibility issue)
- shared mount using busybox (done)
- bloomberg performance issue with ZFS-LocalPV (tunables to improve performance) (@aman)
July 17th, 2020
Attendees: Pawan, Aman, Kiran
Discussions
- Automation of zpool creation [@pawan]
- Focus on chaos testing along with functional tests
- Link the test cases running in pipeline to the automated test scripts. (With READme's in master branch)
- Update the wiki page for QA with all plateforms and k8s and zfs versions.
June 5th, 2020
Attendees: Pawan, Aman, Kiran
Discussions
-
Review/triage the ZFS Local PV tracker
-
Review/triage the ZFS Local PV E2e tests tracker
- Review existing tests and add them to the ZFS Local PV wiki.
- Initial draft is available for review.
-
Install and OS compabilitly
- Attempted to mount /lib and /lib64 - some more validation is required before going with this approach.
- Going with different YAMLs approach for now.
- Helm charts will be made available in the next release. (1.12)
May 22nd, 2020
Attendees: Pawan, Aman, Kiran
Discussions
-
Review/triage the ZFS Local PV tracker
-
Review/triage the ZFS Local PV E2e tests tracker
- Review existing tests and add them to the ZFS Local PV wiki.
-
Install and OS compabilitly
- Need different YAMLs for each OS
- Need travis yaml for building OS specific images
- Helm to include variables for each OS
May 8th, 2020
Attendees: Pawan, Aman, Kiran
Agenda
- [Kiran] Review Backlogs https://github.com/orgs/openebs/projects/10
- [Pawan] ZFS bug with unmount RCA is still under investigation. Will reach out to ZFS community
- [Pawan] Check on the missing metrics and check if PRs can be raised to Node Exporter
- [Aman] E2e for Raw Block
- [Aman] E2e. Manually verified the kubelet and docker restarts
- [Aman] E2e. Bulk volume testing automation is in progress
- [Kiran] Helm / openebs operator to include ZFS Local PV (not started)
- [Aman] ZFS Grafana Dashboard
- Blocked with onprem grafana/prometheus setup
- [Pawan/Kiran] Moving Local PVs?
- Working on a doc for migrating PVs to new node, when underyling disks are moved to new node.