OpenEBS CSI Local PV Discussions Notes

Add your request, question or suggestion to our issue list

If you have anything you’d like to put on the agenda, please do so below for the next meeting:

Nov 29, 2021

Attendees: Pawan, Abhishek

  1. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) abhishek design doc (https://docs.google.com/document/d/13D8Ht__66n66c5ZBThPwqhKjyJey0GFKVO3dgK3w8OA/edit) is in review (pawan/Vishnu)
  2. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
  3. SCP node agent Design Doc for FK phase 2 (pawan) in-progress
  4. volume scheduler for Flipkart (shovan) explore POC done, Shovan will raise a PR
  5. velero jr0dd feture request to not send backup to remote location.
  6. making snapshot available to the original pod (yashpal/abhranil) blocked
  7. merge device localpv with lvm not started yet (pawan)
  8. thin pool design discussion (pawan/yashpal) blocked
  9. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
  10. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  11. data populator design doc (shovan) parked for now
  12. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  14. debugging end point export pprof end point (yashpal) agent was stuck and could not progress, need to have some debug endpoint.

Oct 25, 2021

Attendees: Pawan, Yashpal, Abhishek

  1. SCP node agent Design Doc for FK phase 2 (pawan) in-progress
  2. volume scheduler for Flipkart (shovan) explore POC done, Shovan will raise a PR
  3. velero jr0dd feture request to not send backup to remote location.
  4. making snapshot available to the original pod (yashpal/abhranil) blocked
  5. merge device localpv with lvm not started yet (pawan)
  6. thin pool design discussion (pawan/yashpal) blocked
  7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  8. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  9. data populator design doc (shovan) parked for now
  10. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) abhishek in-process
  13. debugging end point export pprof end point (yashpal) agent was stuck and could not progress, need to have some debug endpoint.

Oct 18, 2021

Attendees: Pawan, Aman, Abhishek

  1. SCP node agent Design Doc for FK phase 2 (pawan) in-progress
  2. volume scheduler for Flipkart (shovan) explore design doc done, working on POC
  3. velero jr0dd feture request to not send backup to remote location.
  4. making snapshot available to the original pod (yashpal/abhranil) blocked
  5. merge device localpv with lvm not started yet (pawan)
  6. thin pool design discussion (pawan/yashpal) blocked
  7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  8. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  9. data populator design doc (shovan) parked for now
  10. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) abhishek
  13. register topology key from env for ZFS-LocalPV (shubham) merged
  14. handle topology key in e2e test cases (aman) need to raise the PR PR is not required as default behavior is to keep all the node labels as topology key. done

Oct 11, 2021

Attendees: Pawan, Aman, Prateek

  1. SCP node agent Design Doc for FK phase 2 (pawan) in-progress
  2. volume scheduler for Flipkart (shovan) explore design doc done, working on POC
  3. velero jr0dd feture request to not send backup to remote location.
  4. making snapshot available to the original pod (yashpal/abhranil) blocked
  5. merge device localpv with lvm not started yet (pawan)
  6. thin pool design discussion (pawan/yashpal)
  7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  8. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  9. data populator design doc (shovan) parked for now
  10. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)
  13. register topology key from env for ZFS-LocalPV (shubham) PR is in review
  14. handle topology key in e2e test cases (aman) need to raise the PR.

Oct 04, 2021

Attendees: Pawan, Aman, Shovan, Abhishek

  1. volume go missing issue on RHEL done, user closed the issue
  2. SCP node agent Design Doc for FK phase 2
  3. volume scheduler for Flipkart (shovan) explore design doc done, working on POC
  4. velero jr0dd feture request to not send backup to remote location.
  5. making snapshot available to the original pod (yashpal/abhranil) blocked
  6. merge device localpv with lvm not started yet (pawan)
  7. thin pool design discussion (pawan/yashpal)
  8. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  9. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  10. data populator design doc (shovan) parked for now
  11. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  13. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)

Sept 27, 2021

Attendees: Pawan, Aman

  1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch. done
  2. merge the cherry pick PRs in LVM and ZFS LocalPV done
  3. SCP node agent Design Doc for FK phase 2
  4. volume scheduler for Flipkart (shovan) explore design doc done, working on POC
  5. volume go missing issue on RHEL
  6. velero jr0dd feture request to not send backup to remote location.
  7. https://github.com/openebs/lvm-localpv/issues/140 need to add enable-capacity arg for csi-provisioner image(aman) done
  8. making snapshot available to the original pod (yashpal/abhranil) in-progress
  9. merge device localpv with lvm not started yet (pawan)
  10. thin pool design discussion (pawan/yashpal)
  11. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  12. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  13. data populator design doc (shovan) parked for now
  14. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  15. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now

Sept 13, 2021

Attendees: Pawan, Aman, Shovan

  1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch.
  2. merge the cherry pick PRs in LVM and ZFS LocalPV pending on Pawan
  3. SCP node agent Design Doc for FK phase 2
  4. volume scheduler for Flipkart (shovan) explore design doc done, working on POC
  5. raw block test cases for device-localpv (aman) in-review (satya) merged
  6. CSI storage scheduling issue need to change the csi-provisioner image for lvm, zfs and device localpv merged
  7. https://github.com/openebs/lvm-localpv/issues/140 need to add enable-capacity arg for csi-provisioner image(aman) done
  8. making snapshot available to the original pod (yashpal/abhranil) in-progress
  9. merge device localpv with lvm not started yet (pawan)
  10. thin pool design discussion (pawan/yashpal)
  11. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38) done
  12. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
  13. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  14. data populator design doc (shovan) parked for now
  15. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  16. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now

Aug 30, 2021

Attendees: Pawan, Aman, Yashpal, Shovan, Sahil, Abhishek

Agenda: using device-localpv for FK phase 2

  1. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  2. data populator design doc (shovan) parked for now
  3. volume scheduler for Flipkart (shovan) explore design doc review is in progress
  4. raw block test cases for device-localpv (aman) in-review (satya)
  5. CSI storage scheduling issue need to change the csi-provisioner image for lvm, zfs and device localpv
  6. https://github.com/openebs/lvm-localpv/issues/140 need to add enable-capacity arg for csi-provisioner image(aman)
  7. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. making snapshot available to the original pod (yashpal/abhranil) in-progress
  10. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  11. merge device localpv with lvm not started yet (pawan)
  12. thin pool design discussion (pawan/yashpal)
  13. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38)
  14. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)

Aug 23, 2021

Attendees: Pawan, Sahil, Abhishek, Aman, Yashpal, Vishnu, Shovan

Agenda: https://github.com/openebs/lvm-localpv/issues/134

  1. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  2. data populator design doc (shovan) parked for now
  3. volume scheduler for Flipkart (shovan) explore design doc review is in progress
  4. raw block test cases for device-localpv (aman) in-progress
  5. CSI storage scheduling issue need to change the csi-provisioner image for lvm, zfs and device localpv
  6. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. CSI volume health monitoring - (pawan/yashpal) on hold
  8. LVM LocalPV docs (pawan/aman) doc, contributor doc, adopters, setup etc Done (aman is working on adopters doc)
  9. making snapshot available to the original pod (yashpal/abhranil) in-progress
  10. parted command issue (Praveen) done, yashpal already filed two issues
  11. performance testing for thick and thin volumes done, need to document it. (pawan/aman) documented
  12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) parked for now
  13. merge device localpv with lvm not started yet (pawan)
  14. Fix Error Handling On Creation Failure (pawan/akhil) done
  15. thin pool design discussion (pawan/yashpal)

Aug 16, 2021

Attendees: Pawan, Akhil

  1. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  2. data populator design doc (shovan) parked for now
  3. volume scheduler for Flipkart (shovan) explore
  4. raw block test cases for device-localpv (aman) in-progress
  5. lvm corruption issue (prateek) working design (Todo: syncup offline) parked for now
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. CSI volume health monitoring - (pawan/yashpal) on hold
  7. LVM LocalPV docs (pawan/aman) doc, contributor doc, adopters, setup etc in-progress (aman is working on adopters doc)
  8. making snapshot available to the original pod (yashpal/abhranil) in-progress
  9. parted command issue (Praveen)
  10. performance testing for thick and thin volumes done, need to document it. (pawan/aman)
  11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  12. merge device localpv with lvm not started yet (pawan)
  13. Fix Error Handling On Creation Failure (pawan/akhil)
  14. thin pool design discussion (pawan/yashpal)

Aug 9th, 2021

Attendees: Pawan, Shovan, Aman, Akhil, Abhishek, Shubham,

  1. data migrartion from one node to other (shovan) working on operator prototype is done parked for now
  2. data populator design doc (shovan) parked for now
  3. volume scheduler for Flipkart (shovan) explore
  4. device-localpv add upgrade test case (aman) done
  5. raw block test cases for device-localpv (aman)
  6. lvm corruption issue (prateek) working design (Todo: syncup offline)
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. CSI volume health monitoring - (pawan/yashpal) on hold
  8. LVM LocalPV docs (pawan/aman) doc, contributor doc, adopters, setup etc in-progress (aman is working on adopters doc)
  9. making snapshot available to the original pod (yashpal/abhranil) in-progress
  10. parted command issue (Praveen)
  11. performance testing for thick and thin volumes done, need to document it. (pawan/aman)
  12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  13. merge device localpv with lvm not started yet (pawan)
  14. Fix Error Handling On Creation Failure (pawan/akhil)
  15. thin pool design discussion (pawan/yashpal)

Aug 2nd, 2021

Attendees: Pawan, Shovan, Abhishek, Shubham, Aman, Akhil

  1. data migrartion from one node to other (shovan) working on operator prototype is done
  2. data populator design doc (shovan)
  3. volume scheduler for Flipkart (shovan) explore
  4. e2e test case for device - will be doing manually for this release. in review (satya) basic provisioning and custom topology test cases and some chaos testing done
  5. device-localpv add upgrade test case (aman)
  6. lvm corruption issue (prateek) working design (Todo: syncup offilen)
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV (abhishek) merged
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. LVM LocalPV docs (pawan/aman) doc, contributor doc, adopters, setup etc in-progress (aman is working on adompters doc)
  10. making snapshot available to the original pod (yashpal/abhranil) in-progress
  11. parted command issue (Praveen)
  12. performance testing for thick and thin volumes todo (pawan/aman)
  13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  14. merge device localpv with lvm not started yet (pawan)
  15. refactoring PR for device localpv (akhil) merged
  16. Fix Error Handling On Creation Failure (pawan/akhil)
  17. add test case for stale volume (pawan/yashpal) megred
  18. thin pool design discussion (pawan/yashpal)

July 26th, 2021

Attendees: Pawan, Shovan, Abhishek, Shubham, Sahil, Vishnu

  1. data migrartion from one node to other (shovan) working on operator prototype is done
  2. data populator design doc (shovan)
  3. volume scheduler for Flipkart (shovan) explore
  4. e2e test case for device - will be doing manually for this release. in review (satya) basic provisioning and custom topology test cases and some chaos testing
  5. lvm corruption issue (prateek) working design (Todo: syncup offilen)
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV (abhishek) in-review
  7. CSI volume health monitoring - (pawan/yashpal) on hold
  8. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress (aman is working on adompters doc)
  9. making snapshot available to the original pod (yashpal/abhranil) in-progress
  10. parted command issue (Praveen)
  11. performance testing for thick and thin volumes todo (pawan/aman)
  12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  13. merge device localpv with lvm not started yet (pawan)
  14. refactoring PR for device localpv (akhil) in reivew
  15. add test case for stale volume (pawan/yashpal) in-review
  16. thin pool design discussion (pawan/yashpal)

July 19th, 2021

Attendees: Pawan, Akhil, Shovan, Abhishek, Vishnu, Prateek, Shubham, Praveen, Sahil

  1. data migrartion from one node to other (shovan) working on operator prototype is done
  2. data populator design doc (shovan)
  3. e2e test case for device - will be doing manually for this release. in review (satya) basic provisioning and custom topology test cases and some chaos testing
  4. add doc for snapshotclass snapsize parameter (pawan/prateek) merged
  5. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV (abhishek) in-review
  7. Alert for issues on disk (shubham). explore on mapping disks to NPD. in-progress (blocked on a PR) merged
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  10. making snapshot available to the original pod (yashpal/abhranil) in-progress
  11. performance testing for thick and thin volumes todo (pawan/aman)
  12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  13. merge device localpv with lvm not started yet (pawan)
  14. refactoring PR for device localpv (akhil) in reivew
  15. add test case for stale volume (pawan/yashpal) in-review
  16. thin pool design discussion (pawan/yashpal)

July 12th, 2021

Attendees: Pawan, Akhil, Shovan, Aman, Vishnu, Yashpal, Sahil

  1. data populators (Shovan) sample populator blog is in review by marketing team published
  2. data migrartion from one node to other (shovan) working on operator prototype is done
  3. data populator design doc (shovan)
  4. e2e test case for device - will be doing manually for this release. in review (satya) basic provisioning and custom topology test cases and some chaos testing
  5. add doc for snapshotclass snapsize parameter (pawan/prateek)
  6. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV (abhishek) in-review
  8. Alert for issues on disk (shubham). explore on mapping disks to NPD. in-progress (blocked on a PR)
  9. CSI volume health monitoring - (pawan/yashpal) on hold
  10. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  11. making snapshot available to the original pod (yashpal/abhranil) in-progress
  12. performance testing for thick and thin volumes todo (pawan/aman)
  13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  14. merge device localpv with lvm not started yet (pawan)
  15. add test case for stale volume (pawan/yashpal) in-review
  16. pvc null issue for device localpv debug (pawan/praveen) akhil - merged
  17. thin pool design discussion (pawan/yashpal)

July 5th, 2021

Attendees: Pawan, Akhil, Shovan, Aman, Shubham, Prateek, Abhishek, Sahil

  1. data populators (Shovan) sample populator blog is in review by marketing team inprogress
  2. data migrartion from one node to other (shovan) working on design doc, working on operator
  3. e2e test case for device - will be doing manually for this release. in review (satya)
  4. thin provisioning support for snapshots (prateek) - merged testing in progress (aman) verified
  5. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. monitoring for LVM LocalPV PR is in review (yashpal, vishnu) merged
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart charts are done
    • need to explore on options of using this as plugin/custom-metrics in node exporter.
  7. Alert for issues on disk (shubham). explore on mapping disks to NPD. in-progress (blocked on a PR)
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. monitoring for device localpv - (abhishek/sahil/yashpal) merged
  10. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  11. making snapshot available to the original pod (yashpal/abhranil) in-progress
  12. add docs for snapsize for LVM LocalPV
  13. performance testing for thick and thin volumes todo (pawan/aman)
  14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  15. merge device localpv with lvm not started yet (pawan)
  16. refactoring device localpv (akhil/praveen)
  17. add test case for stale volume (pawan/yashpal) in-progress
  18. pvc null issue for device localpv debug (pawan/praveen) akhil - raise a PR
  19. pool metrics for LVM LocalPV (abhishek/sahil) in-review
  20. validation while deleting volumes and snapshots for ZFS (akhil) on hold.
  21. thin pool design discussion (pawan/yashpal)

June 28th, 2021

Attendees: Pawan, Abhishek, Shovan, Sahil, Aman, Vishnu, Yashpal, Shubham

  1. data populators (Shovan) sample populator blog is in review by marketing team inprogress
  2. data migrartion from one node to other (shovan) working on design doc, working on operator
  3. e2e test case for device - will be doing manually for this release. in progress
  4. thin provisioning support for snapshots (prateek) - merged testing in progress (aman)
  5. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. monitoring for LVM LocalPV PR is in review (yashpal, vishnu)
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart charts are done
    • need to explore on options of using this as plugin/custom-metrics in node exporter.
  7. Alert for issues on disk (shubham). explore on mapping disks to NPD. in-progress
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. monitoring for device localpv - (abhishek/sahil/yashpal) inprogress
  10. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  11. making snapshot available to the original pod (yashpal/abhranil) in-progress
  12. performance testing for thick and thin volumes todo (pawan/aman)
  13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  14. merge device localpv with lvm not started yet (pawan)
  15. add test case for stale volume (pawan/yashpal) in-progress
  16. pvc null issue for device localpv debug (pawan/praveen)
  17. pool metrics for LVM LocalPV (abhishek/sahil) in-review
  18. validation while deleting volumes and snapshots in-review

June 21th, 2021

Attendees: Pawan, Shubham, Aman, Praveen, Abhishek, Shovan

  1. data populators (Shovan) sample populator blog is in review by marketing team inprogress
  2. data migrartion from one node to other (shovan) working on design doc
  3. e2e test case for device - will be doing manually for this release. in progress
  4. thin provisioning support for snapshots (prateek) - in progress
  5. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  6. monitoring for LVM LocalPV PR is in review (yashpal, vishnu)
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart charts are done
    • need to explore on options of using this as plugin/custom-metrics in node exporter.
  7. Alert for issues on disk (shubham). explore on mapping disks to NPD.
  8. CSI volume health monitoring - (pawan/yashpal) on hold
  9. monitoring for device localpv - (abhishek) inprogress
  10. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  11. making snapshot available to the original pod (yashpal/abhranil) in-progress
  12. make snapshot size configurable via snapshot class SnapSize (% or absolute) in snapshotclass
  13. performance testing for thick and thin volumes todo (pawan/aman)
  14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
  15. merge device localpv with lvm not started yet (pawan)
  16. add test case for stale volume (pawan/yashpal) in-progress
  17. pvc null issue for device localpv debug (pawan/praveen)
  18. pool metrics for LVM LocalPV (abhishek/sahil) in-progress

June 14th, 2021

Attendees: Abhishek, Abhranil, Yashpal, Praveen, Akhil, Shubham, Shovan, Prateek, Aman, Sahil, Pawan

  1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. (yashpal)
    • lib-csi PR merged. WIll update device-localpv merged
  2. data populators (Shovan) sample populator blog is in review by marketing team inprogress
  3. data migrartion from one node to other (shovan) working on design doc
  4. e2e test case for zfs - PR is in review. merged
  5. e2e test case for device - will be doing manually for this release.
  6. lvm corruption issue (prateek) working design
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. monitoring for LVM LocalPV PR is in review (yashpal, vishnu)
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart charts are done
    • need to explore on options of using this as plugin/custom-metrics in node exporter.
  8. Alert for issues on disk (shubham). explore on mapping disks to NPD.
  9. CSI volume health monitoring - (pawan/yashpal) will explore today.
  10. Device LocalPV docs(akhil) - in review (praveen) merged
  11. monitoring for device localpv
  12. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  13. making snapshot available to the original pod (yashpal/abhranil) in-progress
  14. make snapshot size configurable via snapshot class
  15. thin pool + snapshot, how we can reserve space for snapshot.
  16. performance testing for thin pool
  17. merge device localpv with lvm not started yet (pawan)
  18. add test case for stale volume (pawan/yashpal) in-progress

June 7, 2021

Attendees: Shubham, Shovam Sahil, Akhil, Sai, Vishnu, Yashpal, Aman

  1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. (yashpal)
    • lib-csi PR merged. WIll update device-localpv
  2. data populators (Shovan) sample populator blog is in review by marketing team
  3. data migrartion from one node to other (shovan) started on prototyping
  4. e2e test case for zfs - PR is in review.
  5. e2e test case for device - will be doing manually for this release.
  6. lvm corruption issue (prateek) in-progress
    • Testing the multi node scenarios
    • Moving the disk across the Nodes
  7. monitoring for LVM LocalPV
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart charts are done
    • need to explore on options of using this as plugin/custom-metrics in node exporter.
  8. Alert for issues on disk (shubham). explore on mapping disks to NPD.
  9. CSI volume health monitoring - (pawan/yashpal) will explore today
  10. Device LocalPV docs(akhil) - in review (praveen)
  11. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  12. add CSI Storage capacity scheduling for ZFS-LocalPV (shubham) - merged
  13. making snapshot available to the original pod (yashpal/abhranil) in-progress
  14. merge device localpv with lvm not started yet (pawan)
  15. add test case for stale volume (pawan/yashpal) in-progress
  16. support online resize for btrfs (sai) - merged

May 31st 2021

Attendees: Pawan, Shubham, Akhil, Shovan, Aman, Prateek

  1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. (yashpal) in review (prateek, akhil, shubham, pawan)

  2. data populators (Shovan) sample populator blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)

  3. data migrartion from one node to other (shovan) yet to start

  4. master helm chart https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) PR raised approved merged

  5. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue closed

  6. e2e test case for lvm in progress (aman) done

  7. e2e test case for zfs pr in review (aman) will be done by RC1

  8. e2e test case for device yet to start (aman) yet to start

  9. lvm corruption issue (prateek) in-progress

  10. monitoring for LVM LocalPV

    • logging (Ashish) logs monitoring
    • metrics () add grafana chart in-progress
  11. CSI volume health monitoring (pawan/yashpal) explore

  12. Device LocalPV docs (akhil) feature doc and CSI compatibility doc in-progress

  13. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress

  14. add CSI Storage capacity scheduling for ZFS-LocalPV (Shubham) in-review (pawan/akhil)

  15. making snapshot available to the original pod (yashpal/abhranil) in-progress

  16. merge device localpv with lvm not started yet (pawan)

  17. add test case for stale volume (pawan/yashpal)

  18. verify volume capability (sai) PR merged

  19. wipefs when we are deleting the lvm volume (sai) merged

  20. support online resize for btrfs (sai) in-progress

May 24th 2021

Attendees: Pawan, Shubham, Prateek, Akhil, Yashpal, Praveen, Sai

  1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. (yashpal) in review (prateek, akhil, shubham, pawan)
  2. data populators (Shovan) sample populator blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
  3. master helm chart https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) PR raised approved waiting on kiran to merge
  4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
  5. e2e test case for lvm in progress (aman)
  6. e2e test case for zfs pr in review (aman)
  7. e2e test case for device yet to start (aman)
  8. lvm corruption issue (prateek) in-progress
  9. make PV migration completely automatic (pawan) in design
  10. monitoring for LVM LocalPV
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart in-progress
  11. CSI volume health monitoring (pawan/?) explore
  12. an issue including list of metrics needed (yashpal) done
  13. Device LocalPV docs (akhil) feature doc and CSI compatibility doc in-progress
  14. LVM LocalPV docs (pawan) doc, contributor doc, setup etc in-progress
  15. add CSI Storage capacity scheduling for ZFS-LocalPV (Shubham) in-review (pawan/akhil)
  16. making snapshot available to the original pod (yashpal/abhranil) waiting for the backup team
  17. merge device localpv with lvm not started yet (pawan)
  18. add test case for stale volume (pawan/yashpal)
  19. verify volume capability (sai)
  20. wipefs when we are deleting the volume (sai)
  21. support resize for btrfs (?)

May 17th 2021

Attendees: Pawan, Shubham, Prateek, Akhil, Kiran, Abhishek, Abhranil, Yashpal, Sahil

  1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. (yashpal) inprogress
  2. data populators (Shovan) sample populator blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
  3. master helm chart https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) PR raised review inprogress
  4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
  5. helm chart for LVM localPV setup (prateek) PR merged.
  6. make PV migration completely automatic (pawan) in design
  7. monitoring for LVM LocalPV
    • logging (Ashish) logs monitoring
    • metrics () add grafana chart in-progress
  8. CSI volume health monitoring (pawan/?) explore
  9. an issue including list of metrics needed (yashpal)
  10. Device LocalPV docs (akhil) feature doc and CSI compatibility doc
  11. LVM LocalPV docs (pawan) doc, contributor doc, setup etc
  12. add CSI Storage capacity scheduling for ZFS-LocalPV (Shubham)
  13. making snapshot available to the original pod (yashpal/abhranil)
  14. merge device localpv with lvm not started yet (pawan)
  15. merge e2e test cases in the repo for lvm/zfs. (aman)

May 10th 2021

Attendees: Pawan, Shubham, Prateek, Akhil, Shovan

  1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
    • doc update will also be required in case of resize. merged
  2. data populators (Shovan) sample populator blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
  3. master helm chart https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) PR raised
  4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
  5. helm chart for LVM localPV setup (prateek)
  6. make PV migration completely automatic (pawan)
  7. monitoring for LVM LocalPV (pawan) add grafana chart not started
  8. Device LocalPV docs (akhil) feature doc and CSI compatibility doc
  9. LVM LocalPV docs (pawan) doc, contributor doc, setup etc
  10. add CSI Storage capacity scheduling for ZFS-LocalPV (Shubham)
  11. merge device localpv with lvm
  12. merge e2e test cases in the repo for lvm/zfs.

May 3rd 2021

Attendees: Pawan, Aman, Akhil, Shovan, Praveen, Shubham, Prateek

  1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
    • doc update will also be required in case of resize.
  2. data populators (Shovan) sample populator blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
  3. master helm chart https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan)
  4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
  5. update go mod to 1.4.0 for lvm-localpv (prateek) merged
  6. check the snapshot when original volume has already been deleted (akhil) merged
  7. support node migration of the lvm/zfs disks (pawan). PR already raised for ZFS. pr merged for zfs.
  8. add helm chart for lvm localpv (yashpal) in review (akhil/shubham/prateek) a new PR be raised with github workflow for helm lint and releaser (prateek)
  9. monitoring for LVM LocalPV (pawan) add grafana chart not started
  10. Device LocalPV docs (akhil) feature doc and CSI compatibility doc
  11. LVM LocalPV docs (pawan) doc, contributor doc, setup etc
  12. device localpv refactoring Praveen
  13. add CSI Storage capacity scheduling for ZFS-LocaPV
  14. merge device localpv with lvm

April 26th 2021

Attendees: Pawan, Aman, Akhil, Shubham, Shovan

  1. data populators (Shovan) sample populator blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
  2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
  3. multi pool support for lvm (praveen/yashpal) (pawan) merged.
    • Need to update the docs (aman)
  4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
    • doc update will also be required in case of resize.
  5. update go mod to 1.4.0 for lvm-localpv (prateek)
  6. check the snapshot when original volume has already been deleted (akhil) in progress
  7. support node migration of the lvm/zfs disks (pawan). PR already raised for ZFS.
  8. add helm chart for lvm localpv (yashpal) in review (akhil/shubham/prateek)
  9. monitoring for LVM LocalPV (pawan) add grafana chart not started
  10. Device LocalPV docs (akhil) feature doc and CSI compatibility doc
  11. device localpv refactoring Praveen

April 19th 2021

Attendees: Pawan, Aman, Prateek, Akhil, Shubham

  1. data populators (Shovan) sample populator
  2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
  3. multi pool support for lvm (praveen/yashpal) (pawan) merged.
    • Need to update the docs
  4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
    • doc update will also be required in case of resize.
  5. check the snapshot when original volume has already been deleted (akhil) next release
  6. support node migration of the lvm/zfs disks (pawan). PR already raised for ZFS.
  7. add helm chart for lvm localpv (yashpal) in review (akhil/shubham)
  8. monitoring for LVM LocalPV (pawan)
  9. Device LocalPV docs (akhil)

April 12th 2021

Attendees: Pawan, Prateek, shubham, Akhil, Shovan, Abhranil, Aman

  1. data populators (Shovan) sample populator
  2. multi pool support for lvm (praveen/yashpal) (pawan) review pushed to next release
  3. thin provisioning for lvm volumes prateek merged
  4. check the snapshot when original volume has already been deleted (akhil) next release
  5. support node migration of the lvm disks (pawan) in progress
  6. add helm chart for lvm localpv (yashpal)

April 5th 2021

Attendees: Pawan, Prateek, Aman, Akhil, Shovan, Praveen

  1. device localpv make kubegen issue done
  2. ginko test cases for device localpv done (akhil)
  3. add device support for volumes done (praveen/akhil) in alpha
  4. multi pool support for lvm (praveen/yashpal) (pawan) review
  5. thin provisioning for lvm volumes prateek in-review(pawan)
  6. bump k8s for zfs/lvm in review (prateek) done
  7. check the snapshot when original volume has already been deleted (akhil) next release
  8. support node migration of the lvm disks (pawan) in progress
  9. add helm chart for lvm localpv (yashpal)

Mar 30th 2021

  1. device localpv make kubegen issue akhil, pawan
  2. ginko test cases for device localpv pawan
  3. add device support for volumes (provisioning/deprovisioning) (pawan/praveen) inprogress
  4. multi pool support for lvm (praveen/yashpal) (pawan) review
  5. test the device CSI driver and see if are we getting the grpc call done
  6. making snapshots available to the source pod investigation (praveen/pawan) poc is done
  7. thin provisioning for lvm volumes prateek in-review(pawan)
  8. bump k8s for zfs/lvm in review (pawan)
  9. check the snapshot when original volume has already been deleted (akhil)
  10. support node migration of the lvm disks (pawan)

Mar 19th 2021

  1. add device support for volumes (provisioning/deprovisioning) (pawan/praveen) started
  2. multi pool support for lvm (praveen/yashpal) (pawan) review
  3. add docs for lvm how to add custom node label (akhil)
  4. test the device CSI driver and see if are we getting the grpc call (pawan)
  5. making snapshots available to the source pod investigation (praveen/pawan) poc is done
  6. thin provisioning for lvm volumes prateek
  7. bump k8s for zfs/lvm
  8. check the snapshot when original volume has already been deleted (akhil)
  9. support node migration of the lvm disks (pawan)

Mar 12th 2021

Attendees: Pawan, Aman, Akhil, Prateek

  1. support restore in an encrypted pool merged
  2. setup ubuntu 20 to have encryption support done
  3. iops throttling explore (Abhranil) done pending item : iops throttling for block devices
  4. add volume group capacity tracking done
  5. add device support for volumes (provisioning/deprovisioning) (pawan/praveen) started yet
  6. multi pool support for lvm (praveen/yashpal) under-review
  7. add docs for lvm
  8. making snapshots available to the source pod investigation (praveen/pawan) poc is done
  9. thin provisioning for lvm volumes prateek
  10. bump k8s for zfs

Mar 5th 2021

Attendees: Pawan, Aman, Akhil, Shubham Yashpal, Prateek

  1. support restore in an encrypted pool in-Review (kiran) zfs is merged, velero PR is still pending
  2. setup ubuntu 20 to have encryption support tested(aman)
  3. iops throttling explore (Abhranil) done pending item : iops throttling for block devices
  4. add volume group capacity tracking done in-review (pawan/akhil/prateek)
  5. e2e PR for LVM done
  6. wait for volume to be created (zfs) in-review (kiran) pushed for next release
  7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 done
  8. thin provisioning support for lvm volumes (pawan/prateek) https://github.com/openebs/lvm-localpv/pull/30
  9. add device support for volumes (provisioning/deprovisioning) (praveen) not started yet
  10. multi pool support for lvm/zfs (praveen/yashpal) not started yet under-review
  11. making snapshots available to the source pod investigation (praveen/pawan) poc is done

Mar 2nd 2021

Attendees: Pawan, Aman, Akhil, Abhranil, Praveen, Yashpal, Prateek

  1. encryption backward compatibility test done
  2. support restore in an encrypted pool in-Review (kiran) zfs is merged, velero PR is still pending
  3. setup ubuntu 20 to have encryption support tested(aman)
  4. iops throttling explore (Abhranil) in-review (pawan/akhil) lib-csi PR is merged
  5. add volume group capacity tracking in-review (pawan/akhil/prateek)
  6. e2e PR for LVM in review
  7. wait for volume to be created (zfs) in-review (kiran) pushed for next release
  8. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 in-review (pawan)
  9. thin provsioning support for lvm volumes (pawan/prateek)
  10. add device support for volumes (provisioning/deprovisioning) (praveen) not started yet
  11. multi pool support for lvm/zfs (praveen/yashpal) not started yet
  12. making snapshots available to the source pod investigation (praveen/pawan)

Feb 19th 2021

Attendees: Pawan, Aman, Prateek, Abranil

  1. encryption backward compatibility test
  2. support restore in an encrypted pool in-Review (kiran)
  3. setup ubuntu 20 to have encryption support
  4. iops throttling explore (Abhranil) in-review (pawan/akhil) lib-csi PR is merged
  5. add volume group capacity tracking in-review (pawan/akhil)
  6. wait for volume to be created (zfs) in-review (kiran) pushed for next release
  7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 in-review (pawan)
  8. thin provsioning support for lvm volumes (pawan) pushed for next release
  9. add device support for volumes (provisioning/deprovisioning) (preveen) not started yet
  10. multi pool support for lvm/zfs (praveen/yashpal) not started yet
  11. making snapshots available to the source pod investigation (praveen/pawan)

e2e:

  1. have basic test cases for provisioning/deprovisioning
  2. BDD test cases

Doc:

  1. Doc for provisioning/deprovisioning
  2. Resize
  3. raw block volume
  4. doc custom topology
  5. snapshot

Feb 12th 2021

Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal

  1. iops throttling explore (Abhranil) in-review (pawan/akhil)
  2. add volume group capacity tracking in-review (pawan/akhil)
  3. capacity based scheduler for LVM done
  4. snapshot support for LVM (akhil) done
  5. wait for volume to be created (zfs) in-review (kiran) pushed for next release
  6. return proper error while creating the volume (yashpal/pawan)
  7. lvm volumes not visible on the host (debug pawan/praveen/yashpal) lvdisplay command has some issue pvscan cached
  8. thin provsioning support for lvm volumes (pawan) pushed for next release
  9. add device support for volumes (provisioning/deprovisioning) not started yet
  10. multi pool support for lvm/zfs (praveen/yashpal)
  11. making snapshots available to the source pod investigation (praveen/pawan)

Feb 5th 2021

Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal, Prateek

  1. iops throttling explore (Abhranil) in-progress
  2. snapshot support for LVM (akhil) in-review (pawan)
  3. wait for volume to be created (zfs) in-review (kiran)
  4. lvm volumes not visible on the host (debug pawan/praveen/yashpal) lvdisplay command has some issue pvscan cached
  5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity (yashpal)
  6. thin provsioning support for lvm volumes (pawan)
  7. capacity based scheduler for LVM
  8. add device support for volumes (provisioning/deprovisioning) not started yet
  9. add clone support for LVM LocalPV discuss Design
  10. multi pool support for lvm/zfs (praveen/yashpal)

Jan 29th 2021

Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen

  1. snapshot support for LVM (akhil) in-review (pawan)
  2. wait for volume to be created (zfs) in-review (kiran)
  3. lvm volumes not visible on the host (debug pawan/praveen) lvdisplay command has some issue
  4. raw block volume support for LVM in-review (akhil/kiran)
  5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity (pawan/praveen)
  6. iops throttling explore (Abhranil) in-progress
  7. thin provsioning support for lvm volumes (pawan)
  8. add device support for volumes (provisioning/deprovisioning)
  9. add clone support for LVM LocalPV discuss Design
  10. multi pool support for lvm/zfs (praveen)

Jan 25th 2021

Attendees: Pawan, Aman, Shubham, Akhil, Abhranil,

  1. snapshot support for LVM (akhil) in-progress use latest CR
  2. add clone support for LVM LocalPV To Do
  3. wait for volume to be created (zfs) look at csi-provsioner for stale volume issue (corner case)
  4. lvm volumes not visible on the host (debug pawan/praveen)
  5. raw block volume support for LVM (pawan)
  6. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity (pawan/praveen)
  7. iops throttling explore (Abhranil) in-progress

Jan 15th 2021

  1. LVM 0.1 release available
  2. wait for volume to be created (pawan)
  3. lvm volumes not visible on the host (debug pawan/praveen)
  4. snapshot support for LVM (akhil) in-progress
  5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity (pawan/praveen)
  6. iops throttling explore (Abhranil) in-progress
  7. add clone support for LVM LocalPV (pawan/akhil)
  8. lvm provisioner name : local.csi.openebs.io

Jan 8th 2021

  1. wait for volume to be created (pawan)
  2. capacity based scheduler for LVM (praveen)
  3. lvm volumes not visible on the host (debug pawan/praveen)
  4. setup on debian - dependency checks ( pawan )
  5. move pkg/response to csi-resize
  6. snapshot support for LVM (akhil)
  7. resize PR review (praveen)
  8. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity (pawan/praveen)
  • iops throttling explore (Abhranil)

Dec 30th 2020

Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil,

  • backup and restore using different bucket manual verification done
  • blog on incremental backup/restore in progress (pawan)
  • migrate the e2e test cases to ZFS-LocalPV in progress work started
  • helm chart for ZFS Local PV in progress ( pending review from Kiran/Prateek)
  • setup on debian - dependency checks ( praveen / pawan )
  • LVM CSI Driver in progress
    • extract the common packages into openebs/lib-csi ( pawan ) done
  • capacity based scheduler for ZFS-LocalPV (pawan)
  • iops throttling explore
  • lvm-driver : lvm volumes are not visible on the host try lvrescan
  • lvm name length, CSI sanity issue
  • lvm resize support (pawan)

Dec 18th 2020

Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil, Kiran

  • blog on incremental backup/restore in progress
  • backup and restore using different bucket
  • migrate the e2e test cases to ZFS-LocalPV in progress - schedule a meeting on Monday
  • helm chart for ZFS Local PV in progress ( pending review from Kiran/Prateek)
  • setup on debian - dependency checks ( praveen / pawan )
  • LVM CSI Driver in progress
    • extract the common packages into openebs/lib-csi ( pawan )
    • lvm-localpv
  • capacity based scheduler for ZFS-LocalPV (pawan)

Dec 11th 2020

Attendees: Pawan, Aman

  • blog on incremental backup/restore in progress
  • restore in diff ns done
  • incremental backup done
  • pvc clone testing done
  • refactor the README in progress
  • raise a pr in velero-plugin to fix change-pvc-node-selector config label
  • readme PR review Aman

Dec 4th 2020

Attendees: Pawan, Aman

  • kustomize testing done
  • blog on incremental backup/restore in progress
  • code refactoring, no functionality will be added
  • have to run a pipeline with the ci done
  • restore in diff ns in review
  • incremental backup in review
  • pvc clone testing in review
  • refactor the README in progress
  • raise a pr in velero-plugin to fix change-pvc-node-selector-config label

Nov 20th 2020

Attendees: Pawan, Aman

this release

  • code refactoring, no functionality will be added

  • document update

  • doc update : restore on a diff node

  • refactor the README

  • multi arch image testing done

  • put the question in the velero channel regarding snapshotter error no reply

  • kustomize testing in progress

  • pvc clone testing done

  • parallel upgrade testing done

  • blog on incremental backup/restore in progress

Nov 13th 2020

Attendees: Pawan, Aman

  • multi arch image testing
  • put the question in the velero channel regarding snapshotter error
  • kustomize testing
  • pvc clone testing
  • parallel upgrade testing
  • blog on incremental backup/restore

Oct 16th 2020

Attendees: Pawan, Aman

e2e test :

  • incremental backup/restore (ee and community) - manual testing done
  • restore on different node (ee and community) - manual testing done
  • scheduled backup/restore - manual testing done
  • full backup/restore - done
  • upgrade testing : velero upgrade from 2.1.0 - to 2.2.0 and test the scheduled backup/restore
  • test on s3 storage
  • future goal : test on different cluster

Development:

  • BDD for backup/restore
  • multi arch build
  • support NFS for ZFS-LocalPV
  • CSI driver Sanity test
  • deployment via kustomize
  • any issue/bug fixes.

Oct 9th 2020

Attendees: Pawan, Aman, Giri

RC-1 Test cases test upgrade :
create schdedule backup/restore from old version and then upgrade to RC1.

  • There should not be any issue
  • restore should work for old as well as for the new backups
  • check the storage directory size, the size should be less
  • test on s3 storage
  • future goal : test on different cluster

Automated

  • restore in same namespace
  • restore in other namespace
  • schedule backup test cases

Sept 18th 2020

Attendees: Pawan, Aman, Kiran

  • create issues :-

  • deployment via kustomize

  • capacity based scheduling

  • grafana charts for ZPOOL capacity and component / driver status

  • recover volumes from cluster/node disaster recovery = when there are no backup of zfs volume CRs

  • Validations - stop from making accidental deletions (namespace or CR deletions) ( webhook or OPA is required )

  • Node is gone and disks are moved to new node. Recreate the PV. (new operator to auto-detect and recover)

  • Monitor and replace failed Disk (NDM )

  • Backup/Restore without velero dependency

  • CSI Driver test

  • Unit Test cases

  • Integration Tests

    • Validations - stop from making accidental deletions (namespace or CR deletions)
  • E2e issues?

    • volume count based scheduling
  • Possible Refacotring Ideas to support multiple (local) backends

    • (approach 1) openebs/local-csi. take the code from ZFS Local PV and modularize. Add support for lvm, rawfile
    • (approach 2)
      • openebs/lib-storage-scheduling. code for picking up the node to provision storage. support volume count, capacity based.
      • openebs/zfs-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
      • openebs/rawfile-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
      • openebs/dynamic-localpv = use the openebs/lib-storage-scheduling

Sept 11th 2020

Attendees: Pawan, Aman

  • Backup and restore Development (as alpha feature)
    • intial changes are merged
    • add support to restore on different cluster
    • add support for incremental backup/restore
  • Backup and restore Development test cases update test cases on the wiki

Sept 4th 2020

Attendees: Pawan, Aman

  • Backup and restore Development (as alpha feature) :
    • velero side changes has been approved
    • zfs-localpv side changes are under review)
    • incremental backup/restore is under development
  • e2e
    • test case for upgrade done
    • backup and restore via velero (test plan @aman)
    • node failure scenario (@aman) done
    • one yaml for all OS platform ubuntu, centos 7/8, k3s (if possible)
  • 1.0 will be GA release in-progress
  • wiki page done (@aman)

Aug 28th 2020

Holiday

Aug 21st 2020

Attendees: Pawan, Aman

  • backup and restore via velero (test plan @aman)
  • node failure scenario (@aman) in-progress
  • 1.0 will have backup and restore and helm support in-progress
  • 1.0 will be GA release in-progress
  • roundoff fix testing manual testing done
  • wiki page inprogress (@aman)

Aug 14th 2020

Attendees: Pawan, Aman

  • backup and restore via velero (test plan @aman)
  • 0.9.1 release on 15th of Aug done
  • patch the fixes in 0.9x branch done
  • 1.0 will have backup and restore and helm support in-progress
  • 1.0 will be GA release in-progress
  • enable enterprise test case on centos clone on xfs in-progress
  • operator yaml testing on k8s 1.14 done
  • roundoff fix testing manual testing done
  • wiki page inprogress (@aman)

Aug 7th, 2020

Attendees: Pawan, Aman, Kiran, Vishnu

  • 0.9.1 release on 15th of Aug
  • patch the fixes in 0.9x branch
  • 1.0 will have backup and restore and helm support
  • 1.0 will be GA release
  • enable enterprise test case on centos clone on xfs
  • operator yaml testing on k8s 1.14
  • roundoff fix testing
  • wiki page inprogress (@aman)

July 31st, 2020

Attendees: Pawan, Aman

  • wiki page inprogress (@aman)
  • pipeline script needs to change to accomodate the path change
  • backup/restore velero side changes are done
  • compiling spl on centos 8, struct has been changed here, causing compilation failure
  • zfs crash found in Optoro (seems to be version incompatibility issue)
  • shared mount using busybox (done)
  • bloomberg performance issue with ZFS-LocalPV (tunables to improve performance) (@aman)

July 17th, 2020

Attendees: Pawan, Aman, Kiran

Discussions

  • Automation of zpool creation [@pawan]
  • Focus on chaos testing along with functional tests
  • Link the test cases running in pipeline to the automated test scripts. (With READme's in master branch)
  • Update the wiki page for QA with all plateforms and k8s and zfs versions.

June 5th, 2020

Attendees: Pawan, Aman, Kiran

Discussions

  • Review/triage the ZFS Local PV tracker

  • Review/triage the ZFS Local PV E2e tests tracker

    • Review existing tests and add them to the ZFS Local PV wiki.
    • Initial draft is available for review.
  • Install and OS compabilitly

    • Attempted to mount /lib and /lib64 - some more validation is required before going with this approach.
    • Going with different YAMLs approach for now.
    • Helm charts will be made available in the next release. (1.12)

May 22nd, 2020

Attendees: Pawan, Aman, Kiran

Discussions

  • Review/triage the ZFS Local PV tracker

  • Review/triage the ZFS Local PV E2e tests tracker

    • Review existing tests and add them to the ZFS Local PV wiki.
  • Install and OS compabilitly

    • Need different YAMLs for each OS
    • Need travis yaml for building OS specific images
    • Helm to include variables for each OS

May 8th, 2020

Attendees: Pawan, Aman, Kiran

Agenda

  • [Kiran] Review Backlogs https://github.com/orgs/openebs/projects/10
    • [Pawan] ZFS bug with unmount RCA is still under investigation. Will reach out to ZFS community
    • [Pawan] Check on the missing metrics and check if PRs can be raised to Node Exporter
    • [Aman] E2e for Raw Block
    • [Aman] E2e. Manually verified the kubelet and docker restarts
    • [Aman] E2e. Bulk volume testing automation is in progress
    • [Kiran] Helm / openebs operator to include ZFS Local PV (not started)
  • [Aman] ZFS Grafana Dashboard
    • Blocked with onprem grafana/prometheus setup
  • [Pawan/Kiran] Moving Local PVs?
    • Working on a doc for migrating PVs to new node, when underyling disks are moved to new node.
Select a repo