OpenEBS CSI Local PV Discussions Notes

OpenEBS CSI Local PV Discussions Notes === :::info - **Location:** https://meet.google.com/yoq-fktt-qqn - **Date:** Every week from 12:45pm to 01:15pm on Monday (IST) - **Agenda** 1. Walk through the status update via the tracker 2. Discussion topic *Add your request, question or suggestion to our [issue list](https://github.com/openebs/openebs/issues)* *If you have anything you’d like to put on the agenda, please do so below for the next meeting:* ::: ## Nov 29, 2021 Attendees: Pawan, Abhishek 1. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek -- design doc (https://docs.google.com/document/d/13D8Ht__66n66c5ZBThPwqhKjyJey0GFKVO3dgK3w8OA/edit) is in review (pawan/Vishnu) 2. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) -- PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review 3. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress 4. volume scheduler for Flipkart -- (shovan) explore -- POC done, Shovan will raise a PR 5. velero jr0dd feture request to not send backup to remote location. 6. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked 7. merge device localpv with lvm -- not started yet -- (pawan) 8. thin pool design discussion -- (pawan/yashpal) -- blocked 9. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) -- PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review 10. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 11. data populator design doc -- (shovan) -- parked for now 12. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 14. debugging end point -- export pprof end point -- (yashpal) agent was stuck and could not progress, need to have some debug endpoint. ## Oct 25, 2021 Attendees: Pawan, Yashpal, Abhishek 1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress 2. volume scheduler for Flipkart -- (shovan) explore -- POC done, Shovan will raise a PR 3. velero jr0dd feture request to not send backup to remote location. 4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked 5. merge device localpv with lvm -- not started yet -- (pawan) 6. thin pool design discussion -- (pawan/yashpal) -- blocked 7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 9. data populator design doc -- (shovan) -- parked for now 10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek -- in-process 13. debugging end point -- export pprof end point -- (yashpal) agent was stuck and could not progress, need to have some debug endpoint. ## Oct 18, 2021 Attendees: Pawan, Aman, Abhishek 1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress 2. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC 3. velero jr0dd feture request to not send backup to remote location. 4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked 5. merge device localpv with lvm -- not started yet -- (pawan) 6. thin pool design discussion -- (pawan/yashpal) -- blocked 7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 9. data populator design doc -- (shovan) -- parked for now 10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek 13. register topology key from env for ZFS-LocalPV -- (shubham) -- merged 14. handle topology key in e2e test cases -- (aman) need to raise the PR -- PR is not required as default behavior is to keep all the node labels as topology key. -- done ## Oct 11, 2021 Attendees: Pawan, Aman, Prateek 1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress 2. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC 3. velero jr0dd feture request to not send backup to remote location. 4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked 5. merge device localpv with lvm -- not started yet -- (pawan) 6. thin pool design discussion -- (pawan/yashpal) 7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 9. data populator design doc -- (shovan) -- parked for now 10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) 13. register topology key from env for ZFS-LocalPV -- (shubham) PR is in review 14. handle topology key in e2e test cases -- (aman) need to raise the PR. ## Oct 04, 2021 Attendees: Pawan, Aman, Shovan, Abhishek 1. volume go missing issue on RHEL -- done, user closed the issue 2. SCP node agent Design Doc for FK phase 2 3. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC 4. velero jr0dd feture request to not send backup to remote location. 5. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked 6. merge device localpv with lvm -- not started yet -- (pawan) 7. thin pool design discussion -- (pawan/yashpal) 8. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 9. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 10. data populator design doc -- (shovan) -- parked for now 11. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 13. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) ## Sept 27, 2021 Attendees: Pawan, Aman 1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch. -- done 2. merge the cherry pick PRs in LVM and ZFS LocalPV -- done 3. SCP node agent Design Doc for FK phase 2 4. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC 5. volume go missing issue on RHEL 6. velero jr0dd feture request to not send backup to remote location. 7. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman) -- done 8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 9. merge device localpv with lvm -- not started yet -- (pawan) 10. thin pool design discussion -- (pawan/yashpal) 11. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 12. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 13. data populator design doc -- (shovan) -- parked for now 14. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 15. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now ## Sept 13, 2021 Attendees: Pawan, Aman, Shovan 1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch. 2. merge the cherry pick PRs in LVM and ZFS LocalPV -- pending on Pawan 3. SCP node agent Design Doc for FK phase 2 4. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC 5. raw block test cases for device-localpv -- (aman) -- in-review (satya) -- merged 6. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv -- merged 7. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman) -- done 8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 9. merge device localpv with lvm -- not started yet -- (pawan) 10. thin pool design discussion -- (pawan/yashpal) 11. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38) -- done 12. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) 13. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 14. data populator design doc -- (shovan) -- parked for now 15. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 16. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now ## Aug 30, 2021 Attendees: Pawan, Aman, Yashpal, Shovan, Sahil, Abhishek Agenda: using device-localpv for FK phase 2 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 2. data populator design doc -- (shovan) -- parked for now 3. volume scheduler for Flipkart -- (shovan) explore -- design doc review is in progress 4. raw block test cases for device-localpv -- (aman) -- in-review (satya) 5. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv 6. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman) 7. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 10. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 11. merge device localpv with lvm -- not started yet -- (pawan) 12. thin pool design discussion -- (pawan/yashpal) 13. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38) 14. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) ## Aug 23, 2021 Attendees: Pawan, Sahil, Abhishek, Aman, Yashpal, Vishnu, Shovan Agenda: https://github.com/openebs/lvm-localpv/issues/134 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 2. data populator design doc -- (shovan) -- parked for now 3. volume scheduler for Flipkart -- (shovan) explore -- design doc review is in progress 4. raw block test cases for device-localpv -- (aman) -- in-progress 5. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv 6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 7. CSI volume health monitoring - (pawan/yashpal) -- on hold 8. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- Done -- (aman is working on adopters doc) 9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 10. parted command issue -- (Praveen) -- done, yashpal already filed two issues 11. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman) -- documented 12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now 13. merge device localpv with lvm -- not started yet -- (pawan) 14. Fix Error Handling On Creation Failure -- (pawan/akhil) -- done 15. thin pool design discussion -- (pawan/yashpal) ## Aug 16, 2021 Attendees: Pawan, Akhil 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 2. data populator design doc -- (shovan) -- parked for now 3. volume scheduler for Flipkart -- (shovan) explore 4. raw block test cases for device-localpv -- (aman) -- in-progress 5. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now - Testing the multi node scenarios - Moving the disk across the Nodes 6. CSI volume health monitoring - (pawan/yashpal) -- on hold 7. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adopters doc) 8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 9. parted command issue -- (Praveen) 10. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman) 11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 12. merge device localpv with lvm -- not started yet -- (pawan) 13. Fix Error Handling On Creation Failure -- (pawan/akhil) 14. thin pool design discussion -- (pawan/yashpal) ## Aug 9th, 2021 Attendees: Pawan, Shovan, Aman, Akhil, Abhishek, Shubham, 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now 2. data populator design doc -- (shovan) -- parked for now 3. volume scheduler for Flipkart -- (shovan) explore 4. device-localpv add upgrade test case -- (aman) -- done 5. raw block test cases for device-localpv -- (aman) 6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) - Testing the multi node scenarios - Moving the disk across the Nodes 7. CSI volume health monitoring - (pawan/yashpal) -- on hold 8. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adopters doc) 9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 10. parted command issue -- (Praveen) 11. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman) 12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 13. merge device localpv with lvm -- not started yet -- (pawan) 14. Fix Error Handling On Creation Failure -- (pawan/akhil) 15. thin pool design discussion -- (pawan/yashpal) ## Aug 2nd, 2021 Attendees: Pawan, Shovan, Abhishek, Shubham, Aman, Akhil 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done 2. data populator design doc -- (shovan) 3. volume scheduler for Flipkart -- (shovan) explore 4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing -- done 5. device-localpv add upgrade test case -- (aman) 6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offilen) - Testing the multi node scenarios - Moving the disk across the Nodes 7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) merged 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adompters doc) 10. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 11. parted command issue -- (Praveen) 12. performance testing for thick and thin volumes -- todo (pawan/aman) 13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 14. merge device localpv with lvm -- not started yet -- (pawan) 15. refactoring PR for device localpv -- (akhil) -- merged 16. Fix Error Handling On Creation Failure -- (pawan/akhil) 17. add test case for stale volume -- (pawan/yashpal) megred 16. thin pool design discussion -- (pawan/yashpal) ## July 26th, 2021 Attendees: Pawan, Shovan, Abhishek, Shubham, Sahil, Vishnu 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done 2. data populator design doc -- (shovan) 3. volume scheduler for Flipkart -- (shovan) explore 4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing 5. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offilen) - Testing the multi node scenarios - Moving the disk across the Nodes 6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review 7. CSI volume health monitoring - (pawan/yashpal) -- on hold 8. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress -- (aman is working on adompters doc) 9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 10. parted command issue -- (Praveen) 11. performance testing for thick and thin volumes -- todo (pawan/aman) 12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 13. merge device localpv with lvm -- not started yet -- (pawan) 14. refactoring PR for device localpv -- (akhil) -- in reivew 15. add test case for stale volume -- (pawan/yashpal) in-review 16. thin pool design discussion -- (pawan/yashpal) ## July 19th, 2021 Attendees: Pawan, Akhil, Shovan, Abhishek, Vishnu, Prateek, Shubham, Praveen, Sahil 1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done 2. data populator design doc -- (shovan) 3. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing 4. add doc for snapshotclass snapsize parameter -- (pawan/prateek) -- merged 5. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review 7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR) -- merged 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 10. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 11. performance testing for thick and thin volumes -- todo (pawan/aman) 12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 13. merge device localpv with lvm -- not started yet -- (pawan) 14. refactoring PR for device localpv -- (akhil) -- in reivew 15. add test case for stale volume -- (pawan/yashpal) in-review 16. thin pool design discussion -- (pawan/yashpal) ## July 12th, 2021 Attendees: Pawan, Akhil, Shovan, Aman, Vishnu, Yashpal, Sahil 1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- published 2. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done 3. data populator design doc -- (shovan) 4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing 5. add doc for snapshotclass snapsize parameter -- (pawan/prateek) 6. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review 8. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR) 9. CSI volume health monitoring - (pawan/yashpal) -- on hold 10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 12. performance testing for thick and thin volumes -- todo (pawan/aman) 13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 14. merge device localpv with lvm -- not started yet -- (pawan) 15. add test case for stale volume -- (pawan/yashpal) in-review 16. pvc null issue for device localpv -- debug (pawan/praveen) -- akhil - merged 17. thin pool design discussion -- (pawan/yashpal) ## July 5th, 2021 Attendees: Pawan, Akhil, Shovan, Aman, Shubham, Prateek, Abhishek, Sahil 1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress 2. data migrartion from one node to other -- (shovan) -- working on design doc, working on operator 3. e2e test case for device - will be doing manually for this release. -- in review (satya) 4. thin provisioning support for snapshots -- (prateek) - merged -- testing in progress (aman) -- verified 5. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu) -- merged - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- charts are done - need to explore on options of using this as plugin/custom-metrics in node exporter. 7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR) 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. monitoring for device localpv - (abhishek/sahil/yashpal) -- merged 10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 12. add docs for snapsize for LVM LocalPV 13. performance testing for thick and thin volumes -- todo (pawan/aman) 14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 15. merge device localpv with lvm -- not started yet -- (pawan) 16. refactoring device localpv -- (akhil/praveen) 17. add test case for stale volume -- (pawan/yashpal) in-progress 16. pvc null issue for device localpv -- debug (pawan/praveen) -- akhil - raise a PR 17. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-review 18. validation while deleting volumes and snapshots for ZFS -- (akhil) on hold. 19. thin pool design discussion -- (pawan/yashpal) ## June 28th, 2021 Attendees: Pawan, Abhishek, Shovan, Sahil, Aman, Vishnu, Yashpal, Shubham 1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress 2. data migrartion from one node to other -- (shovan) -- working on design doc, working on operator 3. e2e test case for device - will be doing manually for this release. -- in progress 4. thin provisioning support for snapshots -- (prateek) - merged -- testing in progress (aman) 5. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu) - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- charts are done - need to explore on options of using this as plugin/custom-metrics in node exporter. 7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. monitoring for device localpv - (abhishek/sahil/yashpal) -- inprogress 10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 12. performance testing for thick and thin volumes -- todo (pawan/aman) 13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 14. merge device localpv with lvm -- not started yet -- (pawan) 15. add test case for stale volume -- (pawan/yashpal) in-progress 16. pvc null issue for device localpv -- debug (pawan/praveen) 17. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-review 18. validation while deleting volumes and snapshots -- in-review ## June 21th, 2021 Attendees: Pawan, Shubham, Aman, Praveen, Abhishek, Shovan 1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress 2. data migrartion from one node to other -- (shovan) -- working on design doc 3. e2e test case for device - will be doing manually for this release. -- in progress 4. thin provisioning support for snapshots -- (prateek) - in progress 5. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu) - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- charts are done - need to explore on options of using this as plugin/custom-metrics in node exporter. 7. Alert for issues on disk (shubham). explore on mapping disks to NPD. 8. CSI volume health monitoring - (pawan/yashpal) -- on hold 9. monitoring for device localpv - (abhishek) -- inprogress 10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 12. make snapshot size configurable via snapshot class -- SnapSize (% or absolute) in snapshotclass 13. performance testing for thick and thin volumes -- todo (pawan/aman) 14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) 15. merge device localpv with lvm -- not started yet -- (pawan) 16. add test case for stale volume -- (pawan/yashpal) in-progress 17. pvc null issue for device localpv -- debug (pawan/praveen) 18. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-progress ## June 14th, 2021 Attendees: Abhishek, Abhranil, Yashpal, Praveen, Akhil, Shubham, Shovan, Prateek, Aman, Sahil, Pawan 1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) - lib-csi PR merged. WIll update device-localpv -- merged 2. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress 3. data migrartion from one node to other -- (shovan) -- working on design doc 4. e2e test case for zfs - PR is in review. -- merged 5. e2e test case for device - will be doing manually for this release. 6. lvm corruption issue -- (prateek) -- working design - Testing the multi node scenarios - Moving the disk across the Nodes 7. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu) - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- charts are done - need to explore on options of using this as plugin/custom-metrics in node exporter. 8. Alert for issues on disk (shubham). explore on mapping disks to NPD. 9. CSI volume health monitoring - (pawan/yashpal) -- will explore today. 10. Device LocalPV docs(akhil) - in review (praveen) -- merged 11. monitoring for device localpv 12. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 13. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 14. make snapshot size configurable via snapshot class 15. thin pool + snapshot, how we can reserve space for snapshot. 16. performance testing for thin pool 17. merge device localpv with lvm -- not started yet -- (pawan) 18. add test case for stale volume -- (pawan/yashpal) in-progress ## June 7, 2021 Attendees: Shubham, Shovam Sahil, Akhil, Sai, Vishnu, Yashpal, Aman 1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) - lib-csi PR merged. WIll update device-localpv 2. data populators -- (Shovan) sample populator -- blog is in review by marketing team 3. data migrartion from one node to other -- (shovan) -- started on prototyping 4. e2e test case for zfs - PR is in review. 5. e2e test case for device - will be doing manually for this release. 6. lvm corruption issue -- (prateek) in-progress - Testing the multi node scenarios - Moving the disk across the Nodes 7. monitoring for LVM LocalPV - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- charts are done - need to explore on options of using this as plugin/custom-metrics in node exporter. 8. Alert for issues on disk (shubham). explore on mapping disks to NPD. 9. CSI volume health monitoring - (pawan/yashpal) -- will explore today 10. Device LocalPV docs(akhil) - in review (praveen) 11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 12. add CSI Storage capacity scheduling for ZFS-LocalPV (shubham) - merged 13. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 14. merge device localpv with lvm -- not started yet -- (pawan) 15. add test case for stale volume -- (pawan/yashpal) in-progress 16. support online resize for btrfs -- (sai) - merged ## May 31st 2021 Attendees: Pawan, Shubham, Akhil, Shovan, Aman, Prateek 1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- in review (prateek, akhil, shubham, pawan) 2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 3. data migrartion from one node to other -- (shovan) -- yet to start 4. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- approved -- merged 5. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue -- closed 6. e2e test case for lvm -- in progress (aman)-- done 7. e2e test case for zfs -- pr in review (aman) -- will be done by RC1 8. e2e test case for device -- yet to start (aman) -- yet to start 9. lvm corruption issue -- (prateek) in-progress 10. monitoring for LVM LocalPV - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- in-progress 11. CSI volume health monitoring -- (pawan/yashpal) -- explore 12. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc -- in-progress 13. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 14. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) -- in-review (pawan/akhil) 15. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress 16. merge device localpv with lvm -- not started yet -- (pawan) 17. add test case for stale volume -- (pawan/yashpal) 18. verify volume capability -- (sai) -- PR merged 19. wipefs when we are deleting the lvm volume -- (sai) -- merged 20. support online resize for btrfs -- (sai) -- in-progress ## May 24th 2021 Attendees: Pawan, Shubham, Prateek, Akhil, Yashpal, Praveen, Sai 1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- in review (prateek, akhil, shubham, pawan) 2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- approved -- waiting on kiran to merge 4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue 5. e2e test case for lvm -- in progress (aman) 6. e2e test case for zfs -- pr in review (aman) 7. e2e test case for device -- yet to start (aman) 8. lvm corruption issue -- (prateek) in-progress 9. make PV migration completely automatic -- (pawan) -- in design 10. monitoring for LVM LocalPV - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- in-progress 11. CSI volume health monitoring -- (pawan/?) -- explore 12. an issue including list of metrics needed -- (yashpal) -- done 13. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc -- in-progress 14. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress 15. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) -- in-review (pawan/akhil) 16. making snapshot available to the original pod -- (yashpal/abhranil) -- waiting for the backup team 17. merge device localpv with lvm -- not started yet -- (pawan) 18. add test case for stale volume -- (pawan/yashpal) 19. verify volume capability -- (sai) 20. wipefs when we are deleting the volume -- (sai) 21. support resize for btrfs -- (?) ## May 17th 2021 Attendees: Pawan, Shubham, Prateek, Akhil, Kiran, Abhishek, Abhranil, Yashpal, Sahil 1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- inprogress 2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- review inprogress 4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue 5. helm chart for LVM localPV -- setup (prateek) -- PR merged. 6. make PV migration completely automatic -- (pawan) -- in design 7. monitoring for LVM LocalPV - logging (Ashish) -- logs monitoring - metrics () -- add grafana chart -- in-progress 8. CSI volume health monitoring -- (pawan/?) -- explore 9. an issue including list of metrics needed -- (yashpal) 10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc 11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc 12. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) 13. making snapshot available to the original pod -- (yashpal/abhranil) 14. merge device localpv with lvm -- not started yet -- (pawan) 15. merge e2e test cases in the repo for lvm/zfs. -- (aman) ## May 10th 2021 Attendees: Pawan, Shubham, Prateek, Akhil, Shovan 1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49 - doc update will also be required in case of resize. -- merged 2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised 4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) 5. helm chart for LVM localPV -- setup (prateek) 6. make PV migration completely automatic -- (pawan) 7. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started 8. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc 9. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc 10. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) 11. merge device localpv with lvm 12. merge e2e test cases in the repo for lvm/zfs. ## May 3rd 2021 Attendees: Pawan, Aman, Akhil, Shovan, Praveen, Shubham, Prateek 1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49 - doc update will also be required in case of resize. 2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) 4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) 5. update go mod to 1.4.0 for lvm-localpv -- (prateek) -- merged 6. check the snapshot when original volume has already been deleted -- (akhil) merged 7. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS. pr merged for zfs. 8. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham/prateek) -- a new PR be raised with github workflow for helm lint and releaser (prateek) 9. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started 10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc 11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc 12. device localpv refactoring -- Praveen 13. add CSI Storage capacity scheduling for ZFS-LocaPV 14. merge device localpv with lvm ## April 26th 2021 Attendees: Pawan, Aman, Akhil, Shubham, Shovan 1. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit) 2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) 3. multi pool support for lvm (praveen/yashpal) -- (pawan) merged. - Need to update the docs (aman) 4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49 - doc update will also be required in case of resize. 5. update go mod to 1.4.0 for lvm-localpv -- (prateek) 6. check the snapshot when original volume has already been deleted -- (akhil) in progress 7. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS. 8. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham/prateek) 9. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started 10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc 11. device localpv refactoring -- Praveen ## April 19th 2021 Attendees: Pawan, Aman, Prateek, Akhil, Shubham 1. data populators -- (Shovan) sample populator -- 2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) 3. multi pool support for lvm (praveen/yashpal) -- (pawan) merged. - Need to update the docs 4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49 - doc update will also be required in case of resize. 5. check the snapshot when original volume has already been deleted -- (akhil) -- next release 6. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS. 7. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham) 8. monitoring for LVM LocalPV (pawan) 9. Device LocalPV docs (akhil) ## April 12th 2021 Attendees: Pawan, Prateek, shubham, Akhil, Shovan, Abhranil, Aman 1. data populators -- (Shovan) sample populator 2. multi pool support for lvm (praveen/yashpal) -- (pawan) review -- pushed to next release 3. thin provisioning for lvm volumes -- prateek -- merged 4. check the snapshot when original volume has already been deleted -- (akhil) -- next release 5. support node migration of the lvm disks -- (pawan) -- in progress 6. add helm chart for lvm localpv -- (yashpal) ## April 5th 2021 Attendees: Pawan, Prateek, Aman, Akhil, Shovan, Praveen 1. device localpv make kubegen issue -- done 2. ginko test cases for device localpv -- done (akhil) 3. add device support for volumes -- done (praveen/akhil) in alpha 4. multi pool support for lvm (praveen/yashpal) -- (pawan) review 5. thin provisioning for lvm volumes -- prateek -- in-review(pawan) 6. bump k8s for zfs/lvm -- in review (prateek) -- done 7. check the snapshot when original volume has already been deleted -- (akhil) -- next release 8. support node migration of the lvm disks -- (pawan) -- in progress 9. add helm chart for lvm localpv -- (yashpal) ## Mar 30th 2021 1. device localpv make kubegen issue -- akhil, pawan 2. ginko test cases for device localpv -- pawan 3. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) inprogress 4. multi pool support for lvm (praveen/yashpal) -- (pawan) review 5. test the device CSI driver and see if are we getting the grpc call -- done 6. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done 7. thin provisioning for lvm volumes -- prateek -- in-review(pawan) 8. bump k8s for zfs/lvm -- in review (pawan) 9. check the snapshot when original volume has already been deleted -- (akhil) 10. support node migration of the lvm disks -- (pawan) ## Mar 19th 2021 1. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) started 2. multi pool support for lvm (praveen/yashpal) -- (pawan) review 3. add docs for lvm -- how to add custom node label (akhil) 4. test the device CSI driver and see if are we getting the grpc call -- (pawan) 5. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done 6. thin provisioning for lvm volumes -- prateek 7. bump k8s for zfs/lvm 8. check the snapshot when original volume has already been deleted -- (akhil) 9. support node migration of the lvm disks -- (pawan) ## Mar 12th 2021 Attendees: Pawan, Aman, Akhil, Prateek 1. support restore in an encrypted pool -- merged 2. setup ubuntu 20 to have encryption support -- done 3. iops throttling explore (Abhranil) -- done -- pending item : iops throttling for block devices 4. add volume group capacity tracking -- done 5. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) started yet 6. multi pool support for lvm (praveen/yashpal) -- under-review 7. add docs for lvm 8. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done 9. thin provisioning for lvm volumes -- prateek 10. bump k8s for zfs ## Mar 5th 2021 Attendees: Pawan, Aman, Akhil, Shubham Yashpal, Prateek 1. support restore in an encrypted pool -- in-Review (kiran) zfs is merged, velero PR is still pending 2. setup ubuntu 20 to have encryption support -- tested(aman) 3. iops throttling explore (Abhranil) -- done -- pending item : iops throttling for block devices 4. add volume group capacity tracking -- done -- in-review (pawan/akhil/prateek) 5. e2e PR for LVM -- done 6. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release 7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- done 8. thin provisioning support for lvm volumes -- (pawan/prateek) https://github.com/openebs/lvm-localpv/pull/30 9. add device support for volumes (provisioning/deprovisioning) -- (praveen) not started yet 10. multi pool support for lvm/zfs (praveen/yashpal) not started yet -- under-review 11. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done ## Mar 2nd 2021 Attendees: Pawan, Aman, Akhil, Abhranil, Praveen, Yashpal, Prateek 1. encryption backward compatibility test -- done 2. support restore in an encrypted pool -- in-Review (kiran) zfs is merged, velero PR is still pending 3. setup ubuntu 20 to have encryption support -- tested(aman) 4. iops throttling explore (Abhranil) -- in-review (pawan/akhil) -- lib-csi PR is merged 5. add volume group capacity tracking -- in-review (pawan/akhil/prateek) 6. e2e PR for LVM -- in review 7. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release 8. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- in-review (pawan) 9. thin provsioning support for lvm volumes -- (pawan/prateek) 10. add device support for volumes (provisioning/deprovisioning) -- (praveen) not started yet 11. multi pool support for lvm/zfs (praveen/yashpal) not started yet 12. making snapshots available to the source pod -- investigation (praveen/pawan) ## Feb 19th 2021 Attendees: Pawan, Aman, Prateek, Abranil 1. encryption backward compatibility test 2. support restore in an encrypted pool -- in-Review (kiran) 3. setup ubuntu 20 to have encryption support 4. iops throttling explore (Abhranil) -- in-review (pawan/akhil) -- lib-csi PR is merged 5. add volume group capacity tracking -- in-review (pawan/akhil) 6. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release 7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- in-review (pawan) 8. thin provsioning support for lvm volumes -- (pawan) -- pushed for next release 9. add device support for volumes (provisioning/deprovisioning) -- (preveen) not started yet 10. multi pool support for lvm/zfs (praveen/yashpal) not started yet 11. making snapshots available to the source pod -- investigation (praveen/pawan) e2e: 1. have basic test cases for provisioning/deprovisioning 2. BDD test cases Doc: 1. Doc for provisioning/deprovisioning 2. Resize 3. raw block volume 4. doc custom topology 5. snapshot ## Feb 12th 2021 Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal 1. iops throttling explore (Abhranil) -- in-review (pawan/akhil) 2. add volume group capacity tracking -- in-review (pawan/akhil) 3. capacity based scheduler for LVM -- done 4. snapshot support for LVM (akhil) -- done 5. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release 6. return proper error while creating the volume (yashpal/pawan) 7. lvm volumes not visible on the host -- (debug pawan/praveen/yashpal) -- lvdisplay command has some issue -- pvscan --cached 8. thin provsioning support for lvm volumes -- (pawan) -- pushed for next release 9. add device support for volumes (provisioning/deprovisioning) -- not started yet 10. multi pool support for lvm/zfs (praveen/yashpal) 11. making snapshots available to the source pod -- investigation (praveen/pawan) ## Feb 5th 2021 Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal, Prateek 1. iops throttling explore (Abhranil) -- in-progress 2. snapshot support for LVM (akhil) -- in-review (pawan) 3. wait for volume to be created (zfs) -- in-review (kiran) 4. lvm volumes not visible on the host -- (debug pawan/praveen/yashpal) -- lvdisplay command has some issue -- pvscan --cached 5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (yashpal) 6. thin provsioning support for lvm volumes -- (pawan) 7. capacity based scheduler for LVM 8. add device support for volumes (provisioning/deprovisioning) -- not started yet 9. add clone support for LVM LocalPV -- discuss Design 10. multi pool support for lvm/zfs (praveen/yashpal) ## Jan 29th 2021 Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen 1. snapshot support for LVM (akhil) -- in-review (pawan) 2. wait for volume to be created (zfs) -- in-review (kiran) 3. lvm volumes not visible on the host -- (debug pawan/praveen) -- lvdisplay command has some issue 4. raw block volume support for LVM -- in-review (akhil/kiran) 6. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen) 7. iops throttling explore (Abhranil) -- in-progress 8. thin provsioning support for lvm volumes -- (pawan) 9. add device support for volumes (provisioning/deprovisioning) 10. add clone support for LVM LocalPV -- discuss Design 11. multi pool support for lvm/zfs (praveen) ## Jan 25th 2021 Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, 1. snapshot support for LVM (akhil) -- in-progress -- use latest CR 2. add clone support for LVM LocalPV -- To Do 3. wait for volume to be created (zfs)-- look at csi-provsioner for stale volume issue (corner case) 4. lvm volumes not visible on the host -- (debug pawan/praveen) 5. raw block volume support for LVM -- (pawan) 6. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen) 7. iops throttling explore (Abhranil) -- in-progress ## Jan 15th 2021 1. LVM 0.1 release available 2. wait for volume to be created -- (pawan) 3. lvm volumes not visible on the host -- (debug pawan/praveen) 4. snapshot support for LVM (akhil) -- in-progress 5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen) 6. iops throttling explore (Abhranil) -- in-progress 7. add clone support for LVM LocalPV -- (pawan/akhil) 8. lvm provisioner name : local.csi.openebs.io ## Jan 8th 2021 1. wait for volume to be created -- (pawan) 2. capacity based scheduler for LVM -- (praveen) 3. lvm volumes not visible on the host -- (debug pawan/praveen) 4. setup on debian - dependency checks ( pawan ) 5. move pkg/response to csi-resize 6. snapshot support for LVM (akhil) 7. resize PR review (praveen) 8. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen) - iops throttling explore (Abhranil) ## Dec 30th 2020 Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil, - backup and restore using different bucket -- manual verification done - blog on incremental backup/restore -- in progress (pawan) - migrate the e2e test cases to ZFS-LocalPV -- in progress work started - helm chart for ZFS Local PV -- in progress ( pending review from Kiran/Prateek) - setup on debian - dependency checks ( praveen / pawan ) - LVM CSI Driver -- in progress - extract the common packages into openebs/lib-csi ( pawan ) -- done - capacity based scheduler for ZFS-LocalPV (pawan) - iops throttling explore - lvm-driver : lvm volumes are not visible on the host -- try lvrescan - lvm name length, CSI sanity issue - lvm resize support -- (pawan) ## Dec 18th 2020 Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil, Kiran - blog on incremental backup/restore -- in progress - backup and restore using different bucket - migrate the e2e test cases to ZFS-LocalPV -- in progress - schedule a meeting on Monday - helm chart for ZFS Local PV -- in progress ( pending review from Kiran/Prateek) - setup on debian - dependency checks ( praveen / pawan ) - LVM CSI Driver -- in progress - extract the common packages into openebs/lib-csi ( pawan ) - lvm-localpv - capacity based scheduler for ZFS-LocalPV (pawan) ## Dec 11th 2020 Attendees: Pawan, Aman - blog on incremental backup/restore -- in progress - restore in diff ns -- done - incremental backup -- done - pvc clone testing -- done - refactor the README -- in progress - raise a pr in velero-plugin to fix change-pvc-node-selector config label - readme PR review -- Aman ## Dec 4th 2020 Attendees: Pawan, Aman - kustomize testing -- done - blog on incremental backup/restore -- in progress - code refactoring, no functionality will be added - have to run a pipeline with the ci -- done - restore in diff ns -- in review - incremental backup -- in review - pvc clone testing -- in review - refactor the README -- in progress - raise a pr in velero-plugin to fix change-pvc-node-selector-config label ## Nov 20th 2020 Attendees: Pawan, Aman this release - code refactoring, no functionality will be added - document update - doc update : restore on a diff node - refactor the README - multi arch image testing -- done - put the question in the velero channel regarding snapshotter error -- no reply - kustomize testing -- in progress - pvc clone testing -- done - parallel upgrade testing -- done - blog on incremental backup/restore -- in progress ## Nov 13th 2020 Attendees: Pawan, Aman - multi arch image testing - put the question in the velero channel regarding snapshotter error - kustomize testing - pvc clone testing - parallel upgrade testing - blog on incremental backup/restore ## Oct 16th 2020 Attendees: Pawan, Aman e2e test : - incremental backup/restore (ee and community) - manual testing done - restore on different node (ee and community) - manual testing done - scheduled backup/restore - manual testing done - full backup/restore - done - upgrade testing : velero upgrade from 2.1.0 - to 2.2.0 and test the scheduled backup/restore - test on s3 storage - future goal : test on different cluster Development: - BDD for backup/restore - multi arch build - support NFS for ZFS-LocalPV - CSI driver Sanity test - deployment via kustomize - any issue/bug fixes. ## Oct 9th 2020 Attendees: Pawan, Aman, Giri RC-1 Test cases test upgrade : create schdedule backup/restore from old version and then upgrade to RC1. - There should not be any issue - restore should work for old as well as for the new backups - check the storage directory size, the size should be less - test on s3 storage - future goal : test on different cluster Automated - restore in same namespace - restore in other namespace - schedule backup test cases ## Sept 18th 2020 Attendees: Pawan, Aman, Kiran - create issues :- - deployment via kustomize - capacity based scheduling - grafana charts for ZPOOL capacity and component / driver status - recover volumes from cluster/node disaster recovery = when there are no backup of zfs volume CRs - Validations - stop from making accidental deletions (namespace or CR deletions) ( webhook or OPA is required ) - Node is gone and disks are moved to new node. Recreate the PV. (new operator to auto-detect and recover) - Monitor and replace failed Disk (NDM ) - Backup/Restore without velero dependency - CSI Driver test - Unit Test cases - - Integration Tests - Validations - stop from making accidental deletions (namespace or CR deletions) - E2e issues? - volume count based scheduling - - Possible Refacotring Ideas to support multiple (local) backends - (approach 1) openebs/local-csi. take the code from ZFS Local PV and modularize. Add support for lvm, rawfile - (approach 2) - openebs/lib-storage-scheduling. code for picking up the node to provision storage. support volume count, capacity based. - openebs/zfs-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling ) - openebs/rawfile-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling ) - openebs/dynamic-localpv = use the openebs/lib-storage-scheduling ## Sept 11th 2020 Attendees: Pawan, Aman - Backup and restore Development (as alpha feature) - intial changes are merged - add support to restore on different cluster - add support for incremental backup/restore - Backup and restore Development test cases update test cases on the wiki ## Sept 4th 2020 Attendees: Pawan, Aman - Backup and restore Development (as alpha feature) : - velero side changes has been approved - zfs-localpv side changes are under review) - incremental backup/restore is under development - e2e - test case for upgrade -- done - backup and restore via velero (test plan @aman) - node failure scenario (@aman) -- done - one yaml for all OS platform ubuntu, centos 7/8, k3s (if possible) - 1.0 will be GA release -- in-progress - wiki page done (@aman) ## Aug 28th 2020 Holiday ## Aug 21st 2020 Attendees: Pawan, Aman - backup and restore via velero (test plan @aman) - node failure scenario (@aman) -- in-progress - 1.0 will have backup and restore and helm support -- in-progress - 1.0 will be GA release -- in-progress - roundoff fix testing -- manual testing done - wiki page inprogress (@aman) ## Aug 14th 2020 Attendees: Pawan, Aman - backup and restore via velero (test plan @aman) - 0.9.1 release on 15th of Aug -- done - patch the fixes in 0.9x branch -- done - 1.0 will have backup and restore and helm support -- in-progress - 1.0 will be GA release -- in-progress - enable enterprise test case on centos clone on xfs -- in-progress - operator yaml testing on k8s 1.14 -- done - roundoff fix testing -- manual testing done - wiki page inprogress (@aman) ## Aug 7th, 2020 Attendees: Pawan, Aman, Kiran, Vishnu - 0.9.1 release on 15th of Aug - patch the fixes in 0.9x branch - 1.0 will have backup and restore and helm support - 1.0 will be GA release - enable enterprise test case on centos clone on xfs - operator yaml testing on k8s 1.14 - roundoff fix testing - wiki page inprogress (@aman) ## July 31st, 2020 Attendees: Pawan, Aman - wiki page inprogress (@aman) - pipeline script needs to change to accomodate the path change - backup/restore velero side changes are done - compiling spl on centos 8, struct has been changed here, causing compilation failure - zfs crash found in Optoro (seems to be version incompatibility issue) - shared mount using busybox (done) - bloomberg performance issue with ZFS-LocalPV (tunables to improve performance) (@aman) ## July 17th, 2020 Attendees: Pawan, Aman, Kiran ### Discussions - Automation of zpool creation [@pawan] - Focus on chaos testing along with functional tests - Link the test cases running in pipeline to the automated test scripts. (With READme's in master branch) - Update the wiki page for QA with all plateforms and k8s and zfs versions. ## June 5th, 2020 Attendees: Pawan, Aman, Kiran ### Discussions - Review/triage the ZFS Local PV tracker - Review/triage the ZFS Local PV E2e tests tracker - Review existing tests and add them to the ZFS Local PV wiki. - Initial draft is available for review. - Install and OS compabilitly - Attempted to mount /lib and /lib64 - some more validation is required before going with this approach. - Going with different YAMLs approach for now. - Helm charts will be made available in the next release. (1.12) ## May 22nd, 2020 Attendees: Pawan, Aman, Kiran ### Discussions - Review/triage the ZFS Local PV tracker - Review/triage the ZFS Local PV E2e tests tracker - Review existing tests and add them to the ZFS Local PV wiki. - Install and OS compabilitly - Need different YAMLs for each OS - Need travis yaml for building OS specific images - Helm to include variables for each OS ## May 8th, 2020 Attendees: Pawan, Aman, Kiran ### Agenda - [Kiran] Review Backlogs https://github.com/orgs/openebs/projects/10 - [Pawan] ZFS bug with unmount RCA is still under investigation. Will reach out to ZFS community - [Pawan] Check on the missing metrics and check if PRs can be raised to Node Exporter - [Aman] E2e for Raw Block - [Aman] E2e. Manually verified the kubelet and docker restarts - [Aman] E2e. Bulk volume testing automation is in progress - [Kiran] Helm / openebs operator to include ZFS Local PV (not started) - [Aman] ZFS Grafana Dashboard - Blocked with onprem grafana/prometheus setup - [Pawan/Kiran] Moving Local PVs? - Working on a doc for migrating PVs to new node, when underyling disks are moved to new node.