owned this note
owned this note
Published
Linked with GitHub
OpenEBS CSI Local PV Discussions Notes
===
:::info
- **Location:** https://meet.google.com/yoq-fktt-qqn
- **Date:** Every week from 12:45pm to 01:15pm on Monday (IST)
- **Agenda**
1. Walk through the status update via the tracker
2. Discussion topic
*Add your request, question or suggestion to our [issue list](https://github.com/openebs/openebs/issues)*
*If you have anything you’d like to put on the agenda, please do so below for the next meeting:*
:::
## Nov 29, 2021
Attendees: Pawan, Abhishek
1. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek -- design doc (https://docs.google.com/document/d/13D8Ht__66n66c5ZBThPwqhKjyJey0GFKVO3dgK3w8OA/edit) is in review (pawan/Vishnu)
2. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) -- PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
3. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress
4. volume scheduler for Flipkart -- (shovan) explore -- POC done, Shovan will raise a PR
5. velero jr0dd feture request to not send backup to remote location.
6. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked
7. merge device localpv with lvm -- not started yet -- (pawan)
8. thin pool design discussion -- (pawan/yashpal) -- blocked
9. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30) -- PR has been raised https://github.com/openebs/device-localpv/pull/51, waiting for the review
10. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
11. data populator design doc -- (shovan) -- parked for now
12. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
14. debugging end point -- export pprof end point -- (yashpal) agent was stuck and could not progress, need to have some debug endpoint.
## Oct 25, 2021
Attendees: Pawan, Yashpal, Abhishek
1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress
2. volume scheduler for Flipkart -- (shovan) explore -- POC done, Shovan will raise a PR
3. velero jr0dd feture request to not send backup to remote location.
4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked
5. merge device localpv with lvm -- not started yet -- (pawan)
6. thin pool design discussion -- (pawan/yashpal) -- blocked
7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
9. data populator design doc -- (shovan) -- parked for now
10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek -- in-process
13. debugging end point -- export pprof end point -- (yashpal) agent was stuck and could not progress, need to have some debug endpoint.
## Oct 18, 2021
Attendees: Pawan, Aman, Abhishek
1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress
2. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC
3. velero jr0dd feture request to not send backup to remote location.
4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked
5. merge device localpv with lvm -- not started yet -- (pawan)
6. thin pool design discussion -- (pawan/yashpal) -- blocked
7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
9. data populator design doc -- (shovan) -- parked for now
10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134) -- abhishek
13. register topology key from env for ZFS-LocalPV -- (shubham) -- merged
14. handle topology key in e2e test cases -- (aman) need to raise the PR -- PR is not required as default behavior is to keep all the node labels as topology key. -- done
## Oct 11, 2021
Attendees: Pawan, Aman, Prateek
1. SCP node agent Design Doc for FK phase 2 -- (pawan) in-progress
2. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC
3. velero jr0dd feture request to not send backup to remote location.
4. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked
5. merge device localpv with lvm -- not started yet -- (pawan)
6. thin pool design discussion -- (pawan/yashpal)
7. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
8. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
9. data populator design doc -- (shovan) -- parked for now
10. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
12. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)
13. register topology key from env for ZFS-LocalPV -- (shubham) PR is in review
14. handle topology key in e2e test cases -- (aman) need to raise the PR.
## Oct 04, 2021
Attendees: Pawan, Aman, Shovan, Abhishek
1. volume go missing issue on RHEL -- done, user closed the issue
2. SCP node agent Design Doc for FK phase 2
3. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC
4. velero jr0dd feture request to not send backup to remote location.
5. making snapshot available to the original pod -- (yashpal/abhranil) -- blocked
6. merge device localpv with lvm -- not started yet -- (pawan)
7. thin pool design discussion -- (pawan/yashpal)
8. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
9. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
10. data populator design doc -- (shovan) -- parked for now
11. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
13. shared pv support for LVM LocalPV - (requirement from seagate https://github.com/openebs/lvm-localpv/issues/134)
## Sept 27, 2021
Attendees: Pawan, Aman
1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch. -- done
2. merge the cherry pick PRs in LVM and ZFS LocalPV -- done
3. SCP node agent Design Doc for FK phase 2
4. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC
5. volume go missing issue on RHEL
6. velero jr0dd feture request to not send backup to remote location.
7. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman) -- done
8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
9. merge device localpv with lvm -- not started yet -- (pawan)
10. thin pool design discussion -- (pawan/yashpal)
11. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
12. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
13. data populator design doc -- (shovan) -- parked for now
14. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
15. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
## Sept 13, 2021
Attendees: Pawan, Aman, Shovan
1. Upgrade PR is needed for LVM and ZFS LocalPV. Aman will raise a PR against master branch and we need to cherry pick to the release branch.
2. merge the cherry pick PRs in LVM and ZFS LocalPV -- pending on Pawan
3. SCP node agent Design Doc for FK phase 2
4. volume scheduler for Flipkart -- (shovan) explore -- design doc done, working on POC
5. raw block test cases for device-localpv -- (aman) -- in-review (satya) -- merged
6. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv -- merged
7. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman) -- done
8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
9. merge device localpv with lvm -- not started yet -- (pawan)
10. thin pool design discussion -- (pawan/yashpal)
11. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38) -- done
12. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
13. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
14. data populator design doc -- (shovan) -- parked for now
15. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
16. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
## Aug 30, 2021
Attendees: Pawan, Aman, Yashpal, Shovan, Sahil, Abhishek
Agenda: using device-localpv for FK phase 2
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
2. data populator design doc -- (shovan) -- parked for now
3. volume scheduler for Flipkart -- (shovan) explore -- design doc review is in progress
4. raw block test cases for device-localpv -- (aman) -- in-review (satya)
5. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv
6. https://github.com/openebs/lvm-localpv/issues/140 -- need to add --enable-capacity arg for csi-provisioner image(aman)
7. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
10. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
11. merge device localpv with lvm -- not started yet -- (pawan)
12. thin pool design discussion -- (pawan/yashpal)
13. roundoff not needed for device-localpv (https://github.com/openebs/device-localpv/issues/38)
14. propagate the error to the controller (https://github.com/openebs/device-localpv/issues/30)
## Aug 23, 2021
Attendees: Pawan, Sahil, Abhishek, Aman, Yashpal, Vishnu, Shovan
Agenda: https://github.com/openebs/lvm-localpv/issues/134
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
2. data populator design doc -- (shovan) -- parked for now
3. volume scheduler for Flipkart -- (shovan) explore -- design doc review is in progress
4. raw block test cases for device-localpv -- (aman) -- in-progress
5. CSI storage scheduling issue -- need to change the csi-provisioner image for lvm, zfs and device localpv
6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. CSI volume health monitoring - (pawan/yashpal) -- on hold
8. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- Done -- (aman is working on adopters doc)
9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
10. parted command issue -- (Praveen) -- done, yashpal already filed two issues
11. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman) -- documented
12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan) -- parked for now
13. merge device localpv with lvm -- not started yet -- (pawan)
14. Fix Error Handling On Creation Failure -- (pawan/akhil) -- done
15. thin pool design discussion -- (pawan/yashpal)
## Aug 16, 2021
Attendees: Pawan, Akhil
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
2. data populator design doc -- (shovan) -- parked for now
3. volume scheduler for Flipkart -- (shovan) explore
4. raw block test cases for device-localpv -- (aman) -- in-progress
5. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline) -- parked for now
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. CSI volume health monitoring - (pawan/yashpal) -- on hold
7. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adopters doc)
8. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
9. parted command issue -- (Praveen)
10. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman)
11. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
12. merge device localpv with lvm -- not started yet -- (pawan)
13. Fix Error Handling On Creation Failure -- (pawan/akhil)
14. thin pool design discussion -- (pawan/yashpal)
## Aug 9th, 2021
Attendees: Pawan, Shovan, Aman, Akhil, Abhishek, Shubham,
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done -- parked for now
2. data populator design doc -- (shovan) -- parked for now
3. volume scheduler for Flipkart -- (shovan) explore
4. device-localpv add upgrade test case -- (aman) -- done
5. raw block test cases for device-localpv -- (aman)
6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offline)
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. CSI volume health monitoring - (pawan/yashpal) -- on hold
8. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adopters doc)
9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
10. parted command issue -- (Praveen)
11. performance testing for thick and thin volumes -- done, need to document it. (pawan/aman)
12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
13. merge device localpv with lvm -- not started yet -- (pawan)
14. Fix Error Handling On Creation Failure -- (pawan/akhil)
15. thin pool design discussion -- (pawan/yashpal)
## Aug 2nd, 2021
Attendees: Pawan, Shovan, Abhishek, Shubham, Aman, Akhil
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done
2. data populator design doc -- (shovan)
3. volume scheduler for Flipkart -- (shovan) explore
4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing -- done
5. device-localpv add upgrade test case -- (aman)
6. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offilen)
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) merged
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. LVM LocalPV docs (pawan/aman) -- doc, contributor doc, adopters, setup etc -- in-progress -- (aman is working on adompters doc)
10. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
11. parted command issue -- (Praveen)
12. performance testing for thick and thin volumes -- todo (pawan/aman)
13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
14. merge device localpv with lvm -- not started yet -- (pawan)
15. refactoring PR for device localpv -- (akhil) -- merged
16. Fix Error Handling On Creation Failure -- (pawan/akhil)
17. add test case for stale volume -- (pawan/yashpal) megred
16. thin pool design discussion -- (pawan/yashpal)
## July 26th, 2021
Attendees: Pawan, Shovan, Abhishek, Shubham, Sahil, Vishnu
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done
2. data populator design doc -- (shovan)
3. volume scheduler for Flipkart -- (shovan) explore
4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing
5. lvm corruption issue -- (prateek) -- working design -- (Todo: syncup offilen)
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review
7. CSI volume health monitoring - (pawan/yashpal) -- on hold
8. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress -- (aman is working on adompters doc)
9. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
10. parted command issue -- (Praveen)
11. performance testing for thick and thin volumes -- todo (pawan/aman)
12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
13. merge device localpv with lvm -- not started yet -- (pawan)
14. refactoring PR for device localpv -- (akhil) -- in reivew
15. add test case for stale volume -- (pawan/yashpal) in-review
16. thin pool design discussion -- (pawan/yashpal)
## July 19th, 2021
Attendees: Pawan, Akhil, Shovan, Abhishek, Vishnu, Prateek, Shubham, Praveen, Sahil
1. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done
2. data populator design doc -- (shovan)
3. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing
4. add doc for snapshotclass snapsize parameter -- (pawan/prateek) -- merged
5. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review
7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR) -- merged
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
10. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
11. performance testing for thick and thin volumes -- todo (pawan/aman)
12. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
13. merge device localpv with lvm -- not started yet -- (pawan)
14. refactoring PR for device localpv -- (akhil) -- in reivew
15. add test case for stale volume -- (pawan/yashpal) in-review
16. thin pool design discussion -- (pawan/yashpal)
## July 12th, 2021
Attendees: Pawan, Akhil, Shovan, Aman, Vishnu, Yashpal, Sahil
1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- published
2. data migrartion from one node to other -- (shovan) -- working on operator -- prototype is done
3. data populator design doc -- (shovan)
4. e2e test case for device - will be doing manually for this release. -- in review (satya) -- basic provisioning and custom topology test cases and some chaos testing
5. add doc for snapshotclass snapsize parameter -- (pawan/prateek)
6. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. Added LVM vg,lv,pv metrics, pool metrics for LVM LocalPV -- (abhishek) in-review
8. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR)
9. CSI volume health monitoring - (pawan/yashpal) -- on hold
10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
12. performance testing for thick and thin volumes -- todo (pawan/aman)
13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
14. merge device localpv with lvm -- not started yet -- (pawan)
15. add test case for stale volume -- (pawan/yashpal) in-review
16. pvc null issue for device localpv -- debug (pawan/praveen) -- akhil - merged
17. thin pool design discussion -- (pawan/yashpal)
## July 5th, 2021
Attendees: Pawan, Akhil, Shovan, Aman, Shubham, Prateek, Abhishek, Sahil
1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress
2. data migrartion from one node to other -- (shovan) -- working on design doc, working on operator
3. e2e test case for device - will be doing manually for this release. -- in review (satya)
4. thin provisioning support for snapshots -- (prateek) - merged -- testing in progress (aman) -- verified
5. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu) -- merged
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress (blocked on a PR)
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. monitoring for device localpv - (abhishek/sahil/yashpal) -- merged
10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
12. add docs for snapsize for LVM LocalPV
13. performance testing for thick and thin volumes -- todo (pawan/aman)
14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
15. merge device localpv with lvm -- not started yet -- (pawan)
16. refactoring device localpv -- (akhil/praveen)
17. add test case for stale volume -- (pawan/yashpal) in-progress
16. pvc null issue for device localpv -- debug (pawan/praveen) -- akhil - raise a PR
17. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-review
18. validation while deleting volumes and snapshots for ZFS -- (akhil) on hold.
19. thin pool design discussion -- (pawan/yashpal)
## June 28th, 2021
Attendees: Pawan, Abhishek, Shovan, Sahil, Aman, Vishnu, Yashpal, Shubham
1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress
2. data migrartion from one node to other -- (shovan) -- working on design doc, working on operator
3. e2e test case for device - will be doing manually for this release. -- in progress
4. thin provisioning support for snapshots -- (prateek) - merged -- testing in progress (aman)
5. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu)
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
7. Alert for issues on disk (shubham). explore on mapping disks to NPD. -- in-progress
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. monitoring for device localpv - (abhishek/sahil/yashpal) -- inprogress
10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
12. performance testing for thick and thin volumes -- todo (pawan/aman)
13. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
14. merge device localpv with lvm -- not started yet -- (pawan)
15. add test case for stale volume -- (pawan/yashpal) in-progress
16. pvc null issue for device localpv -- debug (pawan/praveen)
17. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-review
18. validation while deleting volumes and snapshots -- in-review
## June 21th, 2021
Attendees: Pawan, Shubham, Aman, Praveen, Abhishek, Shovan
1. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress
2. data migrartion from one node to other -- (shovan) -- working on design doc
3. e2e test case for device - will be doing manually for this release. -- in progress
4. thin provisioning support for snapshots -- (prateek) - in progress
5. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
6. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu)
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
7. Alert for issues on disk (shubham). explore on mapping disks to NPD.
8. CSI volume health monitoring - (pawan/yashpal) -- on hold
9. monitoring for device localpv - (abhishek) -- inprogress
10. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
11. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
12. make snapshot size configurable via snapshot class -- SnapSize (% or absolute) in snapshotclass
13. performance testing for thick and thin volumes -- todo (pawan/aman)
14. thin pool + snapshot, how we can reserve space for snapshot. (praveen/pawan)
15. merge device localpv with lvm -- not started yet -- (pawan)
16. add test case for stale volume -- (pawan/yashpal) in-progress
17. pvc null issue for device localpv -- debug (pawan/praveen)
18. pool metrics for LVM LocalPV -- (abhishek/sahil) -- in-progress
## June 14th, 2021
Attendees: Abhishek, Abhranil, Yashpal, Praveen, Akhil, Shubham, Shovan, Prateek, Aman, Sahil, Pawan
1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal)
- lib-csi PR merged. WIll update device-localpv -- merged
2. data populators -- (Shovan) sample populator -- blog is in review by marketing team -- inprogress
3. data migrartion from one node to other -- (shovan) -- working on design doc
4. e2e test case for zfs - PR is in review. -- merged
5. e2e test case for device - will be doing manually for this release.
6. lvm corruption issue -- (prateek) -- working design
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. monitoring for LVM LocalPV -- PR is in review (yashpal, vishnu)
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
8. Alert for issues on disk (shubham). explore on mapping disks to NPD.
9. CSI volume health monitoring - (pawan/yashpal) -- will explore today.
10. Device LocalPV docs(akhil) - in review (praveen) -- merged
11. monitoring for device localpv
12. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
13. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
14. make snapshot size configurable via snapshot class
15. thin pool + snapshot, how we can reserve space for snapshot.
16. performance testing for thin pool
17. merge device localpv with lvm -- not started yet -- (pawan)
18. add test case for stale volume -- (pawan/yashpal) in-progress
## June 7, 2021
Attendees: Shubham, Shovam Sahil, Akhil, Sai, Vishnu, Yashpal, Aman
1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal)
- lib-csi PR merged. WIll update device-localpv
2. data populators -- (Shovan) sample populator -- blog is in review by marketing team
3. data migrartion from one node to other -- (shovan) -- started on prototyping
4. e2e test case for zfs - PR is in review.
5. e2e test case for device - will be doing manually for this release.
6. lvm corruption issue -- (prateek) in-progress
- Testing the multi node scenarios
- Moving the disk across the Nodes
7. monitoring for LVM LocalPV
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- charts are done
- need to explore on options of using this as plugin/custom-metrics in node exporter.
8. Alert for issues on disk (shubham). explore on mapping disks to NPD.
9. CSI volume health monitoring - (pawan/yashpal) -- will explore today
10. Device LocalPV docs(akhil) - in review (praveen)
11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
12. add CSI Storage capacity scheduling for ZFS-LocalPV (shubham) - merged
13. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
14. merge device localpv with lvm -- not started yet -- (pawan)
15. add test case for stale volume -- (pawan/yashpal) in-progress
16. support online resize for btrfs -- (sai) - merged
## May 31st 2021
Attendees: Pawan, Shubham, Akhil, Shovan, Aman, Prateek
1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- in review (prateek, akhil, shubham, pawan)
2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
3. data migrartion from one node to other -- (shovan) -- yet to start
4. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- approved -- merged
5. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue -- closed
6. e2e test case for lvm -- in progress (aman)-- done
7. e2e test case for zfs -- pr in review (aman) -- will be done by RC1
8. e2e test case for device -- yet to start (aman) -- yet to start
9. lvm corruption issue -- (prateek) in-progress
10. monitoring for LVM LocalPV
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- in-progress
11. CSI volume health monitoring -- (pawan/yashpal) -- explore
12. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc -- in-progress
13. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
14. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) -- in-review (pawan/akhil)
15. making snapshot available to the original pod -- (yashpal/abhranil) -- in-progress
16. merge device localpv with lvm -- not started yet -- (pawan)
17. add test case for stale volume -- (pawan/yashpal)
18. verify volume capability -- (sai) -- PR merged
19. wipefs when we are deleting the lvm volume -- (sai) -- merged
20. support online resize for btrfs -- (sai) -- in-progress
## May 24th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Yashpal, Praveen, Sai
1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- in review (prateek, akhil, shubham, pawan)
2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- approved -- waiting on kiran to merge
4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
5. e2e test case for lvm -- in progress (aman)
6. e2e test case for zfs -- pr in review (aman)
7. e2e test case for device -- yet to start (aman)
8. lvm corruption issue -- (prateek) in-progress
9. make PV migration completely automatic -- (pawan) -- in design
10. monitoring for LVM LocalPV
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- in-progress
11. CSI volume health monitoring -- (pawan/?) -- explore
12. an issue including list of metrics needed -- (yashpal) -- done
13. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc -- in-progress
14. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc -- in-progress
15. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham) -- in-review (pawan/akhil)
16. making snapshot available to the original pod -- (yashpal/abhranil) -- waiting for the backup team
17. merge device localpv with lvm -- not started yet -- (pawan)
18. add test case for stale volume -- (pawan/yashpal)
19. verify volume capability -- (sai)
20. wipefs when we are deleting the volume -- (sai)
21. support resize for btrfs -- (?)
## May 17th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Kiran, Abhishek, Abhranil, Yashpal, Sahil
1. stale volume cleanup when inprogress volume gets deleted before provisioing succeed. -- (yashpal) -- inprogress
2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised -- review inprogress
4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman) - monitor this issue
5. helm chart for LVM localPV -- setup (prateek) -- PR merged.
6. make PV migration completely automatic -- (pawan) -- in design
7. monitoring for LVM LocalPV
- logging (Ashish) -- logs monitoring
- metrics () -- add grafana chart -- in-progress
8. CSI volume health monitoring -- (pawan/?) -- explore
9. an issue including list of metrics needed -- (yashpal)
10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc
11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc
12. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham)
13. making snapshot available to the original pod -- (yashpal/abhranil)
14. merge device localpv with lvm -- not started yet -- (pawan)
15. merge e2e test cases in the repo for lvm/zfs. -- (aman)
## May 10th 2021
Attendees: Pawan, Shubham, Prateek, Akhil, Shovan
1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize. -- merged
2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil) (https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan) -- PR raised
4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
5. helm chart for LVM localPV -- setup (prateek)
6. make PV migration completely automatic -- (pawan)
7. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started
8. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc
9. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc
10. add CSI Storage capacity scheduling for ZFS-LocalPV -- (Shubham)
11. merge device localpv with lvm
12. merge e2e test cases in the repo for lvm/zfs.
## May 3rd 2021
Attendees: Pawan, Aman, Akhil, Shovan, Praveen, Shubham, Prateek
1. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
2. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
3. master helm chart -- https://docs.google.com/document/d/1RE3rKWnsn3rmzPJ-ZtVCe6NvIH8o_FT2VKoh8UbSYBw/edit (shovan)
4. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
5. update go mod to 1.4.0 for lvm-localpv -- (prateek) -- merged
6. check the snapshot when original volume has already been deleted -- (akhil) merged
7. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS. pr merged for zfs.
8. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham/prateek) -- a new PR be raised with github workflow for helm lint and releaser (prateek)
9. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started
10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc
11. LVM LocalPV docs (pawan) -- doc, contributor doc, setup etc
12. device localpv refactoring -- Praveen
13. add CSI Storage capacity scheduling for ZFS-LocaPV
14. merge device localpv with lvm
## April 26th 2021
Attendees: Pawan, Aman, Akhil, Shubham, Shovan
1. data populators -- (Shovan) sample populator -- blog is in review (kiran/akhil)(https://docs.google.com/document/d/1o9ZFqM2Ul9iTbQlCJZAOhhHLccIM1ycWKrN5YM_BXHI/edit)
2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
3. multi pool support for lvm (praveen/yashpal) -- (pawan) merged.
- Need to update the docs (aman)
4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
5. update go mod to 1.4.0 for lvm-localpv -- (prateek)
6. check the snapshot when original volume has already been deleted -- (akhil) in progress
7. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS.
8. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham/prateek)
9. monitoring for LVM LocalPV (pawan) -- add grafana chart -- not started
10. Device LocalPV docs (akhil) -- feature doc and CSI compatibility doc
11. device localpv refactoring -- Praveen
## April 19th 2021
Attendees: Pawan, Aman, Prateek, Akhil, Shubham
1. data populators -- (Shovan) sample populator --
2. Restore stuck in zfs localpv. Ref https://github.com/openebs/zfs-localpv/issues/310 (Aman)
3. multi pool support for lvm (praveen/yashpal) -- (pawan) merged.
- Need to update the docs
4. thin pool size constraints for lvm volumes - Ref: https://github.com/openebs/lvm-localpv/pull/49
- doc update will also be required in case of resize.
5. check the snapshot when original volume has already been deleted -- (akhil) -- next release
6. support node migration of the lvm/zfs disks -- (pawan). PR already raised for ZFS.
7. add helm chart for lvm localpv -- (yashpal) -- in review (akhil/shubham)
8. monitoring for LVM LocalPV (pawan)
9. Device LocalPV docs (akhil)
## April 12th 2021
Attendees: Pawan, Prateek, shubham, Akhil, Shovan, Abhranil, Aman
1. data populators -- (Shovan) sample populator
2. multi pool support for lvm (praveen/yashpal) -- (pawan) review -- pushed to next release
3. thin provisioning for lvm volumes -- prateek -- merged
4. check the snapshot when original volume has already been deleted -- (akhil) -- next release
5. support node migration of the lvm disks -- (pawan) -- in progress
6. add helm chart for lvm localpv -- (yashpal)
## April 5th 2021
Attendees: Pawan, Prateek, Aman, Akhil, Shovan, Praveen
1. device localpv make kubegen issue -- done
2. ginko test cases for device localpv -- done (akhil)
3. add device support for volumes -- done (praveen/akhil) in alpha
4. multi pool support for lvm (praveen/yashpal) -- (pawan) review
5. thin provisioning for lvm volumes -- prateek -- in-review(pawan)
6. bump k8s for zfs/lvm -- in review (prateek) -- done
7. check the snapshot when original volume has already been deleted -- (akhil) -- next release
8. support node migration of the lvm disks -- (pawan) -- in progress
9. add helm chart for lvm localpv -- (yashpal)
## Mar 30th 2021
1. device localpv make kubegen issue -- akhil, pawan
2. ginko test cases for device localpv -- pawan
3. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) inprogress
4. multi pool support for lvm (praveen/yashpal) -- (pawan) review
5. test the device CSI driver and see if are we getting the grpc call -- done
6. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done
7. thin provisioning for lvm volumes -- prateek -- in-review(pawan)
8. bump k8s for zfs/lvm -- in review (pawan)
9. check the snapshot when original volume has already been deleted -- (akhil)
10. support node migration of the lvm disks -- (pawan)
## Mar 19th 2021
1. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) started
2. multi pool support for lvm (praveen/yashpal) -- (pawan) review
3. add docs for lvm -- how to add custom node label (akhil)
4. test the device CSI driver and see if are we getting the grpc call -- (pawan)
5. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done
6. thin provisioning for lvm volumes -- prateek
7. bump k8s for zfs/lvm
8. check the snapshot when original volume has already been deleted -- (akhil)
9. support node migration of the lvm disks -- (pawan)
## Mar 12th 2021
Attendees: Pawan, Aman, Akhil, Prateek
1. support restore in an encrypted pool -- merged
2. setup ubuntu 20 to have encryption support -- done
3. iops throttling explore (Abhranil) -- done -- pending item : iops throttling for block devices
4. add volume group capacity tracking -- done
5. add device support for volumes (provisioning/deprovisioning) -- (pawan/praveen) started yet
6. multi pool support for lvm (praveen/yashpal) -- under-review
7. add docs for lvm
8. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done
9. thin provisioning for lvm volumes -- prateek
10. bump k8s for zfs
## Mar 5th 2021
Attendees: Pawan, Aman, Akhil, Shubham Yashpal, Prateek
1. support restore in an encrypted pool -- in-Review (kiran) zfs is merged, velero PR is still pending
2. setup ubuntu 20 to have encryption support -- tested(aman)
3. iops throttling explore (Abhranil) -- done -- pending item : iops throttling for block devices
4. add volume group capacity tracking -- done -- in-review (pawan/akhil/prateek)
5. e2e PR for LVM -- done
6. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release
7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- done
8. thin provisioning support for lvm volumes -- (pawan/prateek) https://github.com/openebs/lvm-localpv/pull/30
9. add device support for volumes (provisioning/deprovisioning) -- (praveen) not started yet
10. multi pool support for lvm/zfs (praveen/yashpal) not started yet -- under-review
11. making snapshots available to the source pod -- investigation (praveen/pawan) -- poc is done
## Mar 2nd 2021
Attendees: Pawan, Aman, Akhil, Abhranil, Praveen, Yashpal, Prateek
1. encryption backward compatibility test -- done
2. support restore in an encrypted pool -- in-Review (kiran) zfs is merged, velero PR is still pending
3. setup ubuntu 20 to have encryption support -- tested(aman)
4. iops throttling explore (Abhranil) -- in-review (pawan/akhil) -- lib-csi PR is merged
5. add volume group capacity tracking -- in-review (pawan/akhil/prateek)
6. e2e PR for LVM -- in review
7. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release
8. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- in-review (pawan)
9. thin provsioning support for lvm volumes -- (pawan/prateek)
10. add device support for volumes (provisioning/deprovisioning) -- (praveen) not started yet
11. multi pool support for lvm/zfs (praveen/yashpal) not started yet
12. making snapshots available to the source pod -- investigation (praveen/pawan)
## Feb 19th 2021
Attendees: Pawan, Aman, Prateek, Abranil
1. encryption backward compatibility test
2. support restore in an encrypted pool -- in-Review (kiran)
3. setup ubuntu 20 to have encryption support
4. iops throttling explore (Abhranil) -- in-review (pawan/akhil) -- lib-csi PR is merged
5. add volume group capacity tracking -- in-review (pawan/akhil)
6. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release
7. return proper error while creating the volume : (yashpal) https://github.com/openebs/lvm-localpv/pull/23 -- in-review (pawan)
8. thin provsioning support for lvm volumes -- (pawan) -- pushed for next release
9. add device support for volumes (provisioning/deprovisioning) -- (preveen) not started yet
10. multi pool support for lvm/zfs (praveen/yashpal) not started yet
11. making snapshots available to the source pod -- investigation (praveen/pawan)
e2e:
1. have basic test cases for provisioning/deprovisioning
2. BDD test cases
Doc:
1. Doc for provisioning/deprovisioning
2. Resize
3. raw block volume
4. doc custom topology
5. snapshot
## Feb 12th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal
1. iops throttling explore (Abhranil) -- in-review (pawan/akhil)
2. add volume group capacity tracking -- in-review (pawan/akhil)
3. capacity based scheduler for LVM -- done
4. snapshot support for LVM (akhil) -- done
5. wait for volume to be created (zfs) -- in-review (kiran) -- pushed for next release
6. return proper error while creating the volume (yashpal/pawan)
7. lvm volumes not visible on the host -- (debug pawan/praveen/yashpal) -- lvdisplay command has some issue -- pvscan --cached
8. thin provsioning support for lvm volumes -- (pawan) -- pushed for next release
9. add device support for volumes (provisioning/deprovisioning) -- not started yet
10. multi pool support for lvm/zfs (praveen/yashpal)
11. making snapshots available to the source pod -- investigation (praveen/pawan)
## Feb 5th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen, Yashpal, Prateek
1. iops throttling explore (Abhranil) -- in-progress
2. snapshot support for LVM (akhil) -- in-review (pawan)
3. wait for volume to be created (zfs) -- in-review (kiran)
4. lvm volumes not visible on the host -- (debug pawan/praveen/yashpal) -- lvdisplay command has some issue -- pvscan --cached
5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (yashpal)
6. thin provsioning support for lvm volumes -- (pawan)
7. capacity based scheduler for LVM
8. add device support for volumes (provisioning/deprovisioning) -- not started yet
9. add clone support for LVM LocalPV -- discuss Design
10. multi pool support for lvm/zfs (praveen/yashpal)
## Jan 29th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil, Praveen
1. snapshot support for LVM (akhil) -- in-review (pawan)
2. wait for volume to be created (zfs) -- in-review (kiran)
3. lvm volumes not visible on the host -- (debug pawan/praveen) -- lvdisplay command has some issue
4. raw block volume support for LVM -- in-review (akhil/kiran)
6. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen)
7. iops throttling explore (Abhranil) -- in-progress
8. thin provsioning support for lvm volumes -- (pawan)
9. add device support for volumes (provisioning/deprovisioning)
10. add clone support for LVM LocalPV -- discuss Design
11. multi pool support for lvm/zfs (praveen)
## Jan 25th 2021
Attendees: Pawan, Aman, Shubham, Akhil, Abhranil,
1. snapshot support for LVM (akhil) -- in-progress -- use latest CR
2. add clone support for LVM LocalPV -- To Do
3. wait for volume to be created (zfs)-- look at csi-provsioner for stale volume issue (corner case)
4. lvm volumes not visible on the host -- (debug pawan/praveen)
5. raw block volume support for LVM -- (pawan)
6. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen)
7. iops throttling explore (Abhranil) -- in-progress
## Jan 15th 2021
1. LVM 0.1 release available
2. wait for volume to be created -- (pawan)
3. lvm volumes not visible on the host -- (debug pawan/praveen)
4. snapshot support for LVM (akhil) -- in-progress
5. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen)
6. iops throttling explore (Abhranil) -- in-progress
7. add clone support for LVM LocalPV -- (pawan/akhil)
8. lvm provisioner name : local.csi.openebs.io
## Jan 8th 2021
1. wait for volume to be created -- (pawan)
2. capacity based scheduler for LVM -- (praveen)
3. lvm volumes not visible on the host -- (debug pawan/praveen)
4. setup on debian - dependency checks ( pawan )
5. move pkg/response to csi-resize
6. snapshot support for LVM (akhil)
7. resize PR review (praveen)
8. look into storage capacity tracking : https://github.com/kubernetes/enhancements/blob/master/keps/sig-storage/1472-storage-capacity-tracking/README.md#csidriverspecstoragecapacity -- (pawan/praveen)
- iops throttling explore (Abhranil)
## Dec 30th 2020
Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil,
- backup and restore using different bucket -- manual verification done
- blog on incremental backup/restore -- in progress (pawan)
- migrate the e2e test cases to ZFS-LocalPV -- in progress work started
- helm chart for ZFS Local PV -- in progress ( pending review from Kiran/Prateek)
- setup on debian - dependency checks ( praveen / pawan )
- LVM CSI Driver -- in progress
- extract the common packages into openebs/lib-csi ( pawan ) -- done
- capacity based scheduler for ZFS-LocalPV (pawan)
- iops throttling explore
- lvm-driver : lvm volumes are not visible on the host -- try lvrescan
- lvm name length, CSI sanity issue
- lvm resize support -- (pawan)
## Dec 18th 2020
Attendees: Pawan, Aman, Prateek, Shubham, Akhil, Praveen, Abhranil, Kiran
- blog on incremental backup/restore -- in progress
- backup and restore using different bucket
- migrate the e2e test cases to ZFS-LocalPV -- in progress - schedule a meeting on Monday
- helm chart for ZFS Local PV -- in progress ( pending review from Kiran/Prateek)
- setup on debian - dependency checks ( praveen / pawan )
- LVM CSI Driver -- in progress
- extract the common packages into openebs/lib-csi ( pawan )
- lvm-localpv
- capacity based scheduler for ZFS-LocalPV (pawan)
## Dec 11th 2020
Attendees: Pawan, Aman
- blog on incremental backup/restore -- in progress
- restore in diff ns -- done
- incremental backup -- done
- pvc clone testing -- done
- refactor the README -- in progress
- raise a pr in velero-plugin to fix change-pvc-node-selector config label
- readme PR review -- Aman
## Dec 4th 2020
Attendees: Pawan, Aman
- kustomize testing -- done
- blog on incremental backup/restore -- in progress
- code refactoring, no functionality will be added
- have to run a pipeline with the ci -- done
- restore in diff ns -- in review
- incremental backup -- in review
- pvc clone testing -- in review
- refactor the README -- in progress
- raise a pr in velero-plugin to fix change-pvc-node-selector-config label
## Nov 20th 2020
Attendees: Pawan, Aman
this release
- code refactoring, no functionality will be added
- document update
- doc update : restore on a diff node
- refactor the README
- multi arch image testing -- done
- put the question in the velero channel regarding snapshotter error -- no reply
- kustomize testing -- in progress
- pvc clone testing -- done
- parallel upgrade testing -- done
- blog on incremental backup/restore -- in progress
## Nov 13th 2020
Attendees: Pawan, Aman
- multi arch image testing
- put the question in the velero channel regarding snapshotter error
- kustomize testing
- pvc clone testing
- parallel upgrade testing
- blog on incremental backup/restore
## Oct 16th 2020
Attendees: Pawan, Aman
e2e test :
- incremental backup/restore (ee and community) - manual testing done
- restore on different node (ee and community) - manual testing done
- scheduled backup/restore - manual testing done
- full backup/restore - done
- upgrade testing : velero upgrade from 2.1.0 - to 2.2.0 and test the scheduled backup/restore
- test on s3 storage
- future goal : test on different cluster
Development:
- BDD for backup/restore
- multi arch build
- support NFS for ZFS-LocalPV
- CSI driver Sanity test
- deployment via kustomize
- any issue/bug fixes.
## Oct 9th 2020
Attendees: Pawan, Aman, Giri
RC-1 Test cases test upgrade :
create schdedule backup/restore from old version and then upgrade to RC1.
- There should not be any issue
- restore should work for old as well as for the new backups
- check the storage directory size, the size should be less
- test on s3 storage
- future goal : test on different cluster
Automated
- restore in same namespace
- restore in other namespace
- schedule backup test cases
## Sept 18th 2020
Attendees: Pawan, Aman, Kiran
- create issues :-
- deployment via kustomize
- capacity based scheduling
- grafana charts for ZPOOL capacity and component / driver status
- recover volumes from cluster/node disaster recovery = when there are no backup of zfs volume CRs
- Validations - stop from making accidental deletions (namespace or CR deletions) ( webhook or OPA is required )
- Node is gone and disks are moved to new node. Recreate the PV. (new operator to auto-detect and recover)
- Monitor and replace failed Disk (NDM )
- Backup/Restore without velero dependency
- CSI Driver test
- Unit Test cases
-
- Integration Tests
- Validations - stop from making accidental deletions (namespace or CR deletions)
- E2e issues?
- volume count based scheduling
-
- Possible Refacotring Ideas to support multiple (local) backends
- (approach 1) openebs/local-csi. take the code from ZFS Local PV and modularize. Add support for lvm, rawfile
- (approach 2)
- openebs/lib-storage-scheduling. code for picking up the node to provision storage. support volume count, capacity based.
- openebs/zfs-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
- openebs/rawfile-localpv = use the openebs/lib-storage-scheduling ( openebs/zfs-localpv/scheduling )
- openebs/dynamic-localpv = use the openebs/lib-storage-scheduling
## Sept 11th 2020
Attendees: Pawan, Aman
- Backup and restore Development (as alpha feature)
- intial changes are merged
- add support to restore on different cluster
- add support for incremental backup/restore
- Backup and restore Development test cases update test cases on the wiki
## Sept 4th 2020
Attendees: Pawan, Aman
- Backup and restore Development (as alpha feature) :
- velero side changes has been approved
- zfs-localpv side changes are under review)
- incremental backup/restore is under development
- e2e
- test case for upgrade -- done
- backup and restore via velero (test plan @aman)
- node failure scenario (@aman) -- done
- one yaml for all OS platform ubuntu, centos 7/8, k3s (if possible)
- 1.0 will be GA release -- in-progress
- wiki page done (@aman)
## Aug 28th 2020
Holiday
## Aug 21st 2020
Attendees: Pawan, Aman
- backup and restore via velero (test plan @aman)
- node failure scenario (@aman) -- in-progress
- 1.0 will have backup and restore and helm support -- in-progress
- 1.0 will be GA release -- in-progress
- roundoff fix testing -- manual testing done
- wiki page inprogress (@aman)
## Aug 14th 2020
Attendees: Pawan, Aman
- backup and restore via velero (test plan @aman)
- 0.9.1 release on 15th of Aug -- done
- patch the fixes in 0.9x branch -- done
- 1.0 will have backup and restore and helm support -- in-progress
- 1.0 will be GA release -- in-progress
- enable enterprise test case on centos clone on xfs -- in-progress
- operator yaml testing on k8s 1.14 -- done
- roundoff fix testing -- manual testing done
- wiki page inprogress (@aman)
## Aug 7th, 2020
Attendees: Pawan, Aman, Kiran, Vishnu
- 0.9.1 release on 15th of Aug
- patch the fixes in 0.9x branch
- 1.0 will have backup and restore and helm support
- 1.0 will be GA release
- enable enterprise test case on centos clone on xfs
- operator yaml testing on k8s 1.14
- roundoff fix testing
- wiki page inprogress (@aman)
## July 31st, 2020
Attendees: Pawan, Aman
- wiki page inprogress (@aman)
- pipeline script needs to change to accomodate the path change
- backup/restore velero side changes are done
- compiling spl on centos 8, struct has been changed here, causing compilation failure
- zfs crash found in Optoro (seems to be version incompatibility issue)
- shared mount using busybox (done)
- bloomberg performance issue with ZFS-LocalPV (tunables to improve performance) (@aman)
## July 17th, 2020
Attendees: Pawan, Aman, Kiran
### Discussions
- Automation of zpool creation [@pawan]
- Focus on chaos testing along with functional tests
- Link the test cases running in pipeline to the automated test scripts. (With READme's in master branch)
- Update the wiki page for QA with all plateforms and k8s and zfs versions.
## June 5th, 2020
Attendees: Pawan, Aman, Kiran
### Discussions
- Review/triage the ZFS Local PV tracker
- Review/triage the ZFS Local PV E2e tests tracker
- Review existing tests and add them to the ZFS Local PV wiki.
- Initial draft is available for review.
- Install and OS compabilitly
- Attempted to mount /lib and /lib64 - some more validation is required before going with this approach.
- Going with different YAMLs approach for now.
- Helm charts will be made available in the next release. (1.12)
## May 22nd, 2020
Attendees: Pawan, Aman, Kiran
### Discussions
- Review/triage the ZFS Local PV tracker
- Review/triage the ZFS Local PV E2e tests tracker
- Review existing tests and add them to the ZFS Local PV wiki.
- Install and OS compabilitly
- Need different YAMLs for each OS
- Need travis yaml for building OS specific images
- Helm to include variables for each OS
## May 8th, 2020
Attendees: Pawan, Aman, Kiran
### Agenda
- [Kiran] Review Backlogs https://github.com/orgs/openebs/projects/10
- [Pawan] ZFS bug with unmount RCA is still under investigation. Will reach out to ZFS community
- [Pawan] Check on the missing metrics and check if PRs can be raised to Node Exporter
- [Aman] E2e for Raw Block
- [Aman] E2e. Manually verified the kubelet and docker restarts
- [Aman] E2e. Bulk volume testing automation is in progress
- [Kiran] Helm / openebs operator to include ZFS Local PV (not started)
- [Aman] ZFS Grafana Dashboard
- Blocked with onprem grafana/prometheus setup
- [Pawan/Kiran] Moving Local PVs?
- Working on a doc for migrating PVs to new node, when underyling disks are moved to new node.