OpenEBS Contributors Meet - Notes & Agenda

Location: https://meet.google.com/rui-powc-fgt

Date: Bi-Weekly On Thursday

Time: - 9:30AM PDT/12:30PM EDT/6:30PM CEST/10:00 PM IST

Add the event in your calendar - Google

Add your request, question or suggestion to our issue list

If you have anything you'd like to put on the agenda, please do so below for the next meeting.

20 Dec, 2023

Attendees: Blr OpenEBS team

20 Dec, 2023

Attendees: Blr OpenEBS team

06 Dec, 2023

Attendees: Blr OpenEBS team

29 Nov, 2023

Attendees: Blr OpenEBS team

22 Nov, 2023

Attendees: Blr OpenEBS team

16 Nov, 2023

Attendees: Blr OpenEBS team

08 Nov, 2023

Attendees: Blr OpenEBS team

01 Nov, 2023

Meeting canceled due to public holiday

25 Oct, 2023

Attendees: Blr OpenEBS team

18 Oct, 2023

Attendees: Blr OpenEBS team

11 Oct, 2023

Attendees: Blr OpenEBS team

04 Oct, 2023

Attendees: Blr OpenEBS team

27 Sep, 2023

  • Cancelled

20 Sep, 2023

Attendees: Blr OpenEBS team

13 Sep, 2023

Attendees: Blr OpenEBS team

07 Sep, 2023

Attendees: Blr OpenEBS team

30 Aug, 2023

Attendees: Blr OpenEBS team

23 Aug, 2023

Attendees: Blr OpenEBS team

16 Aug, 2023

Attendees: Blr OpenEBS team

16 Sept, 2021

Attendees: Harsh Vardhan, Abhishek Agarwal, Kiran Mova, Niladri Halder

27 May, 2021

Attendees: Prateek, Akhil, Shubham, Niladri, Sai

  • Localpv BDD and unit tests

    • controller runtime fake refer clients
    • VSCode (go generate) can be used to generate scaffolding for units tests
    • Refer zfs localpv for integration tests

  • Jiva Replica movement when Node replaced with new Node

    • Single replica case there is chance to data loss, once the application move to other node and the user is not aware of data
    • Have as a feature-gate feature which can be enabled via jiva-operator ?

  • CNCF Bugbash PR

    • CStor-Operators:

      • Mostly closed
      • Some of the PR to fix string format error are still pending, which can be ignored and closed with a comment.

    • NDM:

      • All bugbash related PRs are merged/closed.

    • Jiva-operators:

      • All bugbash related PRs are merged/closed.

    • zfs-localpv:

      • All bugbash related PRs are merged/closed.

13 May, 2021

Attendees: Akhil, Shubham, Harshvardhan, Kiran, Niladri

  • Demo for openebsctl

29 April, 2021

Attendees: Prateek, Niladri, Akhil, Shubham, Parth

  • cStor Enhancements

    • Automatic CStor pool provisioning. Disk being added automatically when any blockdevice is added.
    • IPv6 support for cStor
      • Changes need to be made in cStor backend

  • Jiva Enhancenments

    • IPv6 support for Jiva
      • Changes need to be made in Jiva backend

  • OpenEBSctl

    • New team members – Abhinandan and Harsh
    • A meeting time is yet to be decided for syncup
    • Use cases may include a user with a PVC lead and the CLI commands

  • CNCF Bugbash

  • Community Issues

    • Not many bug reports
    • Mostly new use cases

15 April, 2021

Attendees: Prateek, Niladri, Akhil, Murat, Abhishek

  • Openebs Community Tracker

  • Openebsctl

    • no updates

  • Openebs Monitoring

    • Exploring Scylla DB
    • Planning to discuss initial design proposal with team

  • LVM LocalPV

    • thin pool size can't be bigger than actual volume group size
    • volumegroup size can't be used since it will throw the similar error of insufficient space
    • thinking of using a constant size which later can be extend once the data% get occupied using lvextend command

  • SPC and older Provisioning deprecate

    • Plannining to deprecate SPC and older provisioning in coming releases
    • Need to refactor the openebs charts to install the cstor and other charts and dependencies

1 April, 2021

Attendees: Prateek, Niladri, Akhil, Rahul, Sahil, Parth, Sahil

18 March, 2021

Attendees: Prateek, Akhil, Eric, Shubham, Abhishek, Parth, Rahul

  • Contributors Onboarding

    • Linux Foundation Mentorship

    • CLI initial implementation of openebsctl https://github.com/openebs/openebsctl

      • Volume Health checker
      • Openebs Installation validation, check health for openebs core components
      • Draft Proposal: Google Doc

    • Grafana dashboard productisation

  • Community

    • Async replication
      • cstor works with synchronous replication
      • qourum needs to healthy for a successful IO completions
      • MayaStor can be one of the solution ?
    • Stale iscsi disks, even after volume no longer exists
      • Force deletion, cleanup issue
      • Restart not required,iscsiadm command can be used to logout the iscsi sessions
      • microsk8s and kubeadm
    • Block device status changes frequently
      • Forced cleanup of openebs
    • UUID label not present

  • OpenEBS release

4 March, 2021

Attendees: Prateek, Akhil, Eric, Shubham

  • Contributors Onboarding

    • Openebs Upgrade

      • Code walk through
      • Implementation details
      • New Upgrade design
      • Script vs GOlang code ?

    • Migration to CSI with new challenges

      • New CSI Spec changes in PersistentVolumeclaims and PersistentVolumes
      • Openebs APIs Schema and group version changes
      • Application downtime

  • Clean up activity, deprecate maya ?

    • Couple of PR merged

18 Feb, 2021

Attendees: Prateek, Akhil, Eric, Shubham

  • Slack-community issues discussion

  • Contributors Onboarding

    • NDM
      • Package structuring
      • Code walk through

  • CFP

    • Rust days in kubecon, cfp's are open

4 Feb, 2021

Attendees: Prateek, Akhil, Niladri, Eric, Shubham

21 Jan, 2021

Attendees: Prateek, Akhil

  • Contributor onboarding

    • Need an overview of the code and general patterns used in the OpenEBS projects.
      • Go code org (package structure)
      • COBRA CLI
      • Unit tests using TDD pattern
      • Ginkgo for e2e tests within repository (aka BDD)
      • Controller Pattern
      • Builder Pattern

  • Repo Conclusion to represent accroding to the above agenda

    • 4th Feb 2021 – Cstor Operators (Prateek)
    • 18th Feb 20221 – NDM (Akhil)

7 Jan, 2021

Attendees: Prateek, Akhil,

24 Dec,2020

Planned Agenda:

  • MayaStor Installation

    • load nvme tcp modules ( command needs to be added)
    • Node name instead of Hostname ( in case of AWS based clusters)
    • Multiple MSP in a single Node ?
    • Does StorageClass support MSP parameter ?
    • MSP with multiple disks ?

  • LVM CSI Driver

  • Jiva CSI

    • Jiva Feature parity ( JivaPolicy, other cas config based features)

  • CStor CSI

    • Multi Attach: deprecate VoluemAttachment, some refactoring
    • PR under review

  • LocalPV move to other Node in case of node shutdown

    • Design and Initial changes

Open PRs & Issues:

  • NDM CRDs and openAPI validations

    • All the changes has been done , need to do a final reviews

  • Cstor Helm Charts

    • All the changes has been pushed, got the approvals from the team
    • Pending for merge

  • ZFS LocalPV Helm Charts

    • All the changes has, pending on final review

  • Dynamic LocalPV Provisioner Helm Charts

    • All the changes has, pending on final review

26 Nov,2020

Attendees: Prateek, Akhil, Shubham

Planned Agenda:

  • Quota Enforcement for Local PV

    • Filesystem quota is the way to go ?

  • Remove the disk from the stripe cstor pool

    • Data distributed across the disk part of the pool
    • Backup the volumes and Restore to the new pool ( fastest way ?)
    • Delete one of the pool and recreate it, once synced do the same with other 2 pools

  • Deprecate Maya repo

    • Local PV moved out
    • m-exporter moved out
    • CStor moved out to cstor-operators and cstor-csi
    • Jiva [Under discussion]
    • CStor Upgrade moved out to openebs/upgrade repo
    • Jiva Upgrade [under progress]

  • Discuss about workloads and Data engines in upcoming meets

Open PRs & Issues:

12 Nov,2020

Cancelled due to holidays

29 Oct,2020

Attendees: Prateek, Akhil, Shubham

Planned Agenda:

Open PRs & Issues:

  • feat(core, uuid): add dm support
    • working on review comments
  • Openebs CRDs to use v1 api versions
  • V2 modules understandings with controller gen
    • Handle the code-gen part having v2 module path
    • handle the conversion func with v2 module path

Discussion:

  • Hacktoberfest 2020 we mainly focused on quality instead of quantity
  • The virtual Hacktoberfest has been a bit unenthusiastic for sure, f2f interaction always helps to get good contributors.
  • Even we have issue with enough details but didn't get claimed by the contributors as they are not straightforward
  • Some issues have the example implementation to learn from, but unfortunately didn’t get claimed by any contributors.
  • We got some linting, docs fixes and translations PRs as they are easy to fix

15 Oct,2020

Attendees: Prateek,Akhil

Planned Agenda:

Open PRs & Issues:
- Helm Chart delete failed due namespace delete webhook validation
- Block Device status changes frequently
- If there is any existing partition table exists, but without a actual partition
- NDM will retry continously to create partition and failed to do that, hence the status changes continously.
- ZFS localPV Shared PVC not able to used by the other application due to SELinux enable
- Work around: Set common SELinux level in both application pods
- Good to create an issue with more details

​​​​- Add filter for empty block device tag label value
​​​​    - https://github.com/openebs/node-disk-manager/pull/500
​​​​    - Needs to add some unit tests
​​​​
​​​​- Update the linux-utils multi-arch image in release operator yamls (@akhil)

Questions and issues to be discussed:
- AquaSecurity trivy github action to run CVE checks on container images
- https://github.com/aquasecurity/trivy-action

October 1,2020

Attendees: Prateek,Harsh,Akhil,Shubham

Planned Agenda:

Open PRs & Issues:
- CRDs V1 migration
- Going to be deprecate in k8s 1.22 version
- Migrate openebs CRDs in 2.3.0 version
- Migrate NDM CRDs in next version
- Add OpenAPIV3 validation to NDM CRDs using controller-gen tool

​​​​- NDM and OpenEBS CRDs migration to Charts template as aprt of new charts

Questions and issues to be discussed:
- NDM: Migrate operator-sdk to native client-go/kubebuilder ?
-

September 17,2020

Attendees:
Prateek, Akhil, Raj Das,

Planned agenda:

Open PRs & Issues:

Questions and issues to be discussed:

  • Snapshot Schedule OEP (Prateek)
    • A custom controller with SnapshotSchedule resource ?
  • openebsctl to create snapshot schedule
  • Use LVM as raw Block Device (Akhil)
  • Openebsctl blockdevice mgmt via consuming grpc client
    • Desing docs for gRPC server
  • Add kubeflow to use OpenEBS localPV as Storage (Raj Das)
  • Raj Das: GSoc experiences
    • Prometheus: To run prom-bench in KIND based k8s cluster
    • Resolve the infra issue

Open Proposals:

September 10, 2020

Attendees:

Prateek,Akhil,Ashutosh,Harsh,Sai,Shubham

Planned agenda:

  • Design Docs for initial start
  • Release Updates:
    • v2.1.0-RC1 released today
    • filtering BD based on tags now added in CSPC, now user can add block-device tag to cspc annotation to filter out the BD in the cluster, earlier it was added in localPV
    • Config Based tag generation to tag different BD
    • Zfs local pv backup/restore
    • Velero plugin parallel restore/backup

Open PRs & Issues:

  • Migrate logging to klog openebs/cstor-csi
  • Update the openEBS helm install website doc issue
  • Ability to specify KUBECONFIG variable in openebsctl
  • Node-disk-manager charts PR
  • Install Chart Dependencies in a namespace

Questions and issues to be discussed:

  • Replica scheduling/distribution – custom-scheduler, a external controller/scheduler
    • Ashutosh - to add OEP link
  • Openebsctl Suggestions:
    • install openebs,jiva, zfs, mayastor
    • Openebsctl upgrade : background/forground upgrade process job/cli
    • openebsctl blockdevice to manage, metrics , rescan, huge-pages, scsi status
  • CrossPlane to provision mayastor nodes using cloud-api

Open Proposals:

Select a repo