# Dragonfly Nydus bi-weekly meeting

###### tags: `nydus` `meeting`

Time: at 06:00 UTC (14:00 Beijing, Shanghai)
Every two weeks starting from Aug 10, 2022 on Wednesday

*Everyone* is welcome to propose topics or suggest agenda alterations there.

[Nydus image service](https://nydus.dev/)

[Conference URL](https://zoom.us/j/91462272196?pwd=c0FINVplcHhUSGQ2ZHNmQzI3YklJUT09) with embedded passcode
[Meeting Calendar](https://zoom.us/meeting/tJUpceuqqTkrE9JITSyVZo04tAms-qUENJIm/ics?icsToken=98tyKuCpqj0oGNOXsRCBRowcBo_oa-rwtnpcj_p3tSvWGhZpbVOiIsNPIf9uJf3-)

Recordings will be made available on Youtube later.

### Proposed topics
- Feature proposal (including fscache, EROFS on containers, etc.)
- Important issues;
- Roadmap update;
- Other topics needed to be discussed together.

### Preferred Languages
- Chinese (with English notes)
- English (if needed)

template at the bottom

## Next

### Attendees:
- Yan Song \<[e-mail]\>

### Actionable Agenda Items:

- Sync up nydus community updates

* toml based configuration for nydusd and snapshotter (wip);
* make snapshotter as cri proxy to get auth (done);
* nydus local CAS #956 (by Jianan Huang);
* nydus content store proxy (wip);
* refactor nydusify;
* refactor smoke test;

- Sync up erofs on fscache updates

* 6.2: fscache interface update;
* 6.3: page cache sharing, failover: (tbd, Jingbo Xu);
* blob gc: shared by Yin Xin (snapshotter/nydusd inuse cull);
* chunkmap persist or restore: shared by Yin Xin;
* support large folios (Jingbo Xu);

- Nydus 2.2 release

* make v2.2 stable;

## Dec 14, 2022

### Attendees:
- Yan Song \<[e-mail]\>
- Bo Liu \<[e-mail]\>

### Actionable Agenda Items:

- Sync up nydus community updates

* support zran conversion and runtime (wip);
* toml based configuration for nydusd and snapshotter (wip);
* s3 backend support (wip);
* make snapshotter as cri proxy to get auth (wip);
* nydus local CAS #956 (by Jianan Huang);

- Sync up erofs on fscache updates

* 6.2: fscache interface update;
* 6.3: page cache sharing, failover: (tbd, Jingbo Xu);
* blob gc: shared by Yin Xin (snapshotter/nydusd inuse cull);
* chunkmap persist or restore: shared by Yin Xin;
* support large folios (Jingbo Xu);

- Nydus 2.2 release

* targz build performance improvement;
* support OCI-referenced zran image;
* TODO:
* Integration test (rc release);
* Nydusify convert/check, nydus-image check;
* Rafs v6 fs verity;
* Test docker top images;
* stargz support (unstable);
* nydus c libarary (unstable);

## Nov 16, 2022

### Attendees:
- Yan Song \<[e-mail]\>
- Gao Xiang \<[e-mail]\>
- Jiang Liu \<[e-mail]\>
- Bo Liu \<[e-mail]\>

### Actionable Agenda Items:

- Sync up nydus community updates

* buildkit/nerdctl/podman (done);
* support targz to rafs/ref conversion and runtime (wip);
* nydus snapshotter: decouple daemon and rafs, daemon configuration improvement (done)
* toml based configuration for nydusd and snapshotter (wip);

- Sync up erofs on fscache updates

* daemonless: shared by Yin Xin (done, syncing with fscache);
* blob gc: shared by Yin Xin (snapshotter/nydusd inuse cull);
* page cache sharing: (tbd, Jing Bo);

- Nydus 2.2 release

* targz build performance improvement;
* support OCI-referenced zran (nydus ref image);
* support snapshot view;

## Nov 02, 2022

Skipped

## Oct 19, 2022

### Attendees:
- Yan Song \<[e-mail]\>
- Bo Liu \<[e-mail]\>
- Gao Xiang \<[e-mail]\>

### Actionable Agenda Items:

### Notes:

- Sync up nydus community updates

* buildkit/nerdctl/podman;
* nydus & dragonfly mirror mode (done)
* support targz to rafs/ref conversion;
* nydus snapshotter improvements;
* local cas updates (Jianan Huang);

- Sync up erofs on fscache updates

* shared domains: shared by Zhu Jia
* daemonless: shared by Yin Xin
* fscache e2e startup preformance: shared by Yin Xin
* blob gc: (wip, create a issue to track)
* page cache sharing: (tbd)
* failover, hot upgrade (done)
* unfairless of fscache requests: by increasing thread count to 4 (done)

- Nydus 2.1 release

* python it & image conversion ci
* unify fusedev and virtiofs frontend (done)
* nydusd & snapshotter mirror mode (done)

### Recording
https://youtu.be/KLLwXupIeDQ

## Sep 21, 2022

### Attendees:
- Xiang Gao \<[e-mail]\>
- Yan Song \<[e-mail]\>
- Xin Yin \<[e-mail]\>
- Bo Liu \<[e-mail]\>

### Actionable Agenda Items:

### Notes:

- Sync up nydus community updates

* buildkit/podman/nerdctl;
* snapshotter liveness monitor (done);
* nydus & dragonfly mirror mode (wip);
* openanolis community package (nydus, buildkit, acceld, dragonfly, harbor) (wip);

- Sync up erofs on fscache updates

* shared domains: shared by Zhu Jia (merged to erofs dev branch, prepare for kernel 6.1, add ut, snapshotter support)
* daemonless: shared by Yin Xin (pin & unpin command)
* fscache e2e startup preformance: shared by Yin Xin (dio or buffer io)
* page cache sharing (tbd)
* failover, hot upgrade (done)
* blob gc (wip)
* unfairless of fscache requests: by increasing thread count to 4 (done)

- Nydus 2.1 release (tbd)

* python it & image conversion ci
* unify fusedev and virtiofs frontend
* nydusd & snapshotter mirror mode

- Nydus 2.2 feature proposal

* nydusd configuration format 2.0 (toml?)
* nydus lib (open issue to track)

### Recording
https://youtu.be/Vj8AAdbi320

## Sep 07, 2022

### Attendees:
- Xiang Gao \<[e-mail]\>
- Yan Song \<[e-mail]\>
- Zhu Jia \<[e-mail]\>
- Jiang Liu \<[e-mail]\>
- Xin Yin \<[e-mail]>
- Changwei Ge \<[e-mail]\>
- Tao Peng \<[e-mail]\>

### Actionable Agenda Items:

### Notes:

- Sync up nydus community updates

* some fixups
* misc: add more release archs (done)
* nydus-test: framework supports fscache mode (done)
* nydusify: abort oss blob upload if conversion failed (done)
* snapshotter: enhance daemon state management (wip, v0.3.0)
* buildkit/podman/nerdctl/acceld

- Sync up erofs on fscache updates

* shared domains: shared by Zhu Jia, integrating with nydusd + snapshotter
* daemonless: shared by Yin Xin, how daemon restore, better to sync with David
* fscache e2e startup preformance: shared by Yin Xin, fscache dio or buffer io (community issue to track)?
* page cache sharing:
* failover, hot upgrade:
* blob gc:
* unfairless of fscache requests: by increasing thread count (2,4?)

- Nydus 2.1 release plan

* integration test failed (nydusd sock, EAGAIN + response hang)
* enable rafs v5 build + running
* unify fusedev & virtiofs

- Nydus 2.2 Feature Proposal
- data dedup with local CAS(content addressable storage)
- rolling hash dedup (linux 6.1, nydusd compressor support)
- zstd product ready (converter option)
- lazy pulling of ociv1/stargz image
- nydus SDK (library interface)
- nydus + nixos
- prefetch in unit of chunk rather than whole file

- Test Framework
- Image format validation
- Regression test
- Performance test

### Recording:
https://youtu.be/QP-NkA2fjww

## Aug 24, 2022

### Attendees:
- Xiang Gao \<[e-mail]\>
- Zhang Yifei \<[e-mail]\>
- Zhu Jia \<[e-mail]\>
- Yan Song \<[e-mail]\>
- Bo Liu \<[e-mail]\>
- Jingbo Xu \<[e-mail]\>

### Actionable Agenda Items:

### Notes:

- Sync up nydus community updates

* nydus storage plugin for cri-o/podman made as non-core subproject of redhat containers community [done];
* snapshotter support k8s docker config secret authentication [done], cri multiple registries (mirrors, scheme, skip_verify) support [wip];
* nydusify view subcommand for trivy image scanner [done], refactor inspect subcommand [almost done];
* simplify nydusify check subcommand (enhance fs consistency check [done], generate backend config [done], remove `docker inspect` deps [wip]);
* nerdctl supports nydus snapshotter [done] and image conversion [wip];
* prepare for v2.1.0 release [wip];

- Sync up erofs on fscache updates

* shared domains: shared by Yin Xin, introduce daemonless usecase, benefit, current progress and TBD;
* daemonless: shared by Zhu Jia, introduce usecase, design, TBD and code repo;
* page cache sharing: <none>;
* failover, hot upgrade: <none>;
* blob gc: <none>;
* unfairless of fscache requests: <none>;

- Nydus use scenarios

* container image;
* function serverless, code package (csi plugin);
* data insight (chunk de-duplication, prefetch optimization, local cas, image size optimization, access log, image hotfix);
* antgroup tnpm (25s -> 6s, faster than pnpm);
* image scanner (`nydusify view` for trivy);

- eStargz/OCI snapshotter

* Gao Xiang shares how nydus supports lazy load without converting OCIv1 images.

### Recording:
https://youtu.be/JSzhXDRG96M

## Aug 10, 2022

### Attendees:
- Xiang Gao \<[e-mail]\>
- Zhu Jia \<[e-mail]\>
- Yan Song \<[e-mail]\>
- Zhang Yifei \<[e-mail]\>
- Jiang Liu \<[e-mail]\>
- Bo Liu \<[e-mail]\>

### Actionable Agenda Items:
- introduction and meeting kickoff
- fscache update and roadmap discussion

### Notes:
- Sync up the fscache next roadmap, see:
https://hackmd.io/@Nydus/BktSGJKp5
- As of fscache shared domains and page cache sharing, we'd like to get more numbers to prove that is useful for real production;
- There is some question about "Nydus convert" time efficiency compared with OCIv1 for continuous integration. Nydus images can be built directly with "buildkit" without explicitly conversion, since Nydus images have faster build speed than OCIv1, so it can benefit the build time as well;
- Raise a question "how to convert online machine to shared daemon mode" if moving to fscache;
- Work out a way to resolve fscache direct I/O impact for "on-demand read";
- A brief discussion about unfairless of fscache requests and a possible solution.
- Share more numbers about ondemand mode gains among different use scenarios.

### Recording:
https://youtu.be/hO0jumTTrh0

## Meeting Date

### Attendees:
- _add your name \<your email\>_

### Actionable Agenda Items:
- Who's taking notes?
- _add your items_

### Notes:

### Recording: