Ceph-CSI standup meeting notes

Meeting Info

URL: https://meet.google.com/nnn-txfp-cge
Time: Mondays, Tuesdays and Thursdays, 12:00 UTC, 17:30 Asia/Kolkata (date -d 12:00 UTC)

Out-Of-Office announcements:
Holidays:

Template

Instructions: Copy the following template, edit the date, and fill in the host and participants. Everyone should put their status and topic into the notes.

2024-02-00 - hosted by

Attendees:

Status

<your name here>
- <status item>

2024-10-28 - hosted by Madhu

Attendees: Madhu, Nikhil

Status

Nikhil
- go-ceph PR to add progress report API is merged
- Ceph-CSI PR is up and under review to log the progress report
  - https://github.com/ceph/ceph-csi/pull/4918
- Opened a draft PR for ModifyVolume RPC support
  - https://github.com/ceph/ceph-csi/pull/4916
  - Need to work on e2e tests and identifying relevant immutable params for the drivers
Madhu
- Added E2E to test ROX PVC-PVC clone for RBD

Topics

2024-10-21 - hosted by Madhu

Attendees: Nikhil, Madhu
Duration of meeting: … minutes

Status

Madhu
- NetworkFence Design
  - https://github.com/ceph/ceph-csi/issues/4913
- Qos Design for RBD
  - https://github.com/ceph/ceph-csi/blob/devel/docs/design/proposals/rbd-qos.md
Nikhil
- Expose CSI metrics - PR
- Log cephfs clone status
  - go-ceph PR is under review
- Looking into implementation of ModifyVolume RPC
  - Check what all params could be modified for cephfs, rbd and nfs.

Topics

2024-10-14 - hosted by

Attendees: Madhu, yati
Duration of meeting: … minutes

Status

Yati
- https://github.com/ceph/ceph-csi/pull/4905

Topics

2024-09-30 - hosted by Madhu

Attendees: Yati, Nikhil, Madhu, Niraj
Duration of meeting: … minutes

Status

<your name here>
- <status item>

Topics

Improvements for upstream
- Run CSI test suite for cephcsi - yati
- Enable more tests in external kubernetes tests
- Update the documents (Readme/etc) - Niraj
  - Remove unsupported version from the document.
- Work on test framework for csi-addon features - Nikhil
- VolumeAttribute class feature
- Update static tools - Niraj
- Add timeout to Ceph GET API calls - Nikhil
- Look for new feature requirements from community - yati

2024-07-01 - hosted by

Attendees: Nraj,yati, praveen
Duration of meeting: … minutes

Status

<your name here>
- <status item>

Topics:

2024-02-20 - hosted by Yati

Attendees: Manish, Niels, Yati
Duration of meeting: … minutes

Status

Yati
- PR on: https://github.com/ceph/ceph-csi/pull/4452
- stale subvolume cleanup testing
Manish:
Niels:
- PR reviews
- rebase Helm client to generate charts (CVE related)

Topics

Niels
- Volume Group Snapshots ideally do not use existing spaghetti coded RBD snapshotting functions.
- New, cleanly written functions for Volume Group Snapshot could be a base for the Volume Snapshot implementation.

2024-01-23 - hosted by Praveen M

Attendees:
Duration of meeting: … minutes

Status

Praveen M:
- Working on rook issue https://github.com/rook/rook/issues/13580
Niels:
- CentOS CI Jenking fails to download containers from internal mirror
- GetVolumeGroupSnapshot status problem identified in upstream CRD

Topics

2024-01-16 - hosted by Yati

Attendees: Madhu, Niels, Yati
Duration of meeting: … minutes

Status

Madhu
- Discussion on making rbd mirror count configurable
- Sent Rook PR to make leaderelection configurable
Niels
- updated external-snapshotter PR with GetGroupSnapshotStatus
  https://github.com/kubernetes-csi/external-snapshotter/pull/837
Yati
- Working on epic for 4.16 readouts

Topics

2023-12-05 - hosted by Rakshith

Attendees:
Duration of meeting: … minutes

Status

Praveen M
- Bug fix: https://github.com/ceph/ceph-csi/pull/4298
- pr reviews
Rakshith
- completed v3.10.0 release https://github.com/ceph/ceph-csi/releases/tag/v3.10.0
- working on updating rook's default cephcsi image to 3.10.0
- pr reviews.

Topics

2023-11-14 - hosted by Rakshith

Attendees: Madhu, Niels, Praveen, Yati
Duration of meeting: … minutes

Status

Praveen
- Working on PR review for kernel & fuse mount options per cluster
- Working on CephFS read affinity
Rakshith
- rook work for ceph-csi configmap changes to accomodate read affinity + fuse/kernel mountoptions
- pr reviews.
Niels
- RBD getCloneDepth testing PR#4013
- misc PR reviews and moving PRs through CI
Madhu
- PR review in cephcsi and Rook
- Sent PR for dependabot https://github.com/csi-addons/kubernetes-csi-addons/pull/484
Yati
- Working on to test stale subvolume epic

Topics

2023-10-31 - hosted by

Attendees:
Duration of meeting: … minutes

Status

Praveen M
- testing PR - removal of subvolumegroup creation
- working on review - read affinity map options per cluster
Yati
- Checking out kubectl-rook-ceph repo for epic
- PR reviewa
- must-gather works
Madhu
- PR reviews
Niels
- updating PR for CephFS health checker
- working on adding Lease support to kubernetes-csi-addons

Topics

2023-09-26 - hosted by

Attendees:
Duration of meeting: … minutes

Status

Rakshith
- Working on design for replication of cloned PVC/Snapshots

Topics

2023-09-26 - hosted by Rakshith

Attendees: Praveen, Riya
Duration of meeting: … minutes

Status

<your name here>
- <status item>
Riya
- Addressed reviews on client eviction PR and testing locally.
Rakshith
- Opened issues: https://github.com/ceph/ceph-csi/issues/4149
- reviewing https://github.com/kubernetes/enhancements/pull/3004
Praveen
- PR merged: https://github.com/ceph/ceph-csi/pull/4111
- Working on Issues
  - https://github.com/ceph/ceph-csi/issues/4149
  - https://github.com/ceph/ceph-csi/issues/4067

Topics

2023-08-22 - hosted by

Attendees: Rakshith
Duration of meeting: … minutes

Status

Rakshith
- Opened issues
  - https://github.com/ceph/ceph-csi/issues/4067
  - https://github.com/ceph/ceph-csi/issues/4069

2023-08-01 - hosted by Madhu

Attendees: Rakshith, Karthik, Riya, Yati
Duration of meeting: … minutes

Status

Karthik
- Completed the NF support on to csi-addons test tool
- Experimenting with the rados timeout parametes
Rakshith
- pr reviews
- Updated https://github.com/rook/rook/pull/12615
Riya
- VolumeReplication task got merged in csi-addon.
- Investigating VolumeNameprefix bug in ceph-csi.

Topics

[Karthik] https://github.com/ceph/ceph-csi/pull/4008 need to be backported to v3.9. It is present in v3.8 & devel. Will send a patch for that.

2023-07-25 - hosted by Rakshith

Attendees: Karthik
Duration of meeting: … minutes

Status

Rakshith
- discussion on https://github.com/ceph/ceph-csi/issues/4013
Karthik
- Working on the review comments on the network fence and testing of it.

Topics

2023-07-18 - Hosted by Karthik

Attendees: Karthik, Riya, Niels
Duration of meeting: 18 minutes

Status

Karthik
- Working on https://github.com/csi-addons/kubernetes-csi-addons/pull/410
Riya
- Working on volume-name-prefix bug
Niels
- VolumeGroup PR review for CSI-Addons
- reviewing work on NFS enhancements (currently Rook PRs)

Topics

2023-07-11 - hosted by Rakshith

Attendees: Niels, Karthik, Riya
Duration of meeting:8 minutes

Status

Riya
- Working on https://github.com/csi-addons/kubernetes-csi-addons/pull/403. Ready to review.
- Created issue https://github.com/csi-addons/kubernetes-csi-addons/issues/405 with ref. to above PR.
- Reviewed PRs in ceph-csi
Rakshith
- https://github.com/ceph/ceph-csi/pull/3985 sent pr to handle rbd sparsify issue.
Karthik
- Working on the issue: https://github.com/ceph/ceph-csi/issues/3657
Niels
- VolumeGroup for CSI-Addons review
- misc reviews in Ceph-CSI and CSI-Addons

Topics

2022-11-12 - hosted by Rakshith

Attendees: Rakshith, Yati
Duration of meeting: … minutes

Status

Rakshith
- cert manager with olm to provide certs for csi-addons sidecar -controller connection.
- pr reviews
Yati
- working on csi-addons bug https://bugzilla.redhat.com/show_bug.cgi?id=2144527

Topics

2022-10-20 - hosted by Niels

Attendees: Niels, Riya, Rakshith, Madhu
Duration of meeting: … minutes

Status

Niels
- PR reviews for 3.7.2 release
- rebasing PRs one-by-one for getting them merged
- looking into Linux kernel patch for per-fs fscrypt option
- kubernetes-csi-addons webhook PR review
Rakshith
- pr reviews
Madhu
- Done with cephcsi 3.7.2 release
- Updated Rook to use 3.7.2 release
- Working on adding webhook for VolumeReplicationClass

Topics

2022-10-17 - hosted by Madhu

Attendees: Madhu, Yati, Riya, Niels
Duration of meeting: 5 minutes

Status

<your name here>
- <status item>
Madhu
- PR Reviews
- Looking at cephcsi and Rook issues
- Sent PR to having unique names for pvc in E2E
Niels
- PR reviews
- rebase of golang.org/x/text for CVE
- checking progress on PRs in CI
- adding/testing NFS Security Types for Kerberos

Topics

2022-10-11 - hosted by Niels

Attendees: Niels, Madhu, Rakshith
Duration of meeting: … minutes

Status

Madhu
- Sent fix for skip metadata errors if ceph cluster is not supported it https://github.com/ceph/ceph-csi/pull/3423
Niels
- CentOS CI testing with AWS EC2 machines
Rakshith
- cephcsi debugging encryption issue https://github.com/ceph/ceph-csi/pull/3422/
- steps for nfs snap/clone e2e on rook side.
<your name here>
- <status item>

Topics

2022-10-06 - hosted by Niels

Attendees: Rakshith, Madhu, Niels
Duration of meeting: … minutes

Status

Niels
- investigation of CI issues
- PR reviews
Madhu
- minikube with none driver
- testing pid configuration with cgroup2
Rakshith
- kmip config steps to auth using username.
- steps for nfs snap/clone e2e on rook side.
- pr reviews.

Topics

2022-09-12 - hosted by Rakshith

Attendees: Yati, Rakshith
Duration of meeting: … minutes

Status

Rakshith
- https://github.com/ceph/ceph-csi/pull/3396 .
- resolving kmip usage doubts.

2022-09-12 - hosted by Niels

Attendees: Yati
Duration of meeting: … minutes

Status

Yati
- VolumeReplication with LastSyncTime
Niels
- PR reviews

Topics

2022-09-05 - hosted by Madhu

Attendees: Madhu, Yati, Niels, Rakshith
Duration of meeting: 10 minutes

Status

Madhu
- PR to map only Primary mirrored images
  - https://github.com/ceph/ceph-csi/pull/3363
- PR to run e2e test on Kubernetes 1.25 (need review)
  - https://github.com/ceph/ceph-csi/pull/3362
Niels
- PR reviews
Yati
- ..
Rakshith
- Rook kmip integration.
- pr reviews.

Topics

2022-09-01 - hosted by Niels

Attendees: Niels, Yati
Duration of meeting: … minutes

Status

Yati
- Volume Replication removal from Rook: https://github.com/rook/rook/pull/10777
Niels
- PR reviews
- PR for kubernetes-csi-addons (Go 1.19)

Topics

2022-08-29 - hosted by Rakshith

Attendees: Rakshith, Niels
Duration of meeting: … minutes

Status

Rakshith
- sent pr to handle replication secret stripping (https://github.com/ceph/ceph-csi/pull/3349)
- working on nfs nodeserver addition to rook https://github.com/rook/rook/pull/10791
- rook cephnfs does not seem to be working on multus https://github.com/rook/rook/issues/10812
- Running k8s-csi-addons tests before release(should be done by tomorrow).
Niels
- VolumeGroup CSI Spec review
- misc Ceph-CSI PR reviews
- Checking wih Yati what needs to get done to get last_update_time in CSI-Addons/Replication

Topics

2022-08-25 - hosted by Madhu

Attendees: Madhu, Niels, Rakshith
Duration of meeting: … minutes

Status

Madhu
- PR to update kubernetes dep to 1.25
  - https://github.com/ceph/ceph-csi/pull/3338
- Working on csi-addons and volume replication operator
  - https://github.com/csi-addons/kubernetes-csi-addons/pull/217
Niels
- PR reviews
- continueing with LDAP & Kerberos support for NFS (Rook mostly)
Rakshith
- https://github.com/rook/rook/pull/10791
- nfs test debugging

Topics

csi-addons release

2022-08-22 - hosted by Niels

Attendees: Yati, Sachin, Niels, Rakshith
Duration of meeting: … minutes

Status

Yati
- nothing specific to Ceph-CSI, more CSI-Addons for volume replication
Rakshith
- adding volrep controller to csiaddons.
Sachin
- understanding CSI
- working on learning go-ceph
Niels
- bit of PR reviews
- Rook changes for Kerberos / LDAP reviewing

Topics

2022-08-08 - hosted by Rakshith

Attendees: Rakshith, Sachin
Duration of meeting: … minutes

Status

Rakshith
- https://github.com/ceph/ceph-csi/pull/3258 added fsgroupPolicy: File
Niels
- PR reviews
- CSI-Addons reconnecting requirements

Topics

2022-08-02 - hosted by Rakshith

Attendees: Rakshith, Niels
Duration of meeting: … minutes

Status

Rakshith
- pr reviews
- https://github.com/ceph/ceph-csi/pull/3258 nfs nodeserver. ready for review
- working on kmip encryption. https://github.com/ceph/ceph-csi/issues/3282

Topics

trim down e2e? use ok-to-test label ? limited ci centos bare machine available now.

2022-08-01 - hosted by Yati

Attendees:
Duration of meeting: … minutes

Status

Yati
- PR reviews
- Busy with DR and rook issue, nothing much on ceph-csi side

Topics

2022-07-26 - hosted by Rakshith

Attendees: Rakshith, Prasanna
Duration of meeting: … minutes

Status

Prasanna
- Working on
  - https://github.com/ceph/ceph-csi/pull/3133
  - https://github.com/ceph/ceph-csi/pull/3168
Rakshith
- working nfs nodeserver.
- working on kmip encryption.

Topics

2022-07-19 - hosted by Niels

Attendees: Niels, Gaurav, Prasanna
Duration of meeting: … minutes

Status

Prasanna
- Was working on CephFS Metadata related PRs (subvolume & snapshot)
  - https://github.com/ceph/ceph-csi/pull/3133
  - https://github.com/ceph/ceph-csi/pull/3168
Niels
- k8s.io/mount-utils non-systemd enhancement
- improving idempotency for NFS-provisioner
Gaurav
- Testing/Working on CephFS mirroring from rook upstream side
- Tried mounting cephfs subvolume manually in the direct-mount pod but can't see a snapshot mirrored there.

Topics

2022-07-18 - hosted by Rakshith

Attendees: Rakshith, Yati, Niels
Duration of meeting: … minutes

Status

Yati
- <status item>
Rakshith
- reviews for ceph csi prs
- working on nfs nodeplugin in cephcsi, rook
Niels
- improving/reducing logging in k8s.io/mount-utils

Topics

2022-07-12 - hosted by

Attendees: Rakshith, Yati
Duration of meeting: … minutes

Status

<your name here > * <status item>
Rakshith
- reviews for ceph csi prs
- working on nfs nodeplugin in cephcsi

Topics

2022-07-05 - hosted by Rakshith

Attendees: Rakshith, Yati, Niels
Duration of meeting: … minutes

Status

Rakshith
- retesting/ debugging ceph csi prs
- looking into rook nfs e2e issue https://github.com/rook/rook/issues/10518
Yati
- Working on creation of multi-group for moving volrep to csi-addons
- Debuging https://github.com/ceph/ceph-csi/pull/3186

Topics

[Yati] Work on log-rotator for better debuging in csi

2022-06-28 - hosted by

Attendees: Niels, Yati, Prasanna
Duration of meeting: … minutes

Status

Prasanna
- Working on
  - https://github.com/ceph/ceph-csi/pull/3016
  - https://github.com/ceph/ceph-csi/issues/3221
Niels
Yati

Topics

2022-06-24 - hosted by Humble

Attendees:
Duration of meeting: … minutes

Status

<your name here> * <status item>
Yati
- PR review
- working on issue with csi driver and volumesnap bug

Topics

2022-06-23 - hosted by Yati

Attendees: Yati, Rakshith
Duration of meeting: … minutes

Status

<your name here> * <status item>
Rakshith
- pr reviews
- looking into KMIP protocal
Yati
- Working on Dr bug
- PR reviews
- Adding vol rep crds to csi-addons

Topics

2022-06-20 - hosted by Rakshith

Attendees: Rakshith, Humble
Duration of meeting: … minutes

Status

Humble
- PR review
- Sent a couple of PRs
Rakshith
- Rook pr update https://github.com/rook/rook/pull/10354
- https://github.com/rook/rook/pull/10478 rook csi-addons controller v0.4.0
- looked into issue https://github.com/csi-addons/kubernetes-csi-addons/issues/166
- looking into KMIP protocal

Topics

https://github.com/ThalesGroup/kmip-go/issues/4
Release 3.7
- we may wait some more before releasing next major version
- mainly 45 PRs one important one being the RO snapshots feature
- important bug fixes are already backported to 3.6 branch
- Humble to Check with gmano about the requirement of having the RO snapshot functionality in official release
volume replication movement
- https://github.com/csi-addons/volume-replication-operator/pull/132 - looks like we are not ready for v1beta1 CRDs

2022-06-16 - hosted by Yati

Attendees: Yati, Prasanna, Madhu
Duration of meeting: … minutes

Status

Prasanna
- Working on https://github.com/ceph/ceph-csi/pull/3016
Madhu
- PR Review
- Updated cephfs size PR https://github.com/ceph/ceph-csi/pull/3183
Yati
- Review needed https://github.com/ceph/ceph-csi/pull/3155
- PR review

Topics

[Madhu] CI E2E improvement
[Madhu] v3.7.0 release timeline
[Prasanna] We should try round robin for release activities
[Madhu] Automation of release/image tag updates

2022-06-13 - hosted by Rakshith

Attendees: Rakshith, Yati
Duration of meeting: … minutes

Status

Rakshith
- Testing and updating New SA token changes https://github.com/ceph/ceph-csi/pull/3174 (ready for review)
- new issue https://github.com/ceph/ceph-csi/issues/3176
- Looking at impact on upgrade scenario by the SA token change
- looking into KMIP protocal
Yati
- worked on must-gather mostly

Topics

Verify cloning/restoring across different SC https://github.com/ceph/ceph-csi/issues/3165

2022-06-09 - hosted by Humble

Attendees:
Duration of meeting: … minutes

Status

Humble
- PR review/updats
- Alone here.. so dropping offf

Topics

2022-06-07 - hosted by Madhu

Attendees: Madhu, Rakshith, Humble, Prasanna
Duration of meeting: 30 minutes

Status

<your name here> * <status item>
Madhu
- PR reviews
- Updated existing PR in Rook and CephCSI
Humble
- PR reviews
- PRs filed in rook, volume replication..etc
Rakshith
- Updated https://github.com/rook/rook/pull/10354
- pr reviews
- Looking up kmip
- created https://github.com/ceph/ceph-csi/issues/3165
Prasanna
- Addressing review comments on https://github.com/ceph/ceph-csi/pull/2833
- Cephfs subvolume snapshot metadata stuff

Topics

CSI Log levels
- have different default log level for external sidecars
- implement log rotator
Metadata operation will may fail due to https://github.com/ceph/ceph-csi/issues/2327 ?
Remove attacher for RBD like we did for Cephfs.
- Its decided to keep RBD for now due to NBD and csi-addons requirement
- Will bring back the attacher for cephfs when we have the real need coming in for the mounter like fuse.
3.7 release update
- due to lack of time postponed the discussion to thursday

2022-06-06 - hosted by

Attendees: Prasanna
Duration of meeting: 5 minutes

Status

Prasanna
- Working on cephfs subvolume snapshot metadata stuff

Topics

2022-06-02 - hosted by Yati

Attendees: Niels, Prasanna, Yati
Duration of meeting: … minutes

Status

Yati
- Working on https://github.com/ceph/ceph-csi/issues/3103
- PR: https://github.com/ceph/ceph-csi/pull/3155
Niels
- PR reviews
- NFS provisioning testing and guidance
Prasanna
- Working on addressing review comments on:
  https://github.com/ceph/ceph-csi/pull/3007
- PR review
- Working on cluster name changes at ocs-operator

Topics

2022-05-31 - hosted by Madhu

Attendees: Madhu,
Duration of meeting: 0 minutes

Status

Madhu
- PR reviews
- Update pod networking PR in Rook

Topics

2022-05-30 - hosted by Humle

Attendees: Prasanna, Humble
Duration of meeting: 5 minutes

Status

Prasanna
- Working on addressing review comments on:
  https://github.com/ceph/ceph-csi/pull/3007
- Working on adding go-ceph subvolume snapshot metadata APIs
Humble
*

Topics

2022-05-24 - hosted by Yati

Attendees: Yati, Marcel, Niels, Rakshith, Prasanna
Duration of meeting: … minutes

Status

Yati
- PR reviews
- Working on e2e k8s storage testing
Rakshith
- Updated and debugged pr https://github.com/ceph/ceph-csi/pull/3116 nfs snap&clone support
- rook nfs e2e
Marcel
*
Niels
- PR reviews
- looking into csi-addons storage-failure handling for faster fail-over for certain workloads (like Kafka)
Prasanna
- Working on adding cephfs metadata

Topics

Cephfs encryption:
- https://github.com/ceph/ceph-csi/pull/2912
- https://github.com/ceph/ceph-csi/issues/1563

2022-05-23 - hosted by Rakshith

Attendees: Rakshith, Marcel
Duration of meeting: … minutes

Status

Rakshith
- Updated and debugged pr https://github.com/ceph/ceph-csi/pull/3116 nfs snap&clone support
Marcel
- cephfs encryption dissussion

Topics

Cephfs encryption:
- https://github.com/ceph/ceph-csi/pull/2912
- https://github.com/ceph/ceph-csi/issues/1563
- discussed regarding using /ceph-csi-encrypted as base directory to bind mount during nodepublish calls.
- patches for ceph mds may still not be present in a released version
- kernel with required patches may release by the end of this year.
- To be continued tomorrow.
…

2022-05-16 - hosted by Rakshith

Attendees: Niels, Rakshith, Prasanna
Duration of meeting: 5 minutes

Status

Rakshith
- Working on nfs snapshot and clone https://github.com/ceph/ceph-csi/pull/3116
- Updating side-car versions
Prasanna
- Working on go-ceph bindings for cephfs metadata work
- Addressing review comments on https://github.com/ceph/ceph-csi/pull/3007
Niels
- PR reviews
- CI retesting
- NFS testing and research for more features

Topics

2022-05-10 - hosted by Niels

Attendees: Prasanna, Niels,
Duration of meeting: … minutes

Status

Prasanna
- Working on VOLUME_CONDITION cap
- Rework on old PRs that needs rebasing…
Niels
- PR reviews
- guiding PRs through CI

Topics

2022-05-09 - hosted by Humble

Attendees: Yati, Rakshith, Humble, Prasanna
Duration of meeting: … minutes

Status

Yati
- PR reviews
- K8s storage e2e test suite
Rakshith
- NFS snapshot and cloning
- pr reviews
- fix for uninstall Rook https://github.com/rook/rook/pull/10231
Prasanna
- Addressing review comments on
  https://github.com/ceph/ceph-csi/pull/3041
  https://github.com/ceph/ceph-csi/pull/3007
  https://github.com/ceph/ceph-csi/pull/3005

2022-05-02 - hosted by Niels

Attendees: Niels
Duration of meeting: … minutes

Status

Niels
- NFS ExpandVolume

2022-04-28 - hosted by Humble

Attendees: Yati
Duration of meeting: … minutes

Status:

<your name here> * <status item>
Yati
- Working on enabling k8s-storage test
- Helping Yuli to calculate csi time while running test

Topics:

Syntax	Example	Reference
# Header	Header	基本排版
- Unordered List	Unordered List
1. Ordered List	Ordered List
- [ ] Todo List	Todo List
> Blockquote	Blockquote
Bold font	Bold font
Italics font	Italics font
~~Strikethrough~~	~~Strikethrough~~
19^th^	19^th
H~2~O	H₂O
++Inserted text++	Inserted text
==Marked text==	Marked text
[link text](https:// "title")	Link
![image alt](https:// "title")	Image
`Code`	`Code`	在筆記中貼入程式碼
```javascript var i = 0; ```	`var i = 0;`	在筆記中貼入程式碼
:smile:		Emoji list
{%youtube youtube_id %}	Externals
$L^aT_eX$	L^aT_eX
:::info This is a alert area. :::	This is a alert area.