Ceph-CSI standup meeting notes

# Ceph-CSI standup meeting notes ## Meeting Info URL: https://meet.google.com/nnn-txfp-cge Time: Mondays, Tuesdays and Thursdays, 12:00 UTC, 17:30 Asia/Kolkata (date -d 12:00 UTC) Out-Of-Office announcements: Holidays: # Template Instructions: Copy the following template, edit the date, and fill in the host and participants. Everyone should put their status and topic into the notes. # 2024-02-00 - hosted by Attendees: ## Status * <your name here> * <status item> # 2024-10-28 - hosted by Madhu Attendees: Madhu, Nikhil ## Status * Nikhil * go-ceph PR to add progress report API is merged * Ceph-CSI PR is up and under review to log the progress report * https://github.com/ceph/ceph-csi/pull/4918 * Opened a draft PR for ModifyVolume RPC support * https://github.com/ceph/ceph-csi/pull/4916 * Need to work on e2e tests and identifying relevant immutable params for the drivers * Madhu * Added E2E to test ROX PVC-PVC clone for RBD ## Topics --- # 2024-10-21 - hosted by Madhu Attendees: Nikhil, Madhu Duration of meeting: … minutes ## Status * Madhu * NetworkFence Design * https://github.com/ceph/ceph-csi/issues/4913 * Qos Design for RBD * https://github.com/ceph/ceph-csi/blob/devel/docs/design/proposals/rbd-qos.md * Nikhil * Expose CSI metrics - [PR](https://github.com/ceph/ceph-csi/pull/4887) * Log cephfs clone status * go-ceph [PR](https://github.com/ceph/go-ceph/pull/1036) is under review * Looking into implementation of ModifyVolume RPC * Check what all params could be modified for cephfs, rbd and nfs. ## Topics --- # 2024-10-14 - hosted by Attendees: Madhu, yati Duration of meeting: … minutes ## Status * Yati * https://github.com/ceph/ceph-csi/pull/4905 ## Topics --- # 2024-09-30 - hosted by Madhu Attendees: Yati, Nikhil, Madhu, Niraj Duration of meeting: … minutes ## Status * <your name here> * <status item> ## Topics * Improvements for upstream * Run CSI test suite for cephcsi - yati * Enable more tests in external kubernetes tests * Update the documents (Readme/etc) - Niraj * Remove unsupported version from the document. * Work on test framework for csi-addon features - Nikhil * VolumeAttribute class feature * Update static tools - Niraj * Add timeout to Ceph GET API calls - Nikhil * Look for new feature requirements from community - yati --- # 2024-07-01 - hosted by Attendees: Nraj,yati, praveen Duration of meeting: … minutes ## Status * <your name here> * <status item> Topics: --- # 2024-02-20 - hosted by Yati Attendees: Manish, Niels, Yati Duration of meeting: … minutes ## Status * Yati * PR on: https://github.com/ceph/ceph-csi/pull/4452 * stale subvolume cleanup testing * Manish: * Niels: * PR reviews * rebase Helm client to generate charts (CVE related) * ## Topics * Niels - Volume Group Snapshots ideally do not use existing *spaghetti coded* RBD snapshotting functions. - New, cleanly written functions for Volume Group Snapshot could be a base for the Volume Snapshot implementation. --- # 2024-01-23 - hosted by Praveen M Attendees: Duration of meeting: … minutes ## Status * Praveen M: * Working on rook issue https://github.com/rook/rook/issues/13580 * Niels: * CentOS CI Jenking fails to download containers from internal mirror * GetVolumeGroupSnapshot status problem identified in upstream CRD ## Topics --- # 2024-01-16 - hosted by Yati Attendees: Madhu, Niels, Yati Duration of meeting: … minutes ## Status * Madhu * Discussion on making rbd mirror count configurable * Sent Rook PR to make leaderelection configurable * Niels * updated external-snapshotter PR with GetGroupSnapshotStatus https://github.com/kubernetes-csi/external-snapshotter/pull/837 * Yati * Working on epic for 4.16 readouts ## Topics --- # 2023-12-05 - hosted by Rakshith Attendees: Duration of meeting: … minutes ## Status * Praveen M * Bug fix: https://github.com/ceph/ceph-csi/pull/4298 * pr reviews * Rakshith * completed v3.10.0 release https://github.com/ceph/ceph-csi/releases/tag/v3.10.0 * working on updating rook's default cephcsi image to 3.10.0 * pr reviews. ## Topics --- # 2023-11-14 - hosted by Rakshith Attendees: Madhu, Niels, Praveen, Yati Duration of meeting: … minutes ## Status * Praveen * Working on PR review for kernel & fuse mount options per cluster * Working on CephFS read affinity * Rakshith * rook work for ceph-csi configmap changes to accomodate read affinity + fuse/kernel mountoptions * pr reviews. * Niels * RBD getCloneDepth testing PR#4013 * misc PR reviews and moving PRs through CI * Madhu * PR review in cephcsi and Rook * Sent PR for dependabot https://github.com/csi-addons/kubernetes-csi-addons/pull/484 * Yati * Working on to test stale subvolume epic ## Topics --- # 2023-10-31 - hosted by Attendees: Duration of meeting: … minutes ## Status * Praveen M * testing PR - removal of subvolumegroup creation * working on review - read affinity map options per cluster * Yati * Checking out kubectl-rook-ceph repo for epic * PR reviewa * must-gather works * Madhu * PR reviews * Niels * updating PR for CephFS health checker * working on adding Lease support to kubernetes-csi-addons ## Topics * --- # 2023-09-26 - hosted by Attendees: Duration of meeting: … minutes ## Status * Rakshith * Working on design for replication of cloned PVC/Snapshots ## Topics --- # 2023-09-26 - hosted by Rakshith Attendees: Praveen, Riya Duration of meeting: … minutes ## Status * <your name here> * <status item> * Riya * Addressed reviews on client eviction PR and testing locally. * Rakshith * Opened issues: https://github.com/ceph/ceph-csi/issues/4149 * reviewing https://github.com/kubernetes/enhancements/pull/3004 * Praveen * PR merged: https://github.com/ceph/ceph-csi/pull/4111 * Working on Issues - https://github.com/ceph/ceph-csi/issues/4149 - https://github.com/ceph/ceph-csi/issues/4067 ## Topics * … --- # 2023-08-22 - hosted by Attendees: Rakshith Duration of meeting: … minutes ## Status * Rakshith * Opened issues * https://github.com/ceph/ceph-csi/issues/4067 * https://github.com/ceph/ceph-csi/issues/4069 --- # 2023-08-01 - hosted by Madhu Attendees: Rakshith, Karthik, Riya, Yati Duration of meeting: … minutes ## Status * Karthik * Completed the NF support on to csi-addons test tool * Experimenting with the rados timeout parametes * Rakshith * pr reviews * Updated https://github.com/rook/rook/pull/12615 * Riya * VolumeReplication task got merged in csi-addon. * Investigating VolumeNameprefix bug in ceph-csi. ## Topics * [Karthik] https://github.com/ceph/ceph-csi/pull/4008 need to be backported to v3.9. It is present in v3.8 & devel. Will send a patch for that. --- # 2023-07-25 - hosted by Rakshith Attendees: Karthik Duration of meeting: … minutes ## Status * Rakshith * discussion on https://github.com/ceph/ceph-csi/issues/4013 * Karthik * Working on the review comments on the network fence and testing of it. ## Topics * … --- # 2023-07-18 - Hosted by Karthik Attendees: Karthik, Riya, Niels Duration of meeting: 18 minutes ## Status * Karthik * Working on https://github.com/csi-addons/kubernetes-csi-addons/pull/410 * Riya * Working on volume-name-prefix bug * Niels * VolumeGroup PR review for CSI-Addons * reviewing work on NFS enhancements (currently Rook PRs) ## Topics * … --- # 2023-07-11 - hosted by Rakshith Attendees: Niels, Karthik, Riya Duration of meeting:8 minutes ## Status * Riya * Working on https://github.com/csi-addons/kubernetes-csi-addons/pull/403. Ready to review. * Created issue https://github.com/csi-addons/kubernetes-csi-addons/issues/405 with ref. to above PR. * Reviewed PRs in ceph-csi * Rakshith * https://github.com/ceph/ceph-csi/pull/3985 sent pr to handle rbd sparsify issue. * Karthik * Working on the issue: https://github.com/ceph/ceph-csi/issues/3657 * Niels * VolumeGroup for CSI-Addons review * misc reviews in Ceph-CSI and CSI-Addons ## Topics * … --- # 2022-11-12 - hosted by Rakshith Attendees: Rakshith, Yati Duration of meeting: … minutes ## Status * Rakshith * cert manager with olm to provide certs for csi-addons sidecar -controller connection. * pr reviews * Yati * working on csi-addons bug https://bugzilla.redhat.com/show_bug.cgi?id=2144527 * ## Topics * … --- # 2022-10-20 - hosted by Niels Attendees: Niels, Riya, Rakshith, Madhu Duration of meeting: … minutes ## Status * Niels * PR reviews for 3.7.2 release * rebasing PRs one-by-one for getting them merged * looking into Linux kernel patch for per-fs fscrypt option * kubernetes-csi-addons webhook PR review * Rakshith * pr reviews * Madhu * Done with cephcsi 3.7.2 release * Updated Rook to use 3.7.2 release * Working on adding webhook for VolumeReplicationClass ## Topics * … --- # 2022-10-17 - hosted by Madhu Attendees: Madhu, Yati, Riya, Niels Duration of meeting: 5 minutes ## Status * <your name here> * <status item> * Madhu * PR Reviews * Looking at cephcsi and Rook issues * Sent PR to having unique names for pvc in E2E * Niels * PR reviews * rebase of golang.org/x/text for CVE * checking progress on PRs in CI * adding/testing NFS Security Types for Kerberos ## Topics * … --- # 2022-10-11 - hosted by Niels Attendees: Niels, Madhu, Rakshith Duration of meeting: … minutes ## Status * Madhu * Sent fix for skip metadata errors if ceph cluster is not supported it https://github.com/ceph/ceph-csi/pull/3423 * Niels * CentOS CI testing with AWS EC2 machines * Rakshith * cephcsi debugging encryption issue https://github.com/ceph/ceph-csi/pull/3422/ * steps for nfs snap/clone e2e on rook side. * <your name here> * <status item> ## Topics * … --- # 2022-10-06 - hosted by Niels Attendees: Rakshith, Madhu, Niels Duration of meeting: … minutes ## Status * Niels * investigation of CI issues * PR reviews * Madhu * minikube with none driver * testing pid configuration with cgroup2 * Rakshith * kmip config steps to auth using username. * steps for nfs snap/clone e2e on rook side. * pr reviews. ## Topics * … --- # 2022-09-12 - hosted by Rakshith Attendees: Yati, Rakshith Duration of meeting: … minutes ## Status * Rakshith * https://github.com/ceph/ceph-csi/pull/3396 . * resolving kmip usage doubts. --- # 2022-09-12 - hosted by Niels Attendees: Yati Duration of meeting: … minutes ## Status * Yati * VolumeReplication with LastSyncTime * Niels * PR reviews ## Topics * … --- # 2022-09-05 - hosted by Madhu Attendees: Madhu, Yati, Niels, Rakshith Duration of meeting: 10 minutes ## Status * Madhu * PR to map only Primary mirrored images * https://github.com/ceph/ceph-csi/pull/3363 * PR to run e2e test on Kubernetes 1.25 (need review) * https://github.com/ceph/ceph-csi/pull/3362 * Niels * PR reviews * Yati * .. * Rakshith * Rook kmip integration. * pr reviews. ## Topics * … --- # 2022-09-01 - hosted by Niels Attendees: Niels, Yati Duration of meeting: … minutes ## Status * Yati * Volume Replication removal from Rook: https://github.com/rook/rook/pull/10777 * Niels * PR reviews * PR for kubernetes-csi-addons (Go 1.19) ## Topics * … --- # 2022-08-29 - hosted by Rakshith Attendees: Rakshith, Niels Duration of meeting: … minutes ## Status * Rakshith * sent pr to handle replication secret stripping (https://github.com/ceph/ceph-csi/pull/3349) * working on nfs nodeserver addition to rook https://github.com/rook/rook/pull/10791 * rook cephnfs does not seem to be working on multus https://github.com/rook/rook/issues/10812 * Running k8s-csi-addons tests before release(should be done by tomorrow). * Niels * [VolumeGroup CSI Spec review](https://github.com/container-storage-interface/spec/pull/519) * misc Ceph-CSI PR reviews * Checking wih Yati what needs to get done to get last_update_time in CSI-Addons/Replication ## Topics * … --- # 2022-08-25 - hosted by Madhu Attendees: Madhu, Niels, Rakshith Duration of meeting: … minutes ## Status * Madhu * PR to update kubernetes dep to 1.25 * https://github.com/ceph/ceph-csi/pull/3338 * Working on csi-addons and volume replication operator * https://github.com/csi-addons/kubernetes-csi-addons/pull/217 * Niels * PR reviews * continueing with LDAP & Kerberos support for NFS (Rook mostly) * Rakshith * https://github.com/rook/rook/pull/10791 * nfs test debugging ## Topics * csi-addons release --- # 2022-08-22 - hosted by Niels Attendees: Yati, Sachin, Niels, Rakshith Duration of meeting: … minutes ## Status * Yati * nothing specific to Ceph-CSI, more CSI-Addons for volume replication * Rakshith * adding volrep controller to csiaddons. * Sachin * understanding CSI * working on learning go-ceph * Niels * bit of PR reviews * Rook changes for Kerberos / LDAP reviewing ## Topics * … --- # 2022-08-08 - hosted by Rakshith Attendees: Rakshith, Sachin Duration of meeting: … minutes ## Status * Rakshith * https://github.com/ceph/ceph-csi/pull/3258 added fsgroupPolicy: File * * Niels * PR reviews * CSI-Addons reconnecting requirements ## Topics * … --- # 2022-08-02 - hosted by Rakshith Attendees: Rakshith, Niels Duration of meeting: … minutes ## Status * Rakshith * pr reviews * https://github.com/ceph/ceph-csi/pull/3258 nfs nodeserver. ready for review * working on kmip encryption. https://github.com/ceph/ceph-csi/issues/3282 ## Topics * trim down e2e? use ok-to-test label ? limited ci centos bare machine available now. --- # 2022-08-01 - hosted by Yati Attendees: Duration of meeting: … minutes ## Status * Yati * PR reviews * Busy with DR and rook issue, nothing much on ceph-csi side ## Topics * … --- # 2022-07-26 - hosted by Rakshith Attendees: Rakshith, Prasanna Duration of meeting: … minutes ## Status * Prasanna * Working on * https://github.com/ceph/ceph-csi/pull/3133 * https://github.com/ceph/ceph-csi/pull/3168 * Rakshith * working nfs nodeserver. * working on kmip encryption. ## Topics * … --- # 2022-07-19 - hosted by Niels Attendees: Niels, Gaurav, Prasanna Duration of meeting: … minutes ## Status * Prasanna * Was working on CephFS Metadata related PRs (subvolume & snapshot) * https://github.com/ceph/ceph-csi/pull/3133 * https://github.com/ceph/ceph-csi/pull/3168 * Niels * k8s.io/mount-utils non-systemd enhancement * improving idempotency for NFS-provisioner * Gaurav * Testing/Working on CephFS mirroring from rook upstream side * Tried mounting cephfs subvolume manually in the direct-mount pod but can't see a snapshot mirrored there. ## Topics * … --- # 2022-07-18 - hosted by Rakshith Attendees: Rakshith, Yati, Niels Duration of meeting: … minutes ## Status * Yati * <status item> * Rakshith * reviews for ceph csi prs * working on nfs nodeplugin in cephcsi, rook * Niels * improving/reducing logging in `k8s.io/mount-utils` ## Topics * … --- # 2022-07-12 - hosted by Attendees: Rakshith, Yati Duration of meeting: … minutes ## Status * <your name here > * <status item> * Rakshith * reviews for ceph csi prs * working on nfs nodeplugin in cephcsi ## Topics * … --- # 2022-07-05 - hosted by Rakshith Attendees: Rakshith, Yati, Niels Duration of meeting: … minutes ## Status * Rakshith * retesting/ debugging ceph csi prs * looking into rook nfs e2e issue https://github.com/rook/rook/issues/10518 * Yati * Working on creation of multi-group for moving volrep to csi-addons * Debuging https://github.com/ceph/ceph-csi/pull/3186 ## Topics * [Yati] Work on log-rotator for better debuging in csi --- # 2022-06-28 - hosted by Attendees: Niels, Yati, Prasanna Duration of meeting: … minutes ## Status * Prasanna * Working on * https://github.com/ceph/ceph-csi/pull/3016 * https://github.com/ceph/ceph-csi/issues/3221 * Niels * Yati ## Topics * … --- # 2022-06-24 - hosted by Humble Attendees: Duration of meeting: … minutes ## Status * <your name here> * <status item> * Yati * PR review * working on issue with csi driver and volumesnap bug ## Topics * … # 2022-06-23 - hosted by Yati Attendees: Yati, Rakshith Duration of meeting: … minutes ## Status * <your name here> * <status item> * Rakshith * pr reviews * looking into KMIP protocal * Yati * Working on Dr bug * PR reviews * Adding vol rep crds to csi-addons ## Topics * … --- # 2022-06-20 - hosted by Rakshith Attendees: Rakshith, Humble Duration of meeting: … minutes ## Status * Humble * PR review * Sent a couple of PRs * Rakshith * Rook pr update https://github.com/rook/rook/pull/10354 * https://github.com/rook/rook/pull/10478 rook csi-addons controller v0.4.0 * looked into issue https://github.com/csi-addons/kubernetes-csi-addons/issues/166 * looking into KMIP protocal ## Topics * https://github.com/ThalesGroup/kmip-go/issues/4 * Release 3.7 - we may wait some more before releasing next major version - mainly 45 PRs one important one being the RO snapshots feature - important bug fixes are already backported to 3.6 branch - Humble to Check with gmano about the requirement of having the RO snapshot functionality in official release * volume replication movement - https://github.com/csi-addons/volume-replication-operator/pull/132 - looks like we are not ready for v1beta1 CRDs - --- # 2022-06-16 - hosted by Yati Attendees: Yati, Prasanna, Madhu Duration of meeting: … minutes ## Status * Prasanna * Working on https://github.com/ceph/ceph-csi/pull/3016 * Madhu * PR Review * Updated cephfs size PR https://github.com/ceph/ceph-csi/pull/3183 * Yati * Review needed https://github.com/ceph/ceph-csi/pull/3155 * PR review ## Topics * [Madhu] CI E2E improvement * [Madhu] v3.7.0 release timeline * [Prasanna] We should try round robin for release activities * [Madhu] Automation of release/image tag updates --- # 2022-06-13 - hosted by Rakshith Attendees: Rakshith, Yati Duration of meeting: … minutes ## Status * Rakshith * Testing and updating New SA token changes https://github.com/ceph/ceph-csi/pull/3174 (ready for review) * new issue https://github.com/ceph/ceph-csi/issues/3176 * Looking at impact on upgrade scenario by the SA token change * looking into KMIP protocal * Yati * worked on must-gather mostly ## Topics * Verify cloning/restoring across different SC https://github.com/ceph/ceph-csi/issues/3165 --- # 2022-06-09 - hosted by Humble Attendees: Duration of meeting: … minutes ## Status * Humble * PR review/updats * Alone here.. so dropping offf ## Topics * … --- # 2022-06-07 - hosted by Madhu Attendees: Madhu, Rakshith, Humble, Prasanna Duration of meeting: 30 minutes ## Status * <your name here> * <status item> * Madhu * PR reviews * Updated existing PR in Rook and CephCSI * Humble * PR reviews * PRs filed in rook, volume replication..etc * Rakshith * Updated https://github.com/rook/rook/pull/10354 * pr reviews * Looking up kmip * created https://github.com/ceph/ceph-csi/issues/3165 * Prasanna * Addressing review comments on https://github.com/ceph/ceph-csi/pull/2833 * Cephfs subvolume snapshot metadata stuff ## Topics * CSI Log levels * have different default log level for external sidecars * implement log rotator * Metadata operation will may fail due to https://github.com/ceph/ceph-csi/issues/2327 ? * Remove attacher for RBD like we did for Cephfs. * Its decided to keep RBD for now due to NBD and csi-addons requirement * Will bring back the attacher for cephfs when we have the real need coming in for the mounter like fuse. * 3.7 release update * due to lack of time postponed the discussion to thursday --- # 2022-06-06 - hosted by Attendees: Prasanna Duration of meeting: 5 minutes ## Status * Prasanna * Working on cephfs subvolume snapshot metadata stuff ## Topics * … --- # 2022-06-02 - hosted by Yati Attendees: Niels, Prasanna, Yati Duration of meeting: … minutes ## Status * Yati * Working on https://github.com/ceph/ceph-csi/issues/3103 * PR: https://github.com/ceph/ceph-csi/pull/3155 * Niels * PR reviews * NFS provisioning testing and guidance * Prasanna * Working on addressing review comments on: https://github.com/ceph/ceph-csi/pull/3007 * PR review * Working on cluster name changes at ocs-operator ## Topics * … --- # 2022-05-31 - hosted by Madhu Attendees: Madhu, Duration of meeting: 0 minutes ## Status * Madhu * PR reviews * Update pod networking PR in Rook ## Topics * … --- # 2022-05-30 - hosted by Humle Attendees: Prasanna, Humble Duration of meeting: 5 minutes ## Status * Prasanna * Working on addressing review comments on: https://github.com/ceph/ceph-csi/pull/3007 * Working on adding go-ceph subvolume snapshot metadata APIs * Humble * ## Topics * … -------- # 2022-05-24 - hosted by Yati Attendees: Yati, Marcel, Niels, Rakshith, Prasanna Duration of meeting: … minutes ## Status * Yati * PR reviews * Working on e2e k8s storage testing * Rakshith * Updated and debugged pr https://github.com/ceph/ceph-csi/pull/3116 nfs snap&clone support * rook nfs e2e * Marcel * * Niels * PR reviews * looking into csi-addons storage-failure handling for faster fail-over for certain workloads (like Kafka) * Prasanna * Working on adding cephfs metadata ## Topics * Cephfs encryption: * https://github.com/ceph/ceph-csi/pull/2912 * https://github.com/ceph/ceph-csi/issues/1563 --- # 2022-05-23 - hosted by Rakshith Attendees: Rakshith, Marcel Duration of meeting: … minutes ## Status * Rakshith * Updated and debugged pr https://github.com/ceph/ceph-csi/pull/3116 nfs snap&clone support * Marcel * cephfs encryption dissussion ## Topics * Cephfs encryption: * https://github.com/ceph/ceph-csi/pull/2912 * https://github.com/ceph/ceph-csi/issues/1563 * discussed regarding using `/ceph-csi-encrypted` as base directory to bind mount during nodepublish calls. * patches for ceph mds may still not be present in a released version * kernel with required patches may release by the end of this year. * To be continued tomorrow. * … --- # 2022-05-16 - hosted by Rakshith Attendees: Niels, Rakshith, Prasanna Duration of meeting: 5 minutes ## Status * Rakshith * Working on nfs snapshot and clone https://github.com/ceph/ceph-csi/pull/3116 * Updating side-car versions * Prasanna * Working on go-ceph bindings for cephfs metadata work * Addressing review comments on https://github.com/ceph/ceph-csi/pull/3007 * Niels * PR reviews * CI retesting * NFS testing and research for more features ## Topics * … --- # 2022-05-10 - hosted by Niels Attendees: Prasanna, Niels, Duration of meeting: … minutes ## Status * Prasanna * Working on VOLUME_CONDITION cap * Rework on old PRs that needs rebasing... * Niels * PR reviews * guiding PRs through CI ## Topics * … --- # 2022-05-09 - hosted by Humble Attendees: Yati, Rakshith, Humble, Prasanna Duration of meeting: … minutes ## Status * Yati * PR reviews * K8s storage e2e test suite * Rakshith * NFS snapshot and cloning * pr reviews * fix for uninstall Rook https://github.com/rook/rook/pull/10231 * Prasanna * Addressing review comments on https://github.com/ceph/ceph-csi/pull/3041 https://github.com/ceph/ceph-csi/pull/3007 https://github.com/ceph/ceph-csi/pull/3005 --- # 2022-05-02 - hosted by Niels Attendees: Niels Duration of meeting: … minutes ## Status * Niels * NFS ExpandVolume --- # 2022-04-28 - hosted by Humble Attendees: Yati Duration of meeting: … minutes Status: * <your name here> * <status item> * Yati * Working on enabling k8s-storage test * Helping Yuli to calculate csi time while running test Topics: * … ---

Syntax	Example	Reference
# Header	Header	基本排版
- Unordered List	Unordered List
1. Ordered List	Ordered List
- [ ] Todo List	Todo List
> Blockquote	Blockquote
Bold font	Bold font
Italics font	Italics font
~~Strikethrough~~	~~Strikethrough~~
19^th^	19^th
H~2~O	H₂O
++Inserted text++	Inserted text
==Marked text==	Marked text
[link text](https:// "title")	Link
![image alt](https:// "title")	Image
`Code`	`Code`	在筆記中貼入程式碼
```javascript var i = 0; ```	`var i = 0;`
:smile:		Emoji list
{%youtube youtube_id %}	Externals
$L^aT_eX$	L^aT_eX
:::info This is a alert area. :::	This is a alert area.