20210927系上群集Microk8s災難還原

--- title: '20210927系上群集Microk8s災難還原' disqus: hackmd --- 20210927系上群集Microk8s災難還原 === ## 索引 [TOC] ## 注意事項 ## 找出正確的群集資料所在節點資料擷取位置: `/var/snap/microk8s/current/var/kubernetes/backend` ### 擷取各節點資料位置 * microk8s-127 ``` csie404@microk8s127:/var/snap/microk8s/current/var/kubernetes/backend$ ls -l total 490908 -rw-rw---- 1 root microk8s 5744720 Sep 26 04:46 0000000009529552-0000000009529767 -rw-rw---- 1 root microk8s 5051400 Sep 26 04:48 0000000009529768-0000000009529935 -rw-rw---- 1 root microk8s 8375096 Sep 26 04:51 0000000009529936-0000000009530279 -rw-rw---- 1 root microk8s 296432 Sep 26 04:51 0000000009530280-0000000009530292 -rw-rw---- 1 root microk8s 8374544 Sep 26 04:55 0000000009530293-0000000009530653 -rw-rw---- 1 root microk8s 8382872 Sep 26 04:58 0000000009530654-0000000009530973 -rw-rw---- 1 root microk8s 4273856 Sep 26 05:00 0000000009530974-0000000009531109 -rw-rw---- 1 root microk8s 8380528 Sep 26 05:03 0000000009531110-0000000009531409 -rw-rw---- 1 root microk8s 1246400 Sep 26 05:03 0000000009531410-0000000009531449 -rw-rw---- 1 root microk8s 8376464 Sep 26 05:06 0000000009531450-0000000009531747 -rw-rw---- 1 root microk8s 1370312 Sep 26 05:06 0000000009531748-0000000009531798 -rw-rw---- 1 root microk8s 1674296 Sep 26 05:08 0000000009531799-0000000009531853 -rw-rw---- 1 root microk8s 8111720 Sep 26 05:12 0000000009531854-0000000009532359 -rw-rw---- 1 root microk8s 1616208 Sep 26 05:13 0000000009532360-0000000009532407 -rw-rw---- 1 root microk8s 974672 Sep 26 05:14 0000000009532408-0000000009532435 -rw-rw---- 1 root microk8s 3299512 Sep 26 05:16 0000000009532436-0000000009532554 -rw-rw---- 1 root microk8s 7729248 Sep 26 05:20 0000000009532555-0000000009532886 -rw-rw---- 1 root microk8s 3242448 Sep 26 05:20 0000000009532887-0000000009533049 -rw-rw---- 1 root microk8s 8349704 Sep 26 05:24 0000000009533050-0000000009533411 -rw-rw---- 1 root microk8s 8368064 Sep 26 05:27 0000000009533412-0000000009533696 -rw-rw---- 1 root microk8s 7647168 Sep 26 05:29 0000000009533697-0000000009534021 -rw-rw---- 1 root microk8s 3226304 Sep 26 05:31 0000000009534022-0000000009534166 -rw-rw---- 1 root microk8s 7791936 Sep 26 05:34 0000000009534167-0000000009534430 -rw-rw---- 1 root microk8s 8370808 Sep 26 05:38 0000000009534431-0000000009534698 -rw-rw---- 1 root microk8s 785456 Sep 26 05:38 0000000009534699-0000000009534720 -rw-rw---- 1 root microk8s 8377424 Sep 26 05:41 0000000009534721-0000000009535044 -rw-rw---- 1 root microk8s 2809304 Sep 26 05:42 0000000009535045-0000000009535131 -rw-rw---- 1 root microk8s 4887200 Sep 26 05:44 0000000009535132-0000000009535295 -rw-rw---- 1 root microk8s 8373456 Sep 26 05:48 0000000009535296-0000000009535599 -rw-rw---- 1 root microk8s 6367856 Sep 26 05:51 0000000009535600-0000000009535888 -rw-rw---- 1 root microk8s 8387208 Sep 26 05:56 0000000009535889-0000000009536322 -rw-rw---- 1 root microk8s 8379440 Sep 26 05:59 0000000009536323-0000000009536595 -rw-rw---- 1 root microk8s 2244864 Sep 26 06:00 0000000009536596-0000000009536725 -rw-rw---- 1 root microk8s 8381216 Sep 26 06:02 0000000009536726-0000000009537043 -rw-rw---- 1 root microk8s 2252224 Sep 26 06:04 0000000009537044-0000000009537162 -rw-rw---- 1 root microk8s 8380200 Sep 26 06:08 0000000009537163-0000000009537445 -rw-rw---- 1 root microk8s 697344 Sep 26 06:10 0000000009537446-0000000009537515 -rw-rw---- 1 root microk8s 8376320 Sep 26 09:14 0000000009537516-0000000009537959 -rw-rw---- 1 root microk8s 477080 Sep 26 09:14 0000000009537960-0000000009537973 -rw-rw---- 1 root microk8s 3329712 Sep 26 09:17 0000000009537974-0000000009538242 -rw-rw---- 1 root microk8s 3810336 Sep 26 10:05 0000000009538243-0000000009538475 -rw-rw---- 1 root microk8s 1870 Sep 20 02:51 cluster.crt -rw-rw---- 1 root microk8s 3272 Sep 20 02:51 cluster.key -rw-rw---- 1 root microk8s 318 Sep 26 09:18 cluster.yaml -rw-rw-r-- 1 root microk8s 2 Sep 27 08:44 failure-domain -rw-rw---- 1 root microk8s 57 Sep 20 03:19 info.yaml srw-rw---- 1 root microk8s 0 Sep 26 09:17 kine.sock -rw-rw---- 1 root microk8s 63 Sep 26 09:17 localnode.yaml -rw-rw---- 1 root microk8s 32 Sep 26 09:17 metadata1 -rw-rw---- 1 root microk8s 32 Sep 26 09:18 metadata2 -rw-rw---- 1 root microk8s 142847060 Sep 26 06:01 snapshot-165-9536871-75703846 -rw-rw---- 1 root microk8s 168 Sep 26 06:01 snapshot-165-9536871-75703846.meta -rw-rw---- 1 root microk8s 143120546 Sep 26 09:13 snapshot-175-9537895-248361 -rw-rw---- 1 root microk8s 168 Sep 26 09:13 snapshot-175-9537895-248361.meta ``` * microk8s-128 ``` csie404@microk8s128:/var/snap/microk8s/current/var/kubernetes/backend$ ls -l total 490880 -rw-rw---- 1 root microk8s 6021024 Sep 26 04:46 0000000009529540-0000000009529767 -rw-rw---- 1 root microk8s 4973056 Sep 26 04:48 0000000009529768-0000000009529933 -rw-rw---- 1 root microk8s 8366872 Sep 26 04:51 0000000009529934-0000000009530277 -rw-rw---- 1 root microk8s 411560 Sep 26 04:51 0000000009530278-0000000009530293 -rw-rw---- 1 root microk8s 2714840 Sep 26 04:53 0000000009530294-0000000009530379 -rw-rw---- 1 root microk8s 168712 Sep 26 04:53 0000000009530380-0000000009530386 -rw-rw---- 1 root microk8s 8382792 Sep 26 04:56 0000000009530387-0000000009530754 -rw-rw---- 1 root microk8s 4795400 Sep 26 04:58 0000000009530755-0000000009530952 -rw-rw---- 1 root microk8s 8368040 Sep 26 05:01 0000000009530953-0000000009531252 -rw-rw---- 1 root microk8s 1609136 Sep 26 05:02 0000000009531253-0000000009531314 -rw-rw---- 1 root microk8s 8364688 Sep 26 05:05 0000000009531315-0000000009531553 -rw-rw---- 1 root microk8s 197504 Sep 26 05:05 0000000009531554-0000000009531560 -rw-rw---- 1 root microk8s 7447960 Sep 26 05:08 0000000009531561-0000000009531853 -rw-rw---- 1 root microk8s 8370688 Sep 26 05:12 0000000009531854-0000000009532377 -rw-rw---- 1 root microk8s 1356488 Sep 26 05:13 0000000009532378-0000000009532407 -rw-rw---- 1 root microk8s 3549728 Sep 26 05:15 0000000009532408-0000000009532518 -rw-rw---- 1 root microk8s 8379856 Sep 26 05:19 0000000009532519-0000000009532884 -rw-rw---- 1 root microk8s 74024 Sep 26 05:19 0000000009532885-0000000009532886 -rw-rw---- 1 root microk8s 3697496 Sep 26 05:20 0000000009532887-0000000009533076 -rw-rw---- 1 root microk8s 5236512 Sep 26 05:23 0000000009533077-0000000009533338 -rw-rw---- 1 root microk8s 8375016 Sep 26 05:26 0000000009533339-0000000009533606 -rw-rw---- 1 root microk8s 8382912 Sep 26 05:29 0000000009533607-0000000009533952 -rw-rw---- 1 root microk8s 8374656 Sep 26 05:32 0000000009533953-0000000009534287 -rw-rw---- 1 root microk8s 8378864 Sep 26 05:36 0000000009534288-0000000009534551 -rw-rw---- 1 root microk8s 8082208 Sep 26 05:39 0000000009534552-0000000009534877 -rw-rw---- 1 root microk8s 8222048 Sep 26 05:42 0000000009534878-0000000009535130 -rw-rw---- 1 root microk8s 6788000 Sep 26 05:45 0000000009535131-0000000009535358 -rw-rw---- 1 root microk8s 8377784 Sep 26 05:49 0000000009535359-0000000009535664 -rw-rw---- 1 root microk8s 4405200 Sep 26 05:51 0000000009535665-0000000009535878 -rw-rw---- 1 root microk8s 3489872 Sep 26 05:53 0000000009535879-0000000009536019 -rw-rw---- 1 root microk8s 7769488 Sep 26 05:57 0000000009536020-0000000009536408 -rw-rw---- 1 root microk8s 8361552 Sep 26 06:00 0000000009536409-0000000009536738 -rw-rw---- 1 root microk8s 4626176 Sep 26 06:01 0000000009536739-0000000009536937 -rw-rw---- 1 root microk8s 3891192 Sep 26 06:03 0000000009536938-0000000009537061 -rw-rw---- 1 root microk8s 8386376 Sep 26 06:08 0000000009537062-0000000009537390 -rw-rw---- 1 root microk8s 5043440 Sep 26 06:09 0000000009537391-0000000009537641 -rw-rw---- 1 root microk8s 1485320 Sep 26 06:14 0000000009537642-0000000009537696 -rw-rw---- 1 root microk8s 1381600 Sep 26 09:11 0000000009537697-0000000009537812 -rw-rw---- 1 root microk8s 2848240 Sep 26 09:14 0000000009537813-0000000009537940 -rw-rw---- 1 root microk8s 3244600 Sep 26 09:17 0000000009537941-0000000009538217 -rw-rw---- 1 root microk8s 790064 Sep 26 09:18 0000000009538218-0000000009538246 -rw-rw---- 1 root microk8s 3682824 Sep 26 10:05 0000000009538247-0000000009538475 -rw-rw---- 1 root microk8s 1870 Sep 21 09:51 cluster.crt -rw-rw---- 1 root microk8s 3272 Sep 21 09:51 cluster.key -rw-rw---- 1 root microk8s 318 Sep 26 09:18 cluster.yaml -rw-rw-r-- 1 root microk8s 2 Sep 27 10:15 failure-domain -rw-rw---- 1 root microk8s 58 Sep 21 09:51 info.yaml srw-rw---- 1 root microk8s 0 Sep 26 09:18 kine.sock -rw-rw---- 1 root microk8s 64 Sep 26 09:18 localnode.yaml -rw-rw---- 1 root microk8s 32 Sep 26 09:18 metadata1 -rw-rw---- 1 root microk8s 32 Sep 26 09:18 metadata2 -rw-rw---- 1 root microk8s 142502028 Sep 26 06:00 snapshot-165-9536763-17472558 -rw-rw---- 1 root microk8s 168 Sep 26 06:00 snapshot-165-9536763-17472558.meta -rw-rw---- 1 root microk8s 143150131 Sep 26 09:11 snapshot-170-9537787-98902 -rw-rw---- 1 root microk8s 168 Sep 26 09:11 snapshot-170-9537787-98902.meta ``` * microk8s-129 ``` csie404@microk8s129:/var/snap/microk8s/current/var/kubernetes/backend$ ls -l total 481120 -rw-rw---- 1 root microk8s 4982192 Sep 26 04:53 0000000009530209-0000000009530378 -rw-rw---- 1 root microk8s 8375104 Sep 26 04:56 0000000009530379-0000000009530747 -rw-rw---- 1 root microk8s 7127984 Sep 26 04:59 0000000009530748-0000000009531023 -rw-rw---- 1 root microk8s 8253696 Sep 26 05:02 0000000009531024-0000000009531330 -rw-rw---- 1 root microk8s 4157648 Sep 26 05:03 0000000009531331-0000000009531448 -rw-rw---- 1 root microk8s 8376464 Sep 26 05:06 0000000009531449-0000000009531746 -rw-rw---- 1 root microk8s 1419776 Sep 26 05:07 0000000009531747-0000000009531800 -rw-rw---- 1 root microk8s 3080336 Sep 26 05:11 0000000009531801-0000000009532063 -rw-rw---- 1 root microk8s 8370656 Sep 26 05:13 0000000009532064-0000000009532411 -rw-rw---- 1 root microk8s 1862808 Sep 26 05:14 0000000009532412-0000000009532463 -rw-rw---- 1 root microk8s 8371304 Sep 26 05:18 0000000009532464-0000000009532821 -rw-rw---- 1 root microk8s 4649880 Sep 26 05:20 0000000009532822-0000000009532996 -rw-rw---- 1 root microk8s 3211496 Sep 26 05:22 0000000009532997-0000000009533158 -rw-rw---- 1 root microk8s 2755896 Sep 26 05:23 0000000009533159-0000000009533338 -rw-rw---- 1 root microk8s 8375048 Sep 26 05:26 0000000009533339-0000000009533606 -rw-rw---- 1 root microk8s 1538432 Sep 26 05:26 0000000009533607-0000000009533655 -rw-rw---- 1 root microk8s 8318424 Sep 26 05:29 0000000009533656-0000000009534012 -rw-rw---- 1 root microk8s 3670776 Sep 26 05:31 0000000009534013-0000000009534166 -rw-rw---- 1 root microk8s 3283832 Sep 26 05:33 0000000009534167-0000000009534289 -rw-rw---- 1 root microk8s 8350064 Sep 26 05:36 0000000009534290-0000000009534552 -rw-rw---- 1 root microk8s 3817208 Sep 26 05:37 0000000009534553-0000000009534673 -rw-rw---- 1 root microk8s 8369704 Sep 26 05:41 0000000009534674-0000000009535002 -rw-rw---- 1 root microk8s 8354056 Sep 26 05:43 0000000009535003-0000000009535264 -rw-rw---- 1 root microk8s 5517224 Sep 26 05:46 0000000009535265-0000000009535455 -rw-rw---- 1 root microk8s 8372112 Sep 26 05:50 0000000009535456-0000000009535817 -rw-rw---- 1 root microk8s 1420280 Sep 26 05:51 0000000009535818-0000000009535878 -rw-rw---- 1 root microk8s 6618688 Sep 26 05:55 0000000009535879-0000000009536250 -rw-rw---- 1 root microk8s 8388600 Sep 26 05:58 0000000009536251-0000000009536536 -rw-rw---- 1 root microk8s 185120 Sep 26 05:58 0000000009536537-0000000009536542 -rw-rw---- 1 root microk8s 8372336 Sep 26 06:01 0000000009536543-0000000009536918 -rw-rw---- 1 root microk8s 4573952 Sep 26 06:02 0000000009536919-0000000009537061 -rw-rw---- 1 root microk8s 4737056 Sep 26 06:07 0000000009537062-0000000009537264 -rw-rw---- 1 root microk8s 8351120 Sep 26 06:09 0000000009537265-0000000009537627 -rw-rw---- 1 root microk8s 1827152 Sep 26 09:09 0000000009537628-0000000009537696 -rw-rw---- 1 root microk8s 4847216 Sep 26 09:14 0000000009537697-0000000009537975 -rw-rw---- 1 root microk8s 3417224 Sep 26 09:18 0000000009537976-0000000009538246 -rw-rw---- 1 root microk8s 3682824 Sep 26 09:19 0000000009538247-0000000009538475 -rw-rw---- 1 root microk8s 5595248 Sep 26 23:53 0000000009538476-0000000009538667 -rw-rw---- 1 root microk8s 1870 Sep 21 09:20 cluster.crt -rw-rw---- 1 root microk8s 3272 Sep 21 09:20 cluster.key -rw-rw---- 1 root microk8s 318 Sep 26 09:57 cluster.yaml -rw-rw-r-- 1 root microk8s 2 Sep 27 10:17 failure-domain -rw-rw---- 1 root microk8s 58 Sep 21 09:20 info.yaml srw-rw---- 1 root microk8s 0 Sep 26 09:56 kine.sock -rw-rw---- 1 root microk8s 64 Sep 26 09:56 localnode.yaml -rw-rw---- 1 root microk8s 32 Sep 27 10:21 metadata1 -rw-rw---- 1 root microk8s 32 Sep 27 10:21 metadata2 -rw-rw---- 1 root microk8s 143808324 Sep 26 06:09 snapshot-168-9537492-3451489 -rw-rw---- 1 root microk8s 168 Sep 26 06:09 snapshot-168-9537492-3451489.meta -rw-rw---- 1 root microk8s 143746264 Sep 26 09:57 snapshot-186-9538516-2883084 -rw-rw---- 1 root microk8s 168 Sep 26 09:57 snapshot-186-9538516-2883084.meta ``` * microk8s-130 ``` csie404@microk8s130:/var/snap/microk8s/current/var/kubernetes/backend$ ls -l total 422992 -rw-rw---- 1 root microk8s 19826280 Sep 26 05:22 0000000009532368-0000000009533161 -rw-rw---- 1 root microk8s 8378904 Sep 26 05:25 0000000009533162-0000000009533519 -rw-rw---- 1 root microk8s 8379728 Sep 26 05:27 0000000009533520-0000000009533795 -rw-rw---- 1 root microk8s 7858696 Sep 26 05:31 0000000009533796-0000000009534166 -rw-rw---- 1 root microk8s 3456704 Sep 26 05:33 0000000009534167-0000000009534296 -rw-rw---- 1 root microk8s 7975520 Sep 26 05:35 0000000009534297-0000000009534544 -rw-rw---- 1 root microk8s 3841856 Sep 26 05:37 0000000009534545-0000000009534665 -rw-rw---- 1 root microk8s 7320160 Sep 26 05:40 0000000009534666-0000000009534952 -rw-rw---- 1 root microk8s 5055824 Sep 26 05:42 0000000009534953-0000000009535119 -rw-rw---- 1 root microk8s 4306832 Sep 26 05:43 0000000009535120-0000000009535257 -rw-rw---- 1 root microk8s 1065656 Sep 26 05:44 0000000009535258-0000000009535295 -rw-rw---- 1 root microk8s 1678976 Sep 26 05:45 0000000009535296-0000000009535358 -rw-rw---- 1 root microk8s 2990600 Sep 26 05:46 0000000009535359-0000000009535455 -rw-rw---- 1 root microk8s 7425624 Sep 26 05:49 0000000009535456-0000000009535781 -rw-rw---- 1 root microk8s 5856600 Sep 26 05:53 0000000009535782-0000000009536019 -rw-rw---- 1 root microk8s 7785976 Sep 26 05:57 0000000009536020-0000000009536409 -rw-rw---- 1 root microk8s 8374168 Sep 26 06:00 0000000009536410-0000000009536739 -rw-rw---- 1 root microk8s 8352896 Sep 26 06:02 0000000009536740-0000000009537056 -rw-rw---- 1 root microk8s 135800 Sep 26 06:02 0000000009537057-0000000009537061 -rw-rw---- 1 root microk8s 1803664 Sep 26 06:05 0000000009537062-0000000009537163 -rw-rw---- 1 root microk8s 7991816 Sep 26 06:08 0000000009537164-0000000009537432 -rw-rw---- 1 root microk8s 5118200 Sep 26 09:09 0000000009537433-0000000009537696 -rw-rw---- 1 root microk8s 1649408 Sep 26 09:12 0000000009537697-0000000009537831 -rw-rw---- 1 root microk8s 497672 Sep 26 09:12 0000000009537832-0000000009537846 -rw-rw---- 1 root microk8s 263384 Sep 26 09:12 0000000009537847-0000000009537856 -rw-rw---- 1 root microk8s 2776416 Sep 26 09:15 0000000009537857-0000000009538135 -rw-rw---- 1 root microk8s 2061440 Sep 26 09:16 0000000009538136-0000000009538209 -rw-rw---- 1 root microk8s 469016 Sep 26 09:17 0000000009538210-0000000009538225 -rw-rw---- 1 root microk8s 4230168 Sep 26 23:50 0000000009538226-0000000009538475 -rw-rw---- 1 root microk8s 1870 Sep 26 05:11 cluster.crt -rw-rw---- 1 root microk8s 3272 Sep 26 05:11 cluster.key -rw-rw---- 1 root microk8s 318 Sep 26 09:18 cluster.yaml -rw-rw-r-- 1 root microk8s 2 Sep 27 10:26 failure-domain -rw-rw---- 1 root microk8s 57 Sep 26 05:11 info.yaml srw-rw---- 1 root microk8s 0 Sep 26 09:17 kine.sock -rw-rw---- 1 root microk8s 63 Sep 26 09:17 localnode.yaml -rw-rw---- 1 root microk8s 32 Sep 27 10:27 metadata1 -rw-rw---- 1 root microk8s 32 Sep 27 10:26 metadata2 -rw-rw---- 1 root microk8s 142304258 Sep 26 05:57 snapshot-164-9536463-2917858 -rw-rw---- 1 root microk8s 168 Sep 26 05:57 snapshot-164-9536463-2917858.meta -rw-rw---- 1 root microk8s 143802651 Sep 26 06:09 snapshot-168-9537489-3604167 -rw-rw---- 1 root microk8s 168 Sep 26 06:09 snapshot-168-9537489-3604167.meta ``` * microk8s-131 ``` csie404@microk8s131:/var/snap/microk8s/current/var/kubernetes/backend$ ls -l total 482536 -rw-rw---- 1 root microk8s 7373416 Sep 26 04:53 0000000009530092-0000000009530386 -rw-rw---- 1 root microk8s 8383336 Sep 26 04:56 0000000009530387-0000000009530754 -rw-rw---- 1 root microk8s 8366248 Sep 26 04:59 0000000009530755-0000000009531074 -rw-rw---- 1 root microk8s 3076136 Sep 26 05:00 0000000009531075-0000000009531162 -rw-rw---- 1 root microk8s 8376048 Sep 26 05:04 0000000009531163-0000000009531463 -rw-rw---- 1 root microk8s 8376680 Sep 26 05:06 0000000009531464-0000000009531764 -rw-rw---- 1 root microk8s 876536 Sep 26 05:06 0000000009531765-0000000009531797 -rw-rw---- 1 root microk8s 8358552 Sep 26 05:11 0000000009531798-0000000009532313 -rw-rw---- 1 root microk8s 588464 Sep 26 05:11 0000000009532314-0000000009532335 -rw-rw---- 1 root microk8s 950328 Sep 26 05:12 0000000009532336-0000000009532370 -rw-rw---- 1 root microk8s 3490976 Sep 26 05:15 0000000009532371-0000000009532463 -rw-rw---- 1 root microk8s 8370248 Sep 26 05:18 0000000009532464-0000000009532821 -rw-rw---- 1 root microk8s 979352 Sep 26 05:18 0000000009532822-0000000009532857 -rw-rw---- 1 root microk8s 6922728 Sep 26 05:22 0000000009532858-0000000009533161 -rw-rw---- 1 root microk8s 8376088 Sep 26 05:25 0000000009533162-0000000009533519 -rw-rw---- 1 root microk8s 8379728 Sep 26 05:27 0000000009533520-0000000009533795 -rw-rw---- 1 root microk8s 1103120 Sep 26 05:28 0000000009533796-0000000009533840 -rw-rw---- 1 root microk8s 8385456 Sep 26 05:32 0000000009533841-0000000009534233 -rw-rw---- 1 root microk8s 1826720 Sep 26 05:33 0000000009534234-0000000009534296 -rw-rw---- 1 root microk8s 7975520 Sep 26 05:36 0000000009534297-0000000009534544 -rw-rw---- 1 root microk8s 4018880 Sep 26 05:37 0000000009534545-0000000009534673 -rw-rw---- 1 root microk8s 7142928 Sep 26 05:40 0000000009534674-0000000009534952 -rw-rw---- 1 root microk8s 8374880 Sep 26 05:43 0000000009534953-0000000009535220 -rw-rw---- 1 root microk8s 987632 Sep 26 05:43 0000000009535221-0000000009535257 -rw-rw---- 1 root microk8s 6113664 Sep 26 05:47 0000000009535258-0000000009535469 -rw-rw---- 1 root microk8s 8372368 Sep 26 05:50 0000000009535470-0000000009535835 -rw-rw---- 1 root microk8s 8380216 Sep 26 05:55 0000000009535836-0000000009536277 -rw-rw---- 1 root microk8s 8383904 Sep 26 05:58 0000000009536278-0000000009536555 -rw-rw---- 1 root microk8s 8191872 Sep 26 06:01 0000000009536556-0000000009536932 -rw-rw---- 1 root microk8s 4224104 Sep 26 06:03 0000000009536933-0000000009537061 -rw-rw---- 1 root microk8s 4733824 Sep 26 06:07 0000000009537062-0000000009537264 -rw-rw---- 1 root microk8s 8350704 Sep 26 06:09 0000000009537265-0000000009537627 -rw-rw---- 1 root microk8s 1827152 Sep 26 09:10 0000000009537628-0000000009537696 -rw-rw---- 1 root microk8s 2482600 Sep 26 09:12 0000000009537697-0000000009537860 -rw-rw---- 1 root microk8s 1745744 Sep 26 09:14 0000000009537861-0000000009537949 -rw-rw---- 1 root microk8s 592592 Sep 26 09:14 0000000009537950-0000000009537974 -rw-rw---- 1 root microk8s 24704 Sep 26 09:14 0000000009537975-0000000009537975 -rw-rw---- 1 root microk8s 1689008 Sep 26 09:16 0000000009537976-0000000009538183 -rw-rw---- 1 root microk8s 1180880 Sep 26 09:17 0000000009538184-0000000009538225 -rw-rw---- 1 root microk8s 460952 Sep 26 09:17 0000000009538226-0000000009538243 -rw-rw---- 1 root microk8s 3769224 Sep 26 09:21 0000000009538244-0000000009538475 -rw-rw---- 1 root microk8s 5595248 Sep 27 10:32 0000000009538476-0000000009538667 -rw-rw---- 1 root microk8s 1870 Sep 21 09:04 cluster.crt -rw-rw---- 1 root microk8s 3272 Sep 21 09:04 cluster.key -rw-rw---- 1 root microk8s 318 Sep 26 09:57 cluster.yaml -rw-rw-r-- 1 root microk8s 2 Sep 27 10:32 failure-domain -rw-rw---- 1 root microk8s 58 Sep 21 09:04 info.yaml srw-rw---- 1 root microk8s 0 Sep 26 09:56 kine.sock -rw-rw---- 1 root microk8s 64 Sep 26 09:56 localnode.yaml -rw-rw---- 1 root microk8s 32 Sep 27 10:34 metadata1 -rw-rw---- 1 root microk8s 32 Sep 27 10:35 metadata2 -rw-rw---- 1 root microk8s 142829536 Sep 26 06:07 snapshot-167-9537264-500928516 -rw-rw---- 1 root microk8s 168 Sep 26 06:07 snapshot-167-9537264-500928516.meta -rw-rw---- 1 root microk8s 143964173 Sep 26 09:18 snapshot-185-9538288-553592 -rw-rw---- 1 root microk8s 168 Sep 26 09:18 snapshot-185-9538288-553592.meta ``` ### 整理並找出具有健康資料的節點 | 節點編號 | 檔案編碼 | 是否為最新 | | -------- | -------- | -------- | | 127 | 0000000009538243-0000000009538475 | X | | 128 | 0000000009538247-0000000009538475 | X | | 129 | 0000000009538476-0000000009538667 | V | | 130 | 0000000009538226-0000000009538475 | X | | 131 | 0000000009538476-0000000009538667 | V | 資料顯示129的資料為健康的資料 ### 打包健康的資料並複製到其他節點指令: `tar -c -v -z --exclude=*.yaml --exclude=metadata* -f dqlite-data.tar.gz /var/snap/microk8s/current/var/kubernetes/backend` * 複製到其他節點 ``` scp dqlite-data.tar.gz csie404@microk8s127:~/dqlite-data.tar.gz scp dqlite-data.tar.gz csie404@microk8s128:~/dqlite-data.tar.gz scp dqlite-data.tar.gz csie404@microk8s130:~/dqlite-data.tar.gz scp dqlite-data.tar.gz csie404@microk8s131:~/dqlite-data.tar.gz ``` * 到各節點解壓縮正確資料並放入到正確位置 ``` sudo su cd / tar zxfv /home/csie404/dqlite-data.tar.gz ``` ## Reference and FAQ * https://discuss.kubernetes.io/t/recovery-of-ha-microk8s-clusters/12931 :::info **Find this document incomplete?** Leave a comment! ::: ###### tags: `聯合大學` `資訊工程學系` `Documentation`