# Dehaze on Vehicle ReID - work log

# Yeh
- [x] Real World Dataset: Veriwild Syn for \beta 0.6-2, \alpha 0.7-1
* 分資料： train: image_train_synreal , gallery: image_test_clear, query: image_query_hazy
* VERIWILD_syn
* 數量：
- image_train_synreal: 277797
- image_test_clear : 8301
- image_query_hazy : 545

- [x] Run DMT: train on veri_syn/image_train_synreal , test on veri_syn/ synreal
* root: /work/r09921058/ReID_dehazeREID/ReID_inference/Aicity_DMT_2020/
* step1. 拿 veh1mwild_nli.py 改dataset/veri_synreal.py
* step2. 改 dataset.make_dataloader.py
* step3. 改configs 拿 veh1m_train_with_image.yml 改
* step4. train veri_synreal

!! model save : '/work/r09921058/ReID_dehazeREID/ReID_inference/Inference_veri_synreal/DMT/modela_1'
- [ ] 1.haze all image folder 2.remove dark 3.query:1 page gallery:others 4. pandas format (fade <1.05 && HSV valure< 140000)
- [x] Run DMT and RBSM on b2,test on gallery b2 and clear,and retrain b
- [x] check RBSM、DMT pretrain weight,retrain DMT b0~b5

- # DataSet
- veri776
- 
- 
- veriwild
- 
- veh1mwild
- 
- 
- image id (train + test )
- for only train id
- 0 <= pid <=
- veri_synreal_plus
- 

- # DMT
* DMT on veri_synreal
- Train Cmd:

python train.py --config_file="./configs/verisyn_train_with_image.yml" DATASETS.ROOT_DIR "/work/r09921058/ReID_dehazeREID/Dataset/VeRi_syn/" MODEL.PRETRAIN_PATH "./pre-train/resnet50_ibn_a.pth.tar" MODEL.DEVICE_ID "('0')" OUTPUT_DIR "/work/r09921058/ReID_dehazeREID/ReID_inference/Inference_veri_synreal/models_1/" DATASETS.NAMES "('veri_syn')"
- TEST_SYNREAL:(b0~b3)
| map | cmc1 | cmc5 | cmc10 |
| ----- | ----- | ----- |:----- |
| 71.5% | 93.9% | 97.3% | 98.5% |
* DMT on veri
- DMT Train on veri_syn_b0:
| map | cmc1 | cmc5 | cmc10 |
|:---- |:---- |:---- |:----- |
| 75.9 | 95.9 | 98.3 | 98.9 |
- DMT Train on veri_syn_b1:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 73.3 | 94.8 | 97.9 | 98.7 |
- DMT Train on veri_syn_b2:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 69.4 | 93.8 | 97.3 | 98.5 |
- DMT Train on veri_syn_b3:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 66.9 | 92.4 | 96.6 | 98.0 |
- DMT Train on veri_syn_b4:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 62.2 | 90.5 | 95.5 | 97.3 |
- DMT Train on veri_syn_b5:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 55.4 | 87.7 | 94.0 | 96.5 |

* DMT Train on Veriwild_clear
- TEST_onlyhaze:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 83.8 | 94.7 | 98.0 | 98.5 |
* DMT Train on Veriwild_syn
- TEST_onlyhaze:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 82.5 | 94.1 | 97.6 | 98.2 |

- # RBSM
* RBSM Train on veri_syn_b0
- TEST_SYN_b0:
| map | cmc1 | cmc5 | cmc10 |
|:----- |:----- |:----- |:----- |
| 73.09 | 94.28 | 98.15 | 98.99 |
- TEST_SYN_b1:
| map | cmc1 | cmc5 | cmc10 |
|:----- |:----- |:----- |:----- |
| 54.49 | 84.51 | 92.07 | 95.05 |
- TEST_SYN_b2:
| map | cmc1 | cmc5 | cmc10 |
|:---- |:----- |:----- |:----- |
| 35.5 | 74.79 | 85.04 | 88.32 |
- TEST_SYN_b3:
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- |:----- |:----- |
| 22.42 | 64.54 | 78.01 | 82.48 |
* RBSM Train on veri_syn_b1
- TEST_SYN_b1:
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- | ----- |:----- |
| 70.34 | 93.68 | 97.79 | 98.75 |
* RBSM Train on veri_syn_b2
- TEST_SYN_b2:
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- | ----- |:----- |
| 68.14 | 92.61 | 97.26 | 98.39 |
- retrain TEST_SYN_b2:(resnet50)
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- |:----- |:----- |
| 68.23 | 92.43 | 97.44 | 98.69 |
* RBSM Train on veri_syn_b3
- TEST_SYN_b3:
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- |:----- |:----- |
| 64.97 | 90.58 | 96.25 | 97.79 |
- retrain TEST_SYN_b3: (resnet50)
| map | cmc1 | cmc5 | cmc10 |
| ----- |:----- |:----- |:----- |
| 65.62 | 91.36 | 96.78 | 97.85 |
## Train_on_veh1M_clear
- gallery_clear_one_query_clear_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 89.95 | 98.48 | 97.44 | 84.15 |
- gallery_clear_one_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 79.06 | 93.71 | 91.84 | 69.00 |
- gallery_haze_one_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 85.63 | 96.39 | 95.34 | 78.09 |
- gallery_clear_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 86.19 | 95.10 | 93.94 | 90.79 |

## Train_on_veh1M_synreal
- gallery_clear_one_query_clear_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 89.80 | 98.48 | 97.32 | 83.80 |
- gallery_clear_one_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 78.54 | 93.47 | 90.79 | 68.07 |
- gallery_haze_one_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 85.92 | 96.74 | 95.34 | 78.32 |
- gallery_clear_query_haze_one:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 86.47 | 95.57 | 93.82 | 91.14 |

- # Triplet (epoch 50)
- test_veri_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 54.6 | 86.6 | 94.2 | 96.4 |
- test_veri_synreal_query_synreal_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 57.6 | 88.0 | 95.2 | 97.3 |
- test_veh1mwild_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 43.5 | 34.3 | 53.6 | 61.1 |
- test_veh1mwild_haze_query_haze_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 40.2 | 30.7 | 50.6 | 58.3 |
- test_veh1mwild_clear_query_clear_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 74.1 | 66.2 | 83.6 | 87.9 |
- test_veh1mwild_haze_query_haze_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 70.9 | 62.0 | 81.4 | 85.8 |

- # DMT (epoch 80)
- test_veri_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 71.4 | 94.1 | 97.6 | 98.6 |
- test_veri_synreal_query_synreal_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 71.9 | 94.2 | 97.5 | 98.4 |
- test_veh1mwild_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 68.3 | 59.7 | 77.7 | 83.6 |
- test_veh1mwild_haze_query_haze_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 68.8 | 59.5 | 79.4 | 83.6 |
- test_veh1mwild_clear_query_clear_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 87.4 | 81.9 | 94.9 | 97.2 |
- test_veh1mwild_haze_query_haze_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 86.2 | 81.3 | 92.9 | 94.9 |

- # VehicleX(epoch 70)
- test_veri_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 61.88 | 88.62 | 95.35 | 97.44 |
- test_veri_synreal_query_synreal_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 63.37 | 88.68 | 95.65 | 97.56 |
- test_veh1mwild_clear_query_clear_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 50.57 | 41.36 | 60.75 | 69.08 |
- test_veh1mwild_haze_query_haze_train_on_veri_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 45.72 | 35.91 | 57.04 | 64.16 |
- test_veh1mwild_clear_query_clear_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 92.15 | 88.08 | 97.35 | 98.05 |
- test_veh1mwild_haze_query_haze_train_on_veh1mwild_synreal:
| map | cmc1 | cmc5 | cmc10 |
| ---- |:---- |:---- |:----- |
| 89.65 | 84.83 | 95.43 | 96.90 |
- # Veri_baseline(epoch 100)
-

---

- [ ] train on clear < train on syn when testing on onlyhaze (run in baseline)

* other job - Veh1m
- [ ] 798 ids all images (non - rename) - hazy
* data pandas : [veh1m_id, clear_img_list, hazy_img_list, clear_img_num, hazy_img_num]
- [ ] clear imgs list: [veh1m_id, clear_img_list, clear_img_num]
* 設定threshold，抓2000-5000 給我們抓。
* Veh1m all data pandas -> for chacking which we can use.

Sylab: cihsiang 1234qwer

# SOTA Compare
- Train VeRi Synreal
| Method | mAP | CMC1 | CMC5 | CMC10 |
| ---- |:---- |:---- |:----- |:----- |
| 89.65 | 84.83 | 95.43 | 96.90 |