# Summary week base | | F1-score | | -------- | -------- | | Direct ST test on July all | `0.8328` | | Direct ST + improved PL method test on July all | `0.8313` | | Gradual ST test on July all　| `0.8375 ` | | Gradual ST + improved PL method test on July all | `0.8375` | Month base | | f1-score | |---|---| | Base Model test on July all| `0.8446`| | Direct ST test on July all | `0.8496`| | Direct ST + improved PL method test on July all|`0.8547` | | Gradual ST test on July all|`0.8547`| | Gradual ST + improved PL method test on July all| `0.8547` |M | | Re-weight | non-Re-weight| |---|---|---| |f1-score|`0.8465`|`0.8496`| |time(s)|`15617.4`|`11255.6`| # Week based ## Base Model test on July week1、July week2、July week3、July week4、July all ![image.png](https://hackmd.io/_uploads/ByK3E0EQT.png) ## Direct ST test on July all ``` Kao/Real_traffic/test_on_shino/2019_3month/week_base/WeekBase_All/All/weekbase_all.ipynb ``` ![image.png](https://hackmd.io/_uploads/SkGqiVH7T.png) `May2 Model July All f1score:, 0.8328` ## Direct ST + improved PL method test on July all ``` Kao/Real_traffic/test_on_shino/2019_3month/week_base/WeekBase_All/All/weekbase_all_remove1.ipynb ``` ![image.png](https://hackmd.io/_uploads/Sk8hP6H7T.png) `May2 Model July All f1score:, 0.8313` ## Gradual ST test on July all ![image.png](https://hackmd.io/_uploads/ryMX1WrXp.png) `May2 Model July All f1score: 0.8375 ` ## Gradual ST + improved PL method test on July week1、July week2、July week3、July week4、July all path: ``` Kao/Real_traffic/test_on_shino/2019_3month/week_base/WeekBase_All/June4/weekbase_June4.ipynb ``` ![image.png](https://hackmd.io/_uploads/SkPBoAEma.png) ### July1 ![image.png](https://hackmd.io/_uploads/HJvJ20N76.png) ![image.png](https://hackmd.io/_uploads/S1-1hC4XT.png) ### July ![image.png](https://hackmd.io/_uploads/SkvCoR4Xa.png) ![image.png](https://hackmd.io/_uploads/r1JCjREmT.png) ### July3 ![image.png](https://hackmd.io/_uploads/B1-piC476.png) ![image.png](https://hackmd.io/_uploads/B1Hhi0N7p.png) ### July4 ![image.png](https://hackmd.io/_uploads/rJcojRVXp.png) ![image.png](https://hackmd.io/_uploads/ry0coR4XT.png) ### July all ![image.png](https://hackmd.io/_uploads/SJ68hREXp.png) `May2 Model July All f1score: 0.8375` # Month based ## Base Model test on July all path: ``` Kao/Real_traffic/test_on_shino/2019_3month/month_base/3month_train5_test6%267.ipynb ``` ![image.png](https://hackmd.io/_uploads/rJUb_0EQ6.png) ## Direct ST test on July all ``` Kao/Real_traffic/test_on_shino/2019_3month/month_base/train5_selftrain6_10base_test7_WT_IT_non-reweight.ipynb ``` ![image.png](https://hackmd.io/_uploads/H1pJKaSQa.png) ![image.png](https://hackmd.io/_uploads/ryPgK6S7T.png) `0.8496` ## Direct ST + improved PL method test on July all ``` Kao/Real_traffic/test_on_shino/2019_3month/month_base/train5_selftrain6_10base_test7_WT_IT_non-reweight_remove1.ipynb ``` ![image.png](https://hackmd.io/_uploads/HyAhOTSQ6.png) ![image.png](https://hackmd.io/_uploads/HJDpdpBX6.png) `0.8547` ## Gradual ST test on July all `Kao/Real_traffic/test_on_shino/2019_3month/10_base/Runall/June3-non_improve_ST.ipynb` ![image.png](https://hackmd.io/_uploads/Byz4_6rQT.png) ![image.png](https://hackmd.io/_uploads/rJ2VdpSma.png) `0.8547` ## Gradual ST + improved PL method test on July all `Kao/Real_traffic/test_on_shino/2019_3month/10_base/Runall/June3.ipynb` ![image.png](https://hackmd.io/_uploads/HyjuOTB7p.png) ![image.png](https://hackmd.io/_uploads/ByEtd6Bmp.png) `0.8547` ## Re-weight vs. Non-Re-weight test on July all ### Re-weight ![image.png](https://hackmd.io/_uploads/S1RUtANmT.png) ![image.png](https://hackmd.io/_uploads/B1DwFA47p.png) `Model test1_f1 f1score: 0.8465` ### Non-re-weight ![image.png](https://hackmd.io/_uploads/H1R6tANQp.png) ![image.png](https://hackmd.io/_uploads/ryvRt0NXa.png) `Model test1_f1 f1score: 0.8496` ## Re-weight vs. Non-Re-weight Runtime re-weight time : `Self-Training Process Time: 15617.462481021881` Non-reweight time : `Self-Training Process Time: 11255.67429113388` # Summary | | model test on Unseen July | | -------- | -------- | | Topline | 0.8494 | | Base model (may2) | 0.7987| | May3 | 0.8355| | May4 | 0.8334| | June1 | 0.8212| | June2 | 0.8392| | June3 | 0.8246| | June4 | 0.8375| # Topline ![](https://hackmd.io/_uploads/B13sKWaG6.png) # May 2 base model ![](https://hackmd.io/_uploads/H1X5K-Tz6.png) # May 3 ![](https://hackmd.io/_uploads/SJ7RtbazT.png) # May 4 ![](https://hackmd.io/_uploads/rJskcb6f6.png) # June 1 ![](https://hackmd.io/_uploads/B1ZzcWpfp.png) # June 2 ![](https://hackmd.io/_uploads/B1bX9Z6G6.png) # June 3 ![](https://hackmd.io/_uploads/SkxHqb6f6.png) # June 4 ![](https://hackmd.io/_uploads/S1ILcb6MT.png)