# PixPro
GPUs=8
## epoch 100目
| pre-dataset | aug | bs | crop size | loss type | head sim | mIOU |
| :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| IN | BYOL (default) | 128 | 224x224 | PixPro | o | 57.92 |
| IN | BYOL (default) | 16 | 224x224 | PixPro | o | 52.86 |
| IN | myBYOL | 128 | 224x224 | pixpro | o | 28.24 |
| IN | myBYOL | 16 | 512x1024 | pixpro | o | 6.93 |
| IN | mySimCLR | 128 | 224x224 | pixpro | o | 26.66 |
| IN | mySimCLR | 16 | 512x1024 | pixpro | o | 17.81 |
| IN | SimCLR | 128 | 224x224 | pixpro | o | 57.58 |
| IN | SimCLR | 16 | 512x1024 | pixpro | o | 47.94 |
| BD | myBYOL | 128 | 224x224 | pixpro | o | 30.31 |
| BD | myBYOL | 16 | 512x1024 | pixpro | o | 23.29 |
| BD | mySimCLR | 128 | 224x224 | pixpro | o | 27.06 |
| BD | mySimCLR | 16 | 512x1024 | pixpro | o | 18.36 |
| BD | SimCLR | 128 | 224x224 | pixpro | o | 47.42 |
| BD | SimCLR | 16 | 512x1024 | pixpro | o | 47.42 |
| BD | SimCLR | 16 | 512x1024 | pixpro | o | 47.42 |
| BD | BYOL | 2\*64 | 224x224 | pixpro | o | 48.44 |
| - | - | - | - | - | - | - |
| BD | BYOL | 16 | 224x224 | floweloss | x | 44.18 |
| BD | myBYOL | 16 | 512x1024 | floweloss | x | 30.97 |
| BD | SimCLR | 16 | 224x224 | floweloss | x | 43.73 |
| BD | mySimCLR | 16 | 512x1024 | floweloss | x | 28.89 |

## epoch 10目
| pre-dataset | aug | bs | crop size | loss type | head sim | mIOU |
| :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| IN | myBYOL | 128 | 224x224 | pixpro | o | 37.48 |
| IN | myBYOL | 16 | 512x1024 | pixpro | o | 11.40 |
| IN | mySimCLR | 128 | 224x224 | pixpro | o | 33.31 |
| IN | mySimCLR | 16 | 512x1024 | pixpro | o | 10.22 |
| IN | SimCLR | 128 | 224x224 | pixpro | o | 54.56 |
| IN | SimCLR | 16 | 512x1024 | pixpro | o | 46.31 |
| BD | myBYOL | 128 | 224x224 | pixpro | o | 32.54 |
| BD | myBYOL | 16 | 512x1024 | pixpro | o | 27.65 |
| BD | mySimCLR | 128 | 224x224 | pixpro | o | 30.76 |
| BD | mySimCLR | 16 | 512x1024 | pixpro | o | 14.72 |
| BD | SimCLR | 128 | 224x224 | pixpro | o | 35.83 |
| BD | SimCLR | 16 | 512x1024 | pixpro | o | 38.04 |
| BD | BYOL | 2\*64 | 224x224 | pixpro | o | 42.54 |
| - | - | - | - | - | - | - |
| BD | BYOL | 16 | 224x224 | floweloss | x | 32.54 |
| BD | myBYOL | 16 | 512x1024 | floweloss | x | 26.21 |
| BD | SimCLR | 16 | 224x224 | floweloss | x | 31.63 |
| BD | mySimCLR | 16 | 512x1024 | floweloss | x | 26.92 |

## 2frame
### 10epoch目
| pre-dataset | bs | crop size | aug | loss type | head sim | mIoU |
| :----: | :----: | :----: | :----: | :----: | :-: | :-: |
| BD | 16 | 512x1024 | mySimCLR + 2frame | floweloss | o | 24.44 |
| BD | 16 | 512x1024 | mySimCLR + 2frame | floweloss | x | 26.16 |
| BD | 16 | 224x224 | BYOL + 2frame | floweloss | o | 33.04 |
| BD | 16 | 512x1024 | myBYOL + 2frame | floweloss | x | 28.33 |

### 100epoch目
| pre-dataset | bs | crop size | aug | loss type | head sim | mIoU |
| :----: | :-: | :----: | :----: | :----: | :----: | :-: |
| BD | 16 | 512x1024 | mySimCLR + 2frame | floweloss | o | 19.08 |
| BD | 16 | 512x1024 | mySimCLR + 2frame | floweloss | x | 19.14 |
| BD | 16 | 224x224 | BYOL + 2frame | floweloss | o | 43.66 |
| BD | 16 | 512x1024 | myBYOL + 2frame | floweloss | x | 18.53 |

# PixPro (video-representation) + OF
## 10epoch
| method | pre-dataset | bs | crop size | aug | loss type | head sim | OF | mIoU |
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| flowe (abci) | BD | 128(2\*64) | 224x224 | BYOL | flowe loss | x | o | 31.05
| flowe (flow) | BD | 128(2\*64) | 224x224 | BYOL + flip + Crop | flowe loss | x | o | 34.13
| flowe (flow) | BD | 128(2\*64) | 224x224 | BYOL + flip + Crop | flowe loss | x | x | 17.98
| flowe (flow) | BD | 128(2\*64) | x | BYOL + flip + Rotate(-30°~30°) | flowe loss | x | x | 23.94
| flowe (flow) | BD | 128(2\*64) | x | BYOL + flip + recale (0.5-2.0) + Rotate(-30°~30°) | flowe loss | x | o | 31.31
| - | - | - | - | - | - | - | - | - |
| flowe (abci) | BD | 128(2\*64) | x | BYOL + Rotate(-30°~30°) | flowe loss | x | o | 29.53
| flowe (abci) | BD | 128(2\*64) | x | BYOL + Rotate(-30°~30°) | flowe loss | x | x | 18.87
| flowe (abci) | BD | 128(2\*64) | (0.08~1.0倍の範囲) | BYOL + Crop | flowe loss | x | o | 34.51
| flowe (abci) | BD | 128(2\*64) | x | BYOL + Rescale(0.5~2.0) + Rotate(-30°~30°) | flowe loss | x | o | 34.59

## 11epoch
| method | pre-dataset | bs | crop size | aug | loss type | head sim | mIoU |
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| flowe (abci,11epochでの結果) | BD | 128(2\*64) | 224x224 | BYOL | flowe loss | x | 32.95
| flowe (abci) | BD | 128(2\*64) | 224x224 | BYOL | flowe loss | x | 32.02
| flowe (flow) | BD | 128(2\*64) | 224x224 | BYOL | flowe loss | x | 34.45

## 100epoch
| method | pre-dataset | bs | crop size | aug | loss type | head sim | OF | mIoU |
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| flowe (abci) | BD | 128(2\*64) | 224x224 | BYOL + flip + Crop | flowe loss | x | o | 34.30
| flowe (flow) | BD | 128(2\*64) | 224x224 | BYOL + flip + Crop | flowe loss | x | o | 32.95
| flowe (flow) | BD | 128(2\*64) | 224x224 | BYOL + flip + Crop | flowe loss | x | x | 16.16
| flowe (flow) | BD | 128(2\*64) | x | BYOL + Rotate(-30°~30°) + flip | flowe loss | x | x | 27.67
| flowe (flow) | BD | 128(2\*64) | x | BYOL + recale (0.5-2.0) + Rotate(-30°~30°) + flip | flowe loss | x | o | 36.91