ICIP'23 - HackMD

--- tags: Compression --- # ICIP'23 ## (Backup) CANF-VC++: Towards Detail-Enhanced and Content-Adaptive Video Compression using Conditional Augmented Normalizing Flows ### Outline 1. Introduction 2. Proposed method * System Overview * Advanced Motion Compensation for Conditional P-frame Coding * Detail-Enhanced Motion-Compensated Frame Generation with I-Frame > I-frame synthesis + GridNet * Content-Adaptive Motion-Compensated Frame Generation > conditional convolution with accumulated flow * Latent Skip Mode Selection > skip-mode * Implementation Details > RNN-based training, training with rounded latent 3. Experiments * Experimental Setup * UVG, HEVC-B, MCL-JCV * Anchor: HM/VTM * GOP size = 32 * \# of GOPs = 3 * Rate-Distortion Performance * Ablation Study * Incremental Gain of Proposed Modules - [x] baseline: CANF-VC - [x] + RNN-based + rounded latent > Exp #1 - [ ] + I-frame Synthesis > Exp #2 - [x] + GridNet > Exp #8 - [x] + cond conv - [ ] + skip mode on Residual > Exp #3 - [ ] + skip mode on Motion (Ours) > Exp #4 * Effectiveness of Content-Adaptive Motion-Compensated Frame Generation - [x] Input: I-frame + warped previous > Exp #5 - [ ] Input: accumulated flow > Exp #6 - [x] Input: I-frame + warped previous + accumulated flow > Exp #7 - [ ] (Spatial) Input: accumulated flow > Exp #9 - [ ] (Spatial) Input: I-frame + warped previous + accumulated flow > Exp #10 4. Conclusion --- ### Experiments 1. * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | -------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | 36 | | 7e98864198a741658b12f991723f86cf | | | 2048 | | 41 | | ee92616c8e0f427b9eadda20b70d11a4 | | | 1024 | | 40 | | 447a00ee468449feae4e6065ba4456de | | | 512 | | 39 | | 50812d3e7fd549c38e82256cb9872fc7 | | | 256 | | 40 | | 82ab8db341c144cf9ad09f913930a511 | | * Training Command | lambda | Command | Note | | -------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=0 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 3 --restore=finetune --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN --restore_exp_key=7a2fe609d85546a68634bcced60d322f --restore_exp_epoch=35 -lr=1e-5` | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 3 --restore=finetune --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN --restore_exp_key=7e98864198a741658b12f991723f86cf --restore_exp_epoch=36 -lr=1e-5` | | | 1024 | `$ CUDA_VISIBLE_DEVICES=1 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 3 --restore=finetune --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN --restore_exp_key=7e98864198a741658b12f991723f86cf --restore_exp_epoch=36 -lr=1e-5` | | | 512 | `$ CUDA_VISIBLE_DEVICES=2 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 3 --restore=finetune --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN --restore_exp_key=7e98864198a741658b12f991723f86cf --restore_exp_epoch=36 -lr=1e-5` | | | 256 | `$ CUDA_VISIBLE_DEVICES=3 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 3 --restore=finetune --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN --restore_exp_key=7e98864198a741658b12f991723f86cf --restore_exp_epoch=36 -lr=1e-5` | | * Testing Command * 2048: `$ CUDA_VISIBLE_DEVICES=0 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN-estUN_gop12 --restore_exp_key=ee92616c8e0f427b9eadda20b70d11a4 --restore_exp_epoch=41 --test --test_GOP=12` * ![](https://i.imgur.com/RA5cRjk.png) * 1024: `$ CUDA_VISIBLE_DEVICES=0 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN-estUN_gop12 --restore_exp_key=447a00ee468449feae4e6065ba4456de --restore_exp_epoch=40 --test --test_GOP=12` * ![](https://i.imgur.com/40gj5xN.png) * 512: `$ CUDA_VISIBLE_DEVICES=1 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN-estUN_gop12 --restore_exp_key=50812d3e7fd549c38e82256cb9872fc7 --restore_exp_epoch=39 --test --test_GOP=12` * ![](https://i.imgur.com/i46EPkJ.png) * 256: `$ CUDA_VISIBLE_DEVICES=1 python3 condMo_condInter_ANFIC.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=ANF-based-resCoder-for-DVC --experiment_name=CANFVC-realRNN-estUN_gop12 --restore_exp_key=82ab8db341c144cf9ad09f913930a511 --restore_exp_epoch=40 --test --test_GOP=12` * ![](https://i.imgur.com/NoNhfy7.png) 2. * Response by: `John` * Table of experiments | No. | Exp | lambda | state | epoch | exp_hash | Note | | ----- | ------------------- | ------ | ----- | ----- | -------------------------------- | ---- | | 2 | start from baseline | 2048 | | 20 | 4e9c768b44be48c9810176ffbf7b1668 | | | 2-1 | start from baseline | 2048 | | 22 | 4e9c768b44be48c9810176ffbf7b1668 | | | 2-2 | start from baseline | 2048 | | 24 | 4e9c768b44be48c9810176ffbf7b1668 | | | 2-3 | start from baseline | 2048 | | 27 | 4e9c768b44be48c9810176ffbf7b1668 | | | 2-4 | start from baseline | 1024 | | 30 | d76718ce7e854a128bf6d9ddada75176 | | | 2-5 | start from baseline | 512 | | 29 | acd7dacc29f54a6f8153d6cfbc592f46 | | | 2-6 | start from baseline | 256 | | 29 | ed698393dcc647ce879d6abb381a5a6a | | | 3 | | 2048 | | 38 | 2527345d2d514abb852ac8ea8cc51a98 | | | 3-1 | | 1024 | | 43 | 053ad3bef0454d9b91f7655cea1d5539 | | | 3-2 | | 512 | | 43 | a2f9713356e1446fa236d0a0aa1c41e4 | | | 3-3 | | 256 | | 43 | 6150d7c51b8f41cfbc9e402885b2692f | | | 4 | 2 again | 2048 | | 32/37 | d3202f9474244d678699cbed28702bb0 | | | 4-1 | finetune 4 | 2048 | | 31 | 5339c97a1f7c49549b5f22e3622969cf | | | 4-1-1 | finetune 4-1 | 2048 | | 30/35 | 37ed856624b745d586a256683c45484c | | | 4-1 | | 1024 | | 33/35 | df7c34951f104b5bbb68465dcdbaf935 | | | 4-2 | | 512 | | 35 | 0895e2490a4145afbabaf0b4a6fea176 | | | 4-3 | | 256 | | 34/35 | 1cc117ee4e344ebf94ee3d1c5460b69c | | * Training Command | No. | Command | Note | | --- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ----- | | 2 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size=12 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=load --restore_exp_key=ee92616c8e0f427b9eadda20b70d11a4 --restore_exp_epoch=41 -lr=1e-4` | 50189 | | 2-1 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size=8 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=resume --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=20 -lr=1e-4` | 50189 | | 2-2 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=resume --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=22 -lr=1e-4` | 50189 | | 2-3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=resume --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=24 -lr=1e-4` | 50189 | | 2-4 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=1024 --num_workers=32 --gpus=8 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=27 -lr=1e-4` | 50189 | | 2-5 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=27 -lr=1e-4` | 53517 | | 2-6 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=27 -lr=1e-4` | 57953 | | 3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=27 -lr=1e-4` | 55496 | | 3-1 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=2527345d2d514abb852ac8ea8cc51a98 --restore_exp_epoch=37 -lr=1e-4` | 55203 | | 3-2 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=2527345d2d514abb852ac8ea8cc51a98 --restore_exp_epoch=37 -lr=1e-4` | 51502 | | 3-3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior_estUN_outR.yml --residual_coder_conf ./config/CANF_inter_coder_estUN_outR.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size=2 --project_name=CANFVC++ --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=2527345d2d514abb852ac8ea8cc51a98 --restore_exp_epoch=37 -lr=1e-4` | 55484 | | 4 | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=load --restore_exp_key=ee92616c8e0f427b9eadda20b70d11a4 --restore_exp_epoch=41 -lr=1e-4` | | | 4-1 | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=d3202f9474244d678699cbed28702bb0 --restore_exp_epoch=32 -lr=2e-5` | | | 4-1 | `$ CUDA_VISIBLE_DEVICES=4 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=5339c97a1f7c49549b5f22e3622969cf --restore_exp_epoch=31 -lr=2e-5` | | | 4-2 | `$ CUDA_VISIBLE_DEVICES=5 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=5339c97a1f7c49549b5f22e3622969cf --restore_exp_epoch=31 -lr=2e-5` | | | 4-3 | `$ CUDA_VISIBLE_DEVICES=6 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=5339c97a1f7c49549b5f22e3622969cf --restore_exp_epoch=31 -lr=2e-5` | | | 4-4 | `$ CUDA_VISIBLE_DEVICES=7 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size=2 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=finetune --restore_exp_key=5339c97a1f7c49549b5f22e3622969cf --restore_exp_epoch=31 -lr=2e-5` | | * Testing Command | Exp No. | Command | Note | | ------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ---- | | 2-3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=4e9c768b44be48c9810176ffbf7b1668 --restore_exp_epoch=27 --gop=32 --test` | | | 2-4 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=d76718ce7e854a128bf6d9ddada75176 --restore_exp_epoch=30 --gop=32 --test` | | | 2-5 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=acd7dacc29f54a6f8153d6cfbc592f46 --restore_exp_epoch=29 --gop=32 --test` | | | 2-6 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=ed698393dcc647ce879d6abb381a5a6a --restore_exp_epoch=29 --gop=32 --test` | | | 3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=2527345d2d514abb852ac8ea8cc51a98 --restore_exp_epoch=37 --gop=32 --test` | | | 3-1 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=053ad3bef0454d9b91f7655cea1d5539 --restore_exp_epoch=42 --gop=32 --test` | | | 3-2 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=a2f9713356e1446fa236d0a0aa1c41e4 --restore_exp_epoch=42 --gop=32 --test` | | | 3-3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size=1 --restore=resume --project_name=CANFVC++ --experiment_name=FS_MCNet_start_from_baseline --restore_exp_key=6150d7c51b8f41cfbc9e402885b2692f --restore_exp_epoch=42 --gop=32 --test` | | | 4-1 | `$ CUDA_VISIBLE_DEVICES=2 python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=resume --restore_exp_key=5339c97a1f7c49549b5f22e3622969cf --restore_exp_epoch=31 --gop=32 --test` | | | 4-1-1 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=resume --restore_exp_key=37ed856624b745d586a256683c45484c --restore_exp_epoch=30 --gop=32 --test` | | | 4-2 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=resume --restore_exp_key=df7c34951f104b5bbb68465dcdbaf935 --restore_exp_epoch=33 --gop=32 --test` | | | 4-3 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=resume --restore_exp_key=0895e2490a4145afbabaf0b4a6fea176 --restore_exp_epoch=35 --gop=32 --test` | | | 4-4 | `$ python3 condMo_condInter_ANFIC_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --project_name=ANF-based-resCoder-for-DVC --experiment_name=FS_MCNet --restore=resume --restore_exp_key=1cc117ee4e344ebf94ee3d1c5460b69c --restore_exp_epoch=34 --gop=32 --test` | | * Testing Result | Exp | lambda | Result | Note | | ----- | ------ | ------------------------------------ | ---- | | 2-3 | 2048 | ![](https://i.imgur.com/bIrmsXb.png) | | | 2-4 | 1024 | ![](https://i.imgur.com/0FelOOq.png) | | | 2-5 | 512 | ![](https://i.imgur.com/pAqRJ4v.png) | | | 2-6 | 256 | ![](https://i.imgur.com/3S3Dk7Z.png) | | | 3 | 2048 | ![](https://i.imgur.com/d77cxQ2.png) | | | 3-1 | 1024 | ![](https://i.imgur.com/2Ql0mZH.png) | | | 3-2 | 512 | ![](https://i.imgur.com/2CmkT0L.png) | | | 3-3 | 256 | ![](https://i.imgur.com/14jYGik.png) | | | 4-1-1 | | ![](https://i.imgur.com/k1BjVOj.png) | | | 4-1 | 1024 | ![](https://i.imgur.com/dpY83kJ.png) | | | 4-2 | 512 | ![](https://i.imgur.com/gpA8bbl.png) | | | 4-3 | 256 | ![](https://i.imgur.com/FiZBHKH.png) | |  3. * Response by: `John` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | ------ | ----- | ----- | ------ | -------- | ---- | | 2048 | | | | | | | | | | | | | | | | | | | | | | | | | | | * Training Command | lambda | Command | Note | | ------ | ------- | ---- | | | | | * Testing Command * 2048: 4. * Response by: `John` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | ------ | ----- | ----- | ------ | -------- | ---- | | 2048 | | | | | | | | | | | | | | | | | | | | | | | | | | | * Training Command | lambda | Command | Note | | ------ | ------- | ---- | | | | | * Testing Command * 2048: 5. Input: I-frame + warped previous * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | ------ | ----- | ----- | ------ | -------------------------------- | ---------- | | 2048 | | 32/33 | | 68ab669f8761403492276256b00d0344 | | | 2048 | | 21 | | b7c2092f1fc9445d97d24194296d0591 | | | 1024 | | 21 | | 755e4202e91d46b3bdacf61567a38418 | | | 512 | | 22 | | 17129510a34748499bef0c43280e41d7 | | | 256 | | 22 | | c07f1bc9f3f94ba4b760850e9c526a60 | | | 1440 | | 21 | | 9288c4bf2d0d4d9ca75219b088afcf95 | 2048/1.414 | | 720 | | 21 | | 2445262b6b6b434dbec46c3d6e74c405 | 1024/1.414 | | 360 | | 21 | | abf13646894b43e48d3a76cbe3ecf1a5 | 512/1.414 | | 180 | | 21 | | a7632350213e487c9da43e2d7c7ed4e3 | 256/1.414 | * Training Command | lambda | Command | Note | | ------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=8 --gpus=2 --batch_size 2 --restore=custom_finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=3ff036624baa46e8b87afaf8600937cc --restore_exp_epoch=26 -lr=1e-4` | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=8 --gpus=2 --batch_size 2 --restore=load --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=61c7947422ac44c583d6a07e3f69688b --restore_exp_epoch=3 -lr=1e-4` | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5` | | | 1024 | `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5` | | | 512 | `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5` | | | 256 | `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5` | | | 1440 | `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5 --lmda_divisor=1.414` | | | 720 | `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5 --lmda_divisor=1.414` | | | 360 | `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5 --lmda_divisor=1.414` | | | 180 | `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=68ab669f8761403492276256b00d0344 --restore_exp_epoch=32 -lr=1e-5 --lmda_divisor=1.414` | | * Testing Command * 2048: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=b7c2092f1fc9445d97d24194296d0591 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/8Mnw0s9.png) * 1024: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=755e4202e91d46b3bdacf61567a38418 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/5Lz3cEW.png) * 512: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=17129510a34748499bef0c43280e41d7 --restore_exp_epoch=22 --test --gop=32` * ![](https://i.imgur.com/DMdqO5P.png) * 256: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame --restore_exp_key=c07f1bc9f3f94ba4b760850e9c526a60 --restore_exp_epoch=22 --test --gop=32` * ![](https://i.imgur.com/eEx136s.png) * 1440: `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame_half_lmda --restore_exp_key=9288c4bf2d0d4d9ca75219b088afcf95 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/sYA5pC8.png) * 720: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame_half_lmda --restore_exp_key=2445262b6b6b434dbec46c3d6e74c405 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/xMv1fGl.png) * 360: `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame_half_lmda --restore_exp_key=abf13646894b43e48d3a76cbe3ecf1a5 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/UN5e2K9.png) * 180: `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=frame --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_frame_half_lmda --restore_exp_key=a7632350213e487c9da43e2d7c7ed4e3 --restore_exp_epoch=21 --test --gop=32` * ![](https://i.imgur.com/Mijbb5o.png) 6. accumulated flow * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | -------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | 32 | | c8434960505a4a1badba6d4c38f9e2a5 | | | 2048 | | 25 | | 4c1d48b06a6e4ea7810a3559d14a309e | | | 1024 | | 22/24 | | 08699d77ca364062958d95d77c9d831b | | | 512 | | 23/24 | | 798befa87eab4b8e97cfde2cb091ca23 | | | 256 | | 21/24 | | cfcdf976be7d4121ba25f52feec21251 | | * Training Command | lambda | Command | Note | | | ------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | --- | | 2048-pre | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size 2 --restore=custom_finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet -lr=5e-5` | | | | 2048-pre | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size 1 --restore=load --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=6767a2470a6746e49bead5fdf466d9a0 --restore_exp_epoch=15 -lr=5e-5` | | | | 2048-pre | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size 1 --restore=load --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=3094bb2c9c5046ccaf21e7ba8fbf9364 --restore_exp_epoch=27 -lr=5e-5` | | | | 2048 | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=c8434960505a4a1badba6d4c38f9e2a5 --restore_exp_epoch=32 -lr=2e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=49130c26dddd4317b922e622bf16c7c4 --restore_exp_epoch=21 -lr=2e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=6e82ce39fbb74a59b560750296d6ea67 --restore_exp_epoch=21 -lr=2e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=999a6747649c4cb591fae7d07f4aa895 --restore_exp_epoch=27 -lr=1e-5` | | | | 2048 | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=113e97355a1b43098cff9873daa00721 --restore_exp_epoch=23 -lr=1e-5` | | | | 1024 | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=999a6747649c4cb591fae7d07f4aa895 --restore_exp_epoch=27 -lr=2e-5` | | | | 512 | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=999a6747649c4cb591fae7d07f4aa895 --restore_exp_epoch=27 -lr=2e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=49130c26dddd4317b922e622bf16c7c4 --restore_exp_epoch=21 -lr=2e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=ee362b62e96f406a8f8ade969a9db0e8 --restore_exp_epoch=21 -lr=2e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=98276f74123c4c8a979bb3ee7ad93103 --restore_exp_epoch=27 -lr=1e-5` | | | * Testing Command * 2048-pre: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_pre --restore_exp_key=c8434960505a4a1badba6d4c38f9e2a5 --restore_exp_epoch=32 --test --gop=32` * ![](https://i.imgur.com/QOCQDGe.png) * 2048: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet --restore_exp_key=4c1d48b06a6e4ea7810a3559d14a309e --restore_exp_epoch=25 --test --gop=32` * ![](https://i.imgur.com/mQzKnPi.png) * ![](https://i.imgur.com/VE7JULJ.png) * GOP=12: ![](https://i.imgur.com/WGs9yD8.png) * 1024: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_gop12 --restore_exp_key=08699d77ca364062958d95d77c9d831b --restore_exp_epoch=22 --test --gop=12` * ![](https://i.imgur.com/iCYDew8.png) * GOP=12: ![](https://i.imgur.com/Et6pt4F.png) * 512: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_gop12 --restore_exp_key=798befa87eab4b8e97cfde2cb091ca23 --restore_exp_epoch=23 --test --gop=12` * ![](https://i.imgur.com/9Cg2jOs.png) * GOP=12: ![](https://i.imgur.com/nX7oRNA.png) * 256: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_gop12 --restore_exp_key=cfcdf976be7d4121ba25f52feec21251 --restore_exp_epoch=21 --test --gop=12` * ![](https://i.imgur.com/RzPDW1Q.png) * GOP=12: ![](https://i.imgur.com/J0Ax3fh.png) 7. Input: I-frame + warped previous + accumulated flow * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | -------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | 32/33 | | 4eb1d453d4df43d9ba68d924dd43dc5b | | | 2048 | | 24 | | 82142c27d100429e81fe3df350223c26 | | | 1024 | | 23 | | 24e29aaebe534bbd98b81cae6cdf9457 | | | 512 | | 23 | | 22b335930c914512b413aded38933a7e | | | 256 | | 23 | | 0e99b4fafb4a4f77a35fcba69af02077 | | * Training Command | lambda | Command | Note | | -------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=8 --gpus=2 --batch_size 2 --restore=custom_finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=3ff036624baa46e8b87afaf8600937cc --restore_exp_epoch=26 -lr=1e-4` | | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=8 --gpus=2 --batch_size 2 --restore=load --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=acce751e99e94a18a092d91c6855e1fc --restore_exp_epoch=3 -lr=1e-4` | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=4eb1d453d4df43d9ba68d924dd43dc5b --restore_exp_epoch=32 -lr=1e-5` | | | 2048 | `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=f7b2094729034cfab1a1316170ec4d81 --restore_exp_epoch=23 -lr=1e-5` | | | 1024 | `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=4eb1d453d4df43d9ba68d924dd43dc5b --restore_exp_epoch=32 -lr=1e-5` | | | 512 | `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=4eb1d453d4df43d9ba68d924dd43dc5b --restore_exp_epoch=32 -lr=1e-5` | | | 256 | `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=4eb1d453d4df43d9ba68d924dd43dc5b --restore_exp_epoch=32 -lr=1e-5` | | * Testing Command * 2048: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=82142c27d100429e81fe3df350223c26 --restore_exp_epoch=24 --test --gop=32` * 2048: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=f7b2094729034cfab1a1316170ec4d81 --restore_exp_epoch=23 --test --gop=32` * ![](https://i.imgur.com/k2ms7Ge.png) * 1024: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=24e29aaebe534bbd98b81cae6cdf9457 --restore_exp_epoch=23 --test --gop=32` * ![](https://i.imgur.com/GKSbnv2.png) * 512: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=22b335930c914512b413aded38933a7e --restore_exp_epoch=23 --test --gop=32` * ![](https://i.imgur.com/oz0uw68.png) * 256: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_both --restore_exp_key=0e99b4fafb4a4f77a35fcba69af02077 --restore_exp_epoch=23 --test --gop=32` * ![](https://i.imgur.com/yxb6USL.png) 8. GridNet * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | -------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | 42/50 | | cedf436b73c649ff9d5540f572b52436 | | | 2048 | | 27/33 | | 7e76d5c06211400083658ccc995540c9 | | | 1024 | | 27/33 | | 9b82ada4a34540b184e755e556a8a501 | | | 512 | | 27/33 | | e09036242fb64bfea08a3883dc79cccb | | | 256 | | 27/33 | | 4546085848134809bd24d4200cf3327a | | * Training Command | lambda | Command | Note | | | -------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | --- | | 2048-pre | `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=custom --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=3ff036624baa46e8b87afaf8600937cc --restore_exp_epoch=26 -lr=1e-4` | | | | 2048-pre | `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=32 --gpus=8 --batch_size 2 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=22 -lr=1e-4` | | | | 2048-pre | `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 2 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=30 -lr=1e-4` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=42 -lr=1e-5` | | | | 1024 | `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=42 -lr=1e-5` | | | | 512 | `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=42 -lr=1e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 2 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=42 -lr=1e-5` | | | * Testing Command * 2048-pre: `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS_pre --restore_exp_key=cedf436b73c649ff9d5540f572b52436 --restore_exp_epoch=42 --test --gop=32` * ![](https://i.imgur.com/d2ZbFNZ.png) * 2048: `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS_gop12 --restore_exp_key=7e76d5c06211400083658ccc995540c9 --restore_exp_epoch=27 --test --gop=12` * ![](https://i.imgur.com/QDiN1CG.png) * GOP=12: ![](https://i.imgur.com/NDw02E6.png) * 1024: `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS_gop12 --restore_exp_key=9b82ada4a34540b184e755e556a8a501 --restore_exp_epoch=27 --test --gop=12` * ![](https://i.imgur.com/vzrvzDr.png) * GOP=12: ![](https://i.imgur.com/4QaLg8X.png) * 512: `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS_gop12 --restore_exp_key=e09036242fb64bfea08a3883dc79cccb --restore_exp_epoch=27 --test --gop=12` * ![](https://i.imgur.com/ANJ8cOc.png) * GOP=12: ![](https://i.imgur.com/qffrPXY.png) * 256: `$ python -s condMo_condInter_ANFIC_GridNet_FS.py --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_gridnet_FS_gop12 --restore_exp_key=4546085848134809bd24d4200cf3327a --restore_exp_epoch=27 --test --gop=12` * ![](https://i.imgur.com/lSaSeAB.png) * GOP=12: ![](https://i.imgur.com/fr9bno6.png) 9. (Spatial) accumulated flow * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | -------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | 25 | | 5161e55566644a9cbf9aa5dd27411b4c | | | 2048 | | 39/42 | | 507a537f33f7491c90603f9d298886ad | | | 1024 | | 39/42 | | a5e4c0a912db4e6c84f9efc20c6e31ca | | | 512 | | 38/42 | | 9642c9c533e84a7890428cc29beccb92 | | | 256 | | 39/42 | | d7b7038c7293403083b6f7709c09a8a5 | | * Training Command | lambda | Command | Note | | | -------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | --- | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 2 --restore=custom_finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=7e76d5c06211400083658ccc995540c9 --restore_exp_epoch=27 -lr=1e-4` | | | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=load --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=f202758f0b7243b399e41a4cdd11c30e --restore_exp_epoch=7 -lr=5e-5` | | | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=5161e55566644a9cbf9aa5dd27411b4c --restore_exp_epoch=8 -lr=5e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=5161e55566644a9cbf9aa5dd27411b4c --restore_exp_epoch=25 -lr=2e-5` | | | | 1024 | `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=5161e55566644a9cbf9aa5dd27411b4c --restore_exp_epoch=25 -lr=2e-5` | | | | 512 | `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=5161e55566644a9cbf9aa5dd27411b4c --restore_exp_epoch=25 -lr=2e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=5161e55566644a9cbf9aa5dd27411b4c --restore_exp_epoch=25 -lr=2e-5` | | | * Testing Command * 2048: `$ CUDA_VISIBLE_DEVICES=0 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=507a537f33f7491c90603f9d298886ad --restore_exp_epoch=39 --test --gop=32` * ![](https://i.imgur.com/ywHhI0v.png) * 1024: `$ CUDA_VISIBLE_DEVICES=1 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=a5e4c0a912db4e6c84f9efc20c6e31ca --restore_exp_epoch=39 --test --gop=32` * ![](https://i.imgur.com/ZuvRbBp.png) * 512: `$ CUDA_VISIBLE_DEVICES=2 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=9642c9c533e84a7890428cc29beccb92 --restore_exp_epoch=38 --test --gop=32` * ![](https://i.imgur.com/kDCCl0G.png) * 256: `$ CUDA_VISIBLE_DEVICES=3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=d7b7038c7293403083b6f7709c09a8a5 --restore_exp_epoch=39 --test --gop=32` * ![](https://i.imgur.com/V0cQNKf.png) 10. (Spatial) Input: I-frame + warped previous + accumulated flow * Response by: `Brian` * Table of experiments | lambda | state | epoch | UVG rd | exp_hash | Note | | ---------- | ----- | ----- | ------ | -------------------------------- | ---- | | 2048-pre | | | | 2b565d85be7941d6a19f6ecb6f767550 | | | 2048 | | 26 | | 7e52641038f246d2bd535e8929a848b7 | | | 2048-again | | 27 | | f1e79afd535042068f3cde1981d90efc | | | 1024 | | 26 | | b8ddcf61681f4b689f3656ecfbfb161d | | | 512 | | 28 | | 3182f81abc3e4bfe886a2fdb0f1e82ac | | | 256 | | 28 | | 106d7829420c4c54bd0137bb487c1a03 | | * Training Command | lambda | Command | Note | | | ------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---- | --- | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 2 --restore=custom_finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both --restore_exp_key=7e76d5c06211400083658ccc995540c9 --restore_exp_epoch=27 -lr=1e-4` | | | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=5 -lr=1e-4` | | | | 2048-pre | `$ CUDA_VISIBLE_DEVICES=4,5,6,7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=13 -lr=5e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=4 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=25 -lr=2e-5` | | | | 2048 | `$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=16 --gpus=4 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both --restore_exp_key=7e52641038f246d2bd535e8929a848b7 --restore_exp_epoch=26 -lr=2e-5` | | | | 1024 | `$ CUDA_VISIBLE_DEVICES=5 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=25 -lr=2e-5` | | | | 512 | `$ CUDA_VISIBLE_DEVICES=6 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=25 -lr=2e-5` | | | | 256 | `$ CUDA_VISIBLE_DEVICES=7 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --batch_size 1 --restore=finetune --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=25 -lr=2e-5` | | | * Testing Command * 2048-pre: `$ CUDA_VISIBLE_DEVICES=4 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow_pre --restore_exp_key=2b565d85be7941d6a19f6ecb6f767550 --restore_exp_epoch=25 --test --gop=32` * 2048: `$ CUDA_VISIBLE_DEVICES=4 python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_flow --restore_exp_key=7e52641038f246d2bd535e8929a848b7 --restore_exp_epoch=26 --test --gop=32` * ![](https://i.imgur.com/N0YTPg7.png) * 2048-again: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=2048 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both --restore_exp_key=f1e79afd535042068f3cde1981d90efc --restore_exp_epoch=27 --test --gop=32` * ![](https://i.imgur.com/eI9UqwD.png) * disable adaptive: ![](https://i.imgur.com/1nJmAiR.png) * GOP=12: ![](https://i.imgur.com/nyy8jIu.png) * 1024: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=1024 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both_gop12 --restore_exp_key=b8ddcf61681f4b689f3656ecfbfb161d --restore_exp_epoch=26 --test --gop=12` * ![](https://i.imgur.com/CIMUFot.png) * disable: ![](https://i.imgur.com/lTBzIBd.png) * GOP=12: ![](https://i.imgur.com/wJN5zqz.png) * 512: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=512 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both_gop12 --restore_exp_key=3182f81abc3e4bfe886a2fdb0f1e82ac --restore_exp_epoch=28 --test --gop=12` * ![](https://i.imgur.com/0eML76x.png) * disable: ![](https://i.imgur.com/eLlz0XT.png) * GOP=12: ![](https://i.imgur.com/LPzzY1e.png) * 256: `$ python -s condMo_condInter_ANFIC_Adaptive_GridNet_FS.py --adaptive_input=both --adaptive_type=spatial --MENet=PWC --motion_coder_conf ./config/DVC_motion.yml --cond_motion_coder_conf ./config/CANF_motion_predprior.yml --residual_coder_conf ./config/CANF_inter_coder_estUN.yml --lmda=256 --num_workers=4 --gpus=1 --restore=resume --project_name=CANFVC_Plus --experiment_name=CANFVC_PP_adaptive_gridnet_spatial_both_gop12 --restore_exp_key=106d7829420c4c54bd0137bb487c1a03 --restore_exp_epoch=28 --test --gop=12` * ![](https://i.imgur.com/PPvt7kf.png) * disable: ![](https://i.imgur.com/9JbhvtY.png) * GOP=12: ![](https://i.imgur.com/q963JMN.png)

Syntax	Example	Reference
# Header	Header	基本排版
- Unordered List	Unordered List
1. Ordered List	Ordered List
- [ ] Todo List	Todo List
> Blockquote	Blockquote
Bold font	Bold font
Italics font	Italics font
~~Strikethrough~~	~~Strikethrough~~
19^th^	19^th
H~2~O	H₂O
++Inserted text++	Inserted text
==Marked text==	Marked text
[link text](https:// "title")	Link
![image alt](https:// "title")	Image
`Code`	`Code`	在筆記中貼入程式碼
```javascript var i = 0; ```	`var i = 0;`
:smile:		Emoji list
{%youtube youtube_id %}	Externals
$L^aT_eX$	L^aT_eX
:::info This is a alert area. :::	This is a alert area.