# Few-shot GAN - Talking Head ET082_15_MoveImg Team member: 42, 46, 48, 22 <!-- Put the link to this slide here so people can follow --> slide: https://hackmd.io/@purelyvivid/BJVcVtCYB --- ## 組員 * [分組結果表](https://docs.google.com/spreadsheets/d/1IzSDO4QWRdvNpwGsMaUcpO0tPIwgDZykWXjYurXxgYE/edit#gid=0) **ET082_15_MoveImg** 讓圖片動起來 - ET082042 (黃慧瑜) - ET082022 (商紓瑋) - ET082046 (葉耀智) - ET082048 (廖欽健) --- ## Paper ### Few-Shot Adversarial Learning of Realistic Neural Talking Head Models - https://arxiv.org/pdf/1905.08233.pdf  ---- {%youtube p1b5aiTrGzY %} --- ## Gitlab - Gitlab(放程式碼的地方): https://gitlab.aiacademy.tw/ET082/ET082_15_MoveImg - [Git 教學投影片](https://docs.google.com/presentation/d/1LMolw81roV5VPMf22z1r5SF_PfpyLpBa2gCQT12OVW8/edit#slide=id.g5c035ba6da_2_16) - [Git SSH]( https://gitlab.aiacademy.tw/ET082/ET082_15_MoveImg/blob/master/git.md) --- ## reference code 1. https://github.com/grey-eye/talking-heads 2. https://github.com/vincent-thevenin/Realistic-Neural-Talking-Head-Models 3. https://github.com/shoutOutYangJie/Few-Shot-Adversarial-Learning-for-face-swap ---- ## Progress * Tensorflow 2.0 prototype is ready(2019/10/16), but not train well yet * Training, improve model, and run other sources for comparison. ---- ## Version torch版本使用 ```python= !pip install --user torch=='1.2.0' !pip install --user torchvision=='0.4.0' ``` ---- ## 讀取npy檔 ```python import numpy as np import matplotlib.pyplot as plt r = np.load("Nancy_Cartwright_F2KB8z7-T-w_8.npy",allow_pickle=True) print('npy檔照片張數',r.item()['frames'].shape[0]) print('第一張照片(shape)',r.item()['frames'][0].shape) print('第一張照片_landmark(shape)',r.item()['landmarks'][0].shape) for i in range(r.item()['frames'].shape[0]): print(r.item()['frames'][i].shape) plt.figure(figsize=(10,100)) plt.subplot(r.item()['frames'].shape[0],2,(i*2)+1) plt.imshow(r.item()['frames'][i]) plt.subplot(r.item()['frames'].shape[0],2,(i*2)+2) plt.imshow(r.item()['landmarks'][i]) plt.show() ``` --- * [南部二期專題分組結果及注意事項-投影片連結 ](https://docs.google.com/presentation/d/1JI8l12qU1RWtoNBBuAH-pErbioVK42Mt1lIqztyv3zg/edit#slide=id.p5 ) ----  ---- ### Meeting 1 - 11/01 10:30-11:00  ---- ### Meeting 2 - 11/15 10:30-11:00  ---- ### Final Report - 11/27 14:30-15:00  繳交 source code README_example https://gitlab.aiacademy.tw/snippets/5 報告範例 https://docs.google.com/presentation/d/1c9OfTFmicZL_-UhpxOT9Fs7tINJWvYi_YyfOGfVApYg/edit#slide=id.g469fda8ea2_0_2588