# [Sony] Note
---
* An Analysis of SVD for Deep Rotation Estimation: https://proceedings.neurips.cc/paper/2020/file/fec3392b0dc073244d38eba1feb8e6b7-Paper.pdf
* Style Transfer Dataset: https://github.com/BandaiNamcoResearchInc/Bandai-Namco-Research-Motiondataset
* In-betweening
* https://github.com/jihoonerd/Robust-Motion-In-betweening
* Motion retarting
* https://github.com/DeepMotionEditing/deep-motion-editing
---
Useful tools & docs
* Quaternions in numpy: https://quaternion.readthedocs.io/en/latest/
* Godot Docs: https://docs.godotengine.org/en/stable/community/tutorials.html
* CG: https://www.tutorialspoint.com/computer_graphics/computer_graphics_surfaces.htm
* 3D Inverse Kinematics Demo: https://godotengine.org/asset-library/asset/523
---
Transformer Tutorials
* [Illustrated Guide to Transformers Neural Network: A step by step explanation](https://www.youtube.com/watch?v=4Bdc55j80l8)
* [Transformer Neural Networks - EXPLAINED! (Attention is all you need)](https://www.youtube.com/watch?v=TQQlZhbC5ps)
* [BERT Neural Network - EXPLAINED!](https://www.youtube.com/watch?v=xI0HHN5XKDo)

---
* [GANsformers: Scene Generation with Generative Adversarial Transformers](https://arxiv.org/abs/2103.01209), ICML'21 [[video]](https://www.youtube.com/watch?v=HO-_t0UArd4)[[code]](https://github.com/dorarad/gansformer)
* [Single-Shot Motion Completion with Transformer](https://arxiv.org/abs/2103.00776), ToG 2020, [[code]](https://github.com/FuxiCV/SSMCT) [[dataset]](https://imagine.enpc.fr/~petrovim/actor/)
* [Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformers](https://arxiv.org/abs/2109.07531), ICCVW'21 [[code]](https://github.com/idiap/potr)
* [Action-Conditioned 3D Human Motion Synthesis with Transformer VAE](https://arxiv.org/abs/2104.05670), ICCV'21 [[web]](https://imagine.enpc.fr/~petrovim/actor/) [[code]](https://github.com/Mathux/ACTOR)
* Onthe Continuity of Rotation Representations in Neural Networks, CVPR 2019
* https://arxiv.org/abs/1812.07035
* https://zhouyisjtu.github.io/project_rotation/rotation.html

---
* Pytorch Transformer Layer (https://pytorch.org/docs/stable/nn.html#transformer-layers)
---
### Limitation of LSTM
* Difficult to train
* Very long gradient paths
* LSTM on 100-word do has gradients like 100-layer network
* Transfer learning never really worked
* Needs specific labelled dataset for every task

---
* slow to train --> within a RNN encoder, we pass an input sentence one word after the other. The current words hidden state has dependencies in the previous words hidden state.
#### Other resource
* X Window: https://www.itread01.com/content/1541027182.html
* [Git manager](https://git-scm.com/book/en/v2/Git-Branching-Branches-in-a-Nutshell)
* [Git (Chinese)](https://codertw.com/%E7%A8%8B%E5%BC%8F%E8%AA%9E%E8%A8%80/454533/)

### Blender
* Install Belnder on Ununtu (https://docs.blender.org/manual/en/latest/getting_started/installing/linux.html)
* Blender 2.80 Fundamentals (https://www.youtube.com/watch?v=MF1qEhBSfq4&list=PLa1F2ddGya_-UvuAqHAksYnB0qL9yWDO6&index=1)

### Quantiumn
- Fundamentals
- https://www.mathsisfun.com/algebra/vectors-cross-product.html
- https://www.wired.com/2010/02/how-do-you-represent-vectors/
- Quaternions and spatial rotation
- https://en.wikipedia.org/wiki/Quaternions_and_spatial_rotation
- Quaternion to Rotation Matrix
- http://www.songho.ca/opengl/gl_quaternion.html
- Conversion between quaternions and Euler angles
- https://en.wikipedia.org/wiki/Conversion_between_quaternions_and_Euler_angles
- Visualizing quaternions***
- https://eater.net/quaternions
- Quaternion Multiplication
- https://www.sciencedirect.com/topics/computer-science/quaternion-multiplication
- Unit quaternion (chinese)
- https://zh.wikipedia.org/wiki/%E5%9B%9B%E5%85%83%E6%95%B0%E4%B8%8E%E7%A9%BA%E9%97%B4%E6%97%8B%E8%BD%AC
- Quaternions and 3d rotation, explained interactively
- https://www.youtube.com/watch?v=zjMuIxRvygQ
- Euler (gimbal lock) Explained
- https://www.youtube.com/watch?v=zc8b2Jo7mno
- Visualizing quaternions (4d numbers) with stereographic projection
- https://www.youtube.com/watch?v=d4EgbgTm0Bg
- 2.3 Rotations in 3D
- https://www.youtube.com/watch?v=wg9bI8-Qx2Q
- Gimbal lock
- https://en.wikipedia.org/wiki/Gimbal_lock

Rotation Matrix
- https://www.cs.cmu.edu/~cga/dynopt/readings/Rmetric.pdf

On the Continuity of Rotation Representations in Neural Networks
- https://arxiv.org/pdf/1812.07035.pdf