---
# System prepended metadata

title: 3D人偶即時操控動作
tags: [3D]

---

## SysMocap
https://github.com/xianfei/SysMocap/tree/main

* 使用VRM模型效果最佳

---
### Tripo3D
https://www.tripo3d.ai/
* 登陸google帳號每個月有600積分可以使用(產生3D模型效果好)

### TripoSR (生成3D模型)
https://github.com/VAST-AI-Research/TripoSR

(4090)
1. 環境位置
``` bash
conda activate triposr
cd F:\GenAI\TripoSR-main
```

2. 執行輸出材質的obj檔案
``` bash
python run.py examples/rabbit.png --output-dir output/ --bake-texture --device cuda:0
```
>若要綁骨架需要先去blender輸出成帶有材質的fbx檔

**安裝時有遇到的問題(皆解決)**
* requirements.txt 內的 torchmcubes 安裝失敗
https://github.com/VAST-AI-Research/TripoSR/issues/48
``` bash
pip install git+https://github.com/tatsy/torchmcubes.git@3aef8afa5f21b113afc4f4ea148baee850cbd472
```

* bake texture透過gpu執行
https://github.com/VAST-AI-Research/TripoSR/issues/100
![螢幕擷取畫面 2024-10-07 144957](https://hackmd.io/_uploads/S1YhVWZk1g.png)

---

### ComfyUI TextTo3Dmodel
https://www.youtube.com/watch?v=jk0K578txTI

### ComfyUI workflow
![workflow](https://hackmd.io/_uploads/rkCavp3CR.png)

~~### 找可使用的3D模型
https://sketchfab.com/3d-models/llama-free-vrm-vtuber-faa5e70318cd4b919e299ee9106b558b~~

### 3D模型自動綁骨架
(可綁定身體基礎姿勢->缺少臉部細緻綁定)
**AccuRIG**
https://www.mobile01.com/topicdetail.php?f=594&t=6678327

**Mixamo**
https://www.mixamo.com/#/
https://www.youtube.com/watch?v=88qbApTkclM

**Animate Anything**
https://www.incgmedia.com/new-release/ai-tool-animate-anything

(臉部綁定)
https://github.com/basefount/animcraft

### FBX轉換VRM
https://www.bilibili.com/read/cv37922392/?jump_opus=1

* SysMocap FBX導入有問題VRM較穩定
原因：https://github.com/xianfei/SysMocap/issues/48

#### 轉換步驟
1. 安裝套件(VRM Add-on for Blender) 
https://github.com/saturday06/VRM-Addon-for-Blender
>在 Blender 中，編輯(Edit)>偏好設定(Preferences)>附加元件(Add-ons)
安裝下載的壓縮文件
2. 在Blender導入FBX檔案
3. 在模型的每個材質的屬性中，啟用VRM MToon材質複選框
![圖片1](https://hackmd.io/_uploads/BJV09VY0A.png)
4. 選擇骨骼分配的節點
![圖片1](https://hackmd.io/_uploads/HJzuiNtC0.png)
![擷取](https://hackmd.io/_uploads/HJL7BHs-kl.png)
5. 導出VRM格式

### openpose與mediapipe的關鍵點
https://blog.csdn.net/BGMcat/article/details/120874335

---

### kalidoface
https://github.com/yeemachine/kalidoface?tab=readme-ov-file

* DEMO
https://lab.kalidoface.com/
https://3d.kalidoface.com/

### talking-head-anime-4-demo
https://github.com/pkhungurn/talking-head-anime-4-demo
https://vocus.cc/article/6478bedefd897800018dbc9a

---

### 圖片生成Q版人物

**Webui**
https://medium.com/@alickwong/transfer-your-image-to-cartoon-style-in-stable-diffusion-d466565ae18a

https://youtu.be/SYNbVaamVSg?si=IG9jljKYDND_qIyg

**ComfyUI**
https://blog.csdn.net/jilibing/article/details/138861868

https://youtu.be/QtTDmiwD-1c?si=OVsl49tWZhqRnuXA

https://openart.ai/workflows/rui400/cute-you/OWYLMYqWMViEeZXLjtqf?msockid=18db6081adfc6cc60eb27499ace76db1

https://openart.ai/workflows/rui400/cute-youcreate-your-cartoon-likeness-using-1-photo/2vwb81MasZTJWU7Zko6L

* 藍采合prompt
>(simple background),cute disney style,full body,(A man wearing aqua blue Hanfu),(double bun:1.2),black hair,(holding a mini flower basket in his one hand:1.3),barefoot

* 織女prompt
>(simple background),cute disney style,full body,(A woman wearing pink Hanfu:1.3),Skirt length to knee,black straight hair,(holdiing the needle in your left hand and a thin red line in her right hand:1.2),a ribbon on her shoulder,barefoot

>monochrome ,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, bad anatomy, bad hands, text, error, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ugly,pregnant,vore,duplicate,morbid,mut ilated,tran nsexual, hermaphrodite,long neck,(mutated hands),(poorly drawn hands),poorly drawn face,mutation,deformed,blurry,bad anatomy,bad proportions,malformed limbs,extra limbs,cloned face,disfigured,gross proportions, (((missing arms))),(((missing legs))), (((extra arms))),(((extra legs))),(((extra fingers))),pubic hair, plump,bad legs,error legs,username,blurry,((bad feets)),breasts,cleavage,(distorted fingers),bad toes,shoes,(missing feets),(extra feets)