## SysMocap https://github.com/xianfei/SysMocap/tree/main * 使用VRM模型效果最佳 --- ### Tripo3D https://www.tripo3d.ai/ * 登陸google帳號每個月有600積分可以使用(產生3D模型效果好) ### TripoSR (生成3D模型) https://github.com/VAST-AI-Research/TripoSR (4090) 1. 環境位置 ``` bash conda activate triposr cd F:\GenAI\TripoSR-main ``` 2. 執行輸出材質的obj檔案 ``` bash python run.py examples/rabbit.png --output-dir output/ --bake-texture --device cuda:0 ``` >若要綁骨架需要先去blender輸出成帶有材質的fbx檔 **安裝時有遇到的問題(皆解決)** * requirements.txt 內的 torchmcubes 安裝失敗 https://github.com/VAST-AI-Research/TripoSR/issues/48 ``` bash pip install git+https://github.com/tatsy/torchmcubes.git@3aef8afa5f21b113afc4f4ea148baee850cbd472 ``` * bake texture透過gpu執行 https://github.com/VAST-AI-Research/TripoSR/issues/100 ![螢幕擷取畫面 2024-10-07 144957](https://hackmd.io/_uploads/S1YhVWZk1g.png) --- ### ComfyUI TextTo3Dmodel https://www.youtube.com/watch?v=jk0K578txTI ### ComfyUI workflow ![workflow](https://hackmd.io/_uploads/rkCavp3CR.png) ~~### 找可使用的3D模型 https://sketchfab.com/3d-models/llama-free-vrm-vtuber-faa5e70318cd4b919e299ee9106b558b~~ ### 3D模型自動綁骨架 (可綁定身體基礎姿勢->缺少臉部細緻綁定) **AccuRIG** https://www.mobile01.com/topicdetail.php?f=594&t=6678327 **Mixamo** https://www.mixamo.com/#/ https://www.youtube.com/watch?v=88qbApTkclM **Animate Anything** https://www.incgmedia.com/new-release/ai-tool-animate-anything (臉部綁定) https://github.com/basefount/animcraft ### FBX轉換VRM https://www.bilibili.com/read/cv37922392/?jump_opus=1 * SysMocap FBX導入有問題VRM較穩定 原因：https://github.com/xianfei/SysMocap/issues/48 #### 轉換步驟 1. 安裝套件(VRM Add-on for Blender) https://github.com/saturday06/VRM-Addon-for-Blender >在 Blender 中，編輯(Edit)>偏好設定(Preferences)>附加元件(Add-ons) 安裝下載的壓縮文件 2. 在Blender導入FBX檔案 3. 在模型的每個材質的屬性中，啟用VRM MToon材質複選框 ![圖片1](https://hackmd.io/_uploads/BJV09VY0A.png) 4. 選擇骨骼分配的節點 ![圖片1](https://hackmd.io/_uploads/HJzuiNtC0.png) ![擷取](https://hackmd.io/_uploads/HJL7BHs-kl.png) 5. 導出VRM格式 ### openpose與mediapipe的關鍵點 https://blog.csdn.net/BGMcat/article/details/120874335 --- ### kalidoface https://github.com/yeemachine/kalidoface?tab=readme-ov-file * DEMO https://lab.kalidoface.com/ https://3d.kalidoface.com/ ### talking-head-anime-4-demo https://github.com/pkhungurn/talking-head-anime-4-demo https://vocus.cc/article/6478bedefd897800018dbc9a --- ### 圖片生成Q版人物 **Webui** https://medium.com/@alickwong/transfer-your-image-to-cartoon-style-in-stable-diffusion-d466565ae18a https://youtu.be/SYNbVaamVSg?si=IG9jljKYDND_qIyg **ComfyUI** https://blog.csdn.net/jilibing/article/details/138861868 https://youtu.be/QtTDmiwD-1c?si=OVsl49tWZhqRnuXA https://openart.ai/workflows/rui400/cute-you/OWYLMYqWMViEeZXLjtqf?msockid=18db6081adfc6cc60eb27499ace76db1 https://openart.ai/workflows/rui400/cute-youcreate-your-cartoon-likeness-using-1-photo/2vwb81MasZTJWU7Zko6L * 藍采合prompt >(simple background),cute disney style,full body,(A man wearing aqua blue Hanfu),(double bun:1.2),black hair,(holding a mini flower basket in his one hand:1.3),barefoot * 織女prompt >(simple background),cute disney style,full body,(A woman wearing pink Hanfu:1.3),Skirt length to knee,black straight hair,(holdiing the needle in your left hand and a thin red line in her right hand:1.2),a ribbon on her shoulder,barefoot >monochrome ,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, bad anatomy, bad hands, text, error, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ugly,pregnant,vore,duplicate,morbid,mut ilated,tran nsexual, hermaphrodite,long neck,(mutated hands),(poorly drawn hands),poorly drawn face,mutation,deformed,blurry,bad anatomy,bad proportions,malformed limbs,extra limbs,cloned face,disfigured,gross proportions, (((missing arms))),(((missing legs))), (((extra arms))),(((extra legs))),(((extra fingers))),pubic hair, plump,bad legs,error legs,username,blurry,((bad feets)),breasts,cleavage,(distorted fingers),bad toes,shoes,(missing feets),(extra feets)