## TRELLIS https://github.com/microsoft/TRELLIS * hugging face https://huggingface.co/spaces/JeffreyXiang/TRELLIS * windows安裝 https://github.com/microsoft/TRELLIS/issues/3 https://github.com/sdbds/TRELLIS-for-windows/blob/main/README.md ## Text To Openpose https://github.com/sato-team/Stable-Text-to-Motion-Framework ### PoseCrafts https://github.com/SupeemAFK/PoseCrafts/tree/main?tab=readme-ov-file * DEMO：https://posecrafts.vercel.app/ * https://huggingface.co/spaces/Supeem/PoseCrafts 輸入文字生成openpose(但都會在同張圖片應需各分幀數) ![pose](https://hackmd.io/_uploads/H1cgKq6z1x.png) ### text-to-motion https://github.com/EricGuo5513/text-to-motion ### momask-codes https://github.com/EricGuo5513/momask-codes?tab=readme-ov-file * DEMO：https://huggingface.co/spaces/MeYourHint/MoMask 輸入文字生成BVH檔案 ![擷取](https://hackmd.io/_uploads/ryrZccaGkl.png) * 本地下載 https://blog.csdn.net/weixin_47046422/article/details/144052430 安裝步驟 https://medium.com/@makeinufilm/notes-on-how-to-set-up-the-momask-environment-and-how-to-use-blenderaddon-6563f1abdbfa 1. cd D:\momask-codes 2. conda activate momask 3. 執行python ``` bash python gen_t2m.py --gpu_id 0 --ext exp1 --text_prompt "A person is running on a treadmill." ``` **Blender BVH檔案綁骨架於FBX上** https://www.bilibili.com/video/BV16o4y1o7Qk/?vd_source=1883269ab62e2e4e8d6749388e2881e7 * Download：https://github.com/Rokoko/rokoko-studio-live-blender/releases 來源是骨架(BVH)，目標是模型(FBX) ![擷取](https://hackmd.io/_uploads/S146oibX1g.png) ![擷取](https://hackmd.io/_uploads/BJKxT66zkg.png) --- ## Unity ### 建造場景 https://assetstore.unity.com/zh-CN/search#q=terrain%20tools ### 3D模型綁骨架流程 1. 先將BVH檔案在Blender中匯出成FBX(Selected Objects/骨架Armature/Apply Transform) 2. 上傳FBX模型(角色模型和骨架模型) 3. Rig確認動畫類型是否改為人形Humanoid並且套用 4. 在Assets建立空的動畫器控制器Animator Controller並命名 5. 將骨架模型的Scene(三角形那個)連結到剛創建的Animator上 6. 角色模型Controller選擇動畫器控制器 * Whisper(語音轉文字) ``` bash D:\openai_whisper ``` https://blog.csdn.net/weixin_41573444/article/details/115578584 * BVH轉FBX ``` bash D:\atlan blender --background --python BVH_to_FBX.py ``` ### Unity 語音生成嘴型 #### SALSA https://blog.csdn.net/yigiwoliao/article/details/122389453 #### uLipSync https://github.com/hecomi/uLipSync https://www.youtube.com/watch?v=k5CtTsIKwE4 https://github.com/ReForge-Mode/Live_Lipsync_Examples?tab=readme-ov-file * 臉部特徵反映到模型上 https://www.youtube.com/watch?v=KOFOGIElcGU&t=177s