Anime fan but always sick of the bone rotations calculation, so I fine tuned a LLM with MMD poses to control the model with natural language.
The coolest part of this project is it directly outputs MMD specific bone rotation and morph weights, no need to translate from generic pose/motion capture tools like Mediapipe and map to MMD (yes I don’t know how to solve the finger rotations in this previous MMD motion capture project MiKaPo)
Now it is trained with 160 poses, works but not that smart… Welcome high quality labeled poses!
Built on babylon-mmd, many thanks!