How to use babylon.js to load pmd, pmx, vmd and other formats

[Spencer17x]

How to write an mmd loader to serve babylon.js, similar to mmd loader in threejs, which supports loading model formats such as pmd and pmx, and supports loading vmd animation format

[qq2315137135]

I’m working on it.

I actually started after I saw your post.

2315137135/babylonjs-mmd-loader (github.com)

I made a start, and now he can load static meshes. However, things like materials, animations, bones, skins, mapping, and a lot more are still to be done.

[carolhmj]

WOOOO glad to see you working on it! I’ve been watching so many MMD videos recently

There’s a VRML loader project too! virtual-cast/babylon-vrm-loader: glTF VRM extension Loader for babylon.js (github.com)

[qq2315137135]

material

[Spencer17x]

Static I also solved, but animation and other do not know how to do

[carolhmj]

yayyayay!

[qq2315137135]

I’m working on bones and skins now

[qq2315137135]

Skeleton and skin!
Some skeletal problems tormented me for quite some time, but now they are solved.

[qq2315137135]

Update! Bone animation.
Since ik has not been implemented yet, the feet look a bit strange.
Next, deal with facial expressions.

[Spencer17x]

There may be a small problem. I submitted pr to fix it. Please check if there is any problem

[qq2315137135]

Facial expressions and animations.

I will release an npm package after processing the ik.

[carolhmj]

WOOOHOOOO! I hope to play with it

[Spencer17x]

Cool!!!

[qq2315137135]

I have implemented the basic version of ccd IK, which I will soon apply to the mmd model

[Spencer17x]

I’m looking forward to it!

[qq2315137135]

pmd IK Complete.
pmx seems to need additional processing . Looks like I fell down a rabbit hole

[carolhmj]

You can do it!!!

[qq2315137135]

I’m sorry, but the animation in the pmx section is a bit out of my league.

I can’t understand what “grant bone” is. And how it relates to ik.
I’ve searched a lot, but there’s no explanation.

Maybe when I become an actual MikuMikuDance master, I’ll come back.

I’ll take a break and actually try out how to use mmd.
In case anyone wants to use the existing code, the repository is here babylonjs-mmd-loader

[qq2315137135]

I will take some time off.
And for those who want to use the existing implementation, here are

playground example:

playground: https://playground.babylonjs.com#3VECRA#4

npm: @wenxin123/babylonjs-mmd-loader - npm (npmjs.com)

umd CDN: https://www.unpkg.com/@wenxin123/babylonjs-mmd-loader@0.1.4/dist/lib/index.umd.js

[carolhmj]

Thanks for sharing the implementation! You did a lot of cool stuff already

And I wish you luck in the journey to become MMD master