How to use babylon.js to load pmd, pmx, vmd and other formats

Questions
1

How to write an mmd loader to serve babylon.js, similar to mmd loader in threejs, which supports loading model formats such as pmd and pmx, and supports loading vmd animation format

2

Iā€™m working on it.

I actually started after I saw your post.

2315137135/babylonjs-mmd-loader (github.com)

I made a start, and now he can load static meshes. However, things like materials, animations, bones, skins, mapping, and a lot more are still to be done.

image
image906Ɨ632 85.5 KB

6 Likes
3

WOOOO glad to see you working on it! :star_struck: Iā€™ve been watching so many MMD videos recently :rofl:

MMD Hatsune Miku Punch Broken Glass Wallpaper by topex-psy on DeviantArt

Thereā€™s a VRML loader project too! virtual-cast/babylon-vrm-loader: glTF VRM extension Loader for babylon.js (github.com)

4

material

64e08766c2ef8293aee412b732876fe9a75d9118

image
image949Ɨ1010 172 KB

1 Like
5

Static I also solved, but animation and other do not know how to do

6

yayyayay!

miku dance (gif) | Miku/vocaloid | Pinterest | Dancing, Vocaloid and ...

7

Iā€™m working on bones and skins now

image

2 Likes
8

Skeleton and skin!
Some skeletal problems tormented me for quite some time, but now they are solved.

msedge_YaJiHJ8vPz

1 Like
9

Update! Bone animation.
Since ik has not been implemented yet, the feet look a bit strange.
Next, deal with facial expressions.

msedge_N3kcBMaynL

2 Likes
10

There may be a small problem. I submitted pr to fix it. Please check if there is any problem

12

Facial expressions and animations.

I will release an npm package after processing the ik.

2 Likes
13

WOOOHOOOO! I hope to play with it :smile:

Hatsune Miku Sway GIF - HatsuneMiku Sway Dance - Discover & Share GIFs

1 Like
14

Cool!!!

15

I have implemented the basic version of ccd IK, which I will soon apply to the mmd model

1 Like
16

Iā€™m looking forward to it!

17

image
image427Ɨ585 92.7 KB

pmd IK Complete.
pmx seems to need additional processing . Looks like I fell down a rabbit hole

KX6%{Z3}L~US(U$D9AWR8L5

18

You can do it!!!
Ganbatte Butterfly Estate GIF - Ganbatte ButterflyEstate YouCanDoIt ...

1 Like
19

Iā€™m sorry, but the animation in the pmx section is a bit out of my league.

I canā€™t understand what ā€œgrant boneā€ is. And how it relates to ik.
Iā€™ve searched a lot, but thereā€™s no explanation.

Maybe when I become an actual MikuMikuDance master, Iā€™ll come back.
DS@XHNWYLL)OQK6~FWAIZW6

Iā€™ll take a break and actually try out how to use mmd.
In case anyone wants to use the existing code, the repository is here babylonjs-mmd-loader

2 Likes
20

I will take some time off.
And for those who want to use the existing implementation, here are

playground example:

playground: https://playground.babylonjs.com#3VECRA#4

npm: @wenxin123/babylonjs-mmd-loader - npm (npmjs.com)

umd CDN: https://www.unpkg.com/@wenxin123/babylonjs-mmd-loader@0.1.4/dist/lib/index.umd.js

2 Likes
21

Thanks for sharing the implementation! You did a lot of cool stuff already :smiley:

And I wish you luck in the journey to become MMD master :saluting_face:

1 Like