Creating avatar from Ready player me

Questions
,
1

is it possible to load avatar from “Ready player me” and add animation to it and make button click animation to it in babylon js ? @Cedric

1 Like
2

Hi @Kiran_Raj_N_V
I know nothing about Ready play me. Is it possible to export .gltf or export to Mixamo?

3

Ready player me has an export to gltf/b function which works well with Babylon. @thomlucc can confirm :wink:

1 Like
4

I allowed myself to move this to the ‘question categories’ for now.
@Kiran_Raj_N_V Once you have the solution and would like to share it as ‘a tutorial’ with the Community, we will both hug you for your contribution and welcome the tutorial in the tutorial section :smiley: Meanwhile, have a great day :sunglasses:

1 Like
5

@MackeyK24 did it for the unity toolkit and it works really well.

1 Like
6

Yes, you can export a ReadPlayerMe avatar to glb and animate it with mixamo. Here is a playground example (it works in both WebGL an WebGPU): https://playground.babylonjs.com/#IKXPN3#33. @mawa - I’ll be happy to do a tutorial and will post it back here this week.

5 Likes
7

hey @thomlucc thank you so much for the playground example ,it has really helped us . I have one more query how can we download glb animation file from mixamo ? i am finding only fbx file download available in mixamo. can you please explain the flow so that we can integrate in our application
and one more doubt should all animations from mixamo is compactable with all models from ready player me ?
thanks in advance

8

Glad that it helped @Kiran_Raj_N_V! You can use Blender to convert the fbx files to glb files (each have one animation) and you combine the animations in the code (using BABYLON.SceneLoader.ImportAnimations like in the example) OR you can also use Blender to load the fbx from Mixamo and then combine all the animations into one glb within Blender (it requires some knowledge of Blender/skeletons/animations - not my specialty!). The step-by-step tutorial I’m planning to do this week should help you. Regarding your last question, it is hard to say if all RPM models and compatible with all Mixamo animations, but I can tell you that all the one I tried worked :slight_smile:

9

@thomlucc thank your for the help. It worked . Is it possible to play and pause the animation that imported using "SceneLoader.ImportAnimations " function ? Thanks in advance

10

Yes, you can play and pause the animations.

  • First thing is to get the Animation Group name using the Inspector:
    image

    image
    image506×889 130 KB

  • Then get the animation using scene.getAnimationGroupByName (animationName);

  • Then you can call the animation.stop() or .start methods

You have an example in this playground: https://playground.babylonjs.com/#AHQEIB#17

11

@thomlucc thanks for the reply. Can you please give an example with this playground https://playground.babylonjs.com/#IKXPN3#33. How to play and pause the animation by using this method

12

Here you go @Kiran_Raj_N_V : https://playground.babylonjs.com/#IKXPN3#56 (thanks @bghgary !)

2 Likes
13

@thomlucc thanks for help. It worked

2 Likes
14

Hey guys… Check out the technology preview for the Babylon Toolkit: Realtime Networked Ready Player Me Avatars

4 Likes
15

This is awesome @MackeyK24! Thanks a lot for sharing

16

For my scenario, I am enabling users to select and create their avatars via Ready Player Me. I can easily download them and put the avatars into scenes. How do I merge the assets programmatically with animations from Mixamo? I would like to add animations like walking to each character.

Here is a playground that demonstrates what I want to do - any suggestion on how to get it to work?

17

Here are two examples of Mixamo animations import for Ready Player avatar.

Basically, you need to upload your (or any other) RPM character to Mixamo first, to have proper bones names and other stuff. When you have your character uploaded to Mixamo, export needed animations with this character. You’ll need Blender to convert FBX; see also common “Mixamo to GLB” tips.

1 Like
18

I tried to adapt the retargeting animationGroup method.

I got it animating but the scale is off and the model is very skeletal.
Please advise on how the code could be fixed.

19

Here is the simplest example with Michael walking - https://playground.babylonjs.com/#JQLEGG#23 :slight_smile:

1 Like
20

That’s perfect - I found that the problem that I was having was with my process. The animation I exported from Mixamo as a FBX, imported into Blender, and exported int FLB was the problem. Can you please give any tips if all of my models will be coming from Ready Player Me and animations from Mixamo?

Also, If I want to do this multiple times with different avatars, each with multiple animations, what approach would I use?
Thanks,
Michael