About the error that there is no tracked Meshes in the hand tracking gesture

Questions
1

I want to start babylonjs webXR and control it with gestures.
There is no trackedMeshes property that should be able to receive joint data when getting hand data with onHandAddedObservable and it cannot be controlled by gestures.

The sample babylonjs docs also gives an error that there is no trackedMeshes.
If anyone knows how to solve it, please let me know.

2

cc @RaananW

1 Like
3

can you share which demo is not working? or share a playground so I can understand the issue?

1 Like
4

thank you for your reply
Below, undefined is displayed in trackedMeshes around line 209.
What I want to achieve is
I want to control an object when I make my hand Rock（Goo？） with a gesture. Is this feasible?

WebXR basic example with teleportation | Babylon.js Playground (babylonjs.com)

5

Or here is my edited sample.
Tracked Meshes around line 87 shows undefined.
Babylon.js Playground (babylonjs.com)

6

Not sure where this demo is in our documentation? trackedMesh was removed during development on the feature. Would be great to know which playground is referenced so that I will be able to remove it.

Regarding getting specific meshes - an XRHand has two functions you can use:

and

getJointMesh will give you the corresponding mesh, if available. You can ask any of those hand parts - XRHandJoint | Babylon.js Documentation. getHandPartMeshes will give you a whole section of the hand (for example the entire index finger)

1 Like
7

thank you for your reply
You can see the documents and samples here.
Playground search page | Babylon.js Documentation (babylonjs.com)

Does that mean that the gesture documentation here is no longer available?

I’m sorry.
Is it possible to give me some samples because I don’t have much idea about XRHand?
We apologize for the inconvenience, but thank you.

8

That’s not a playground created by us, this is someone who created a playground which you found in the playground search (the search and all playgrounds are public).

Not really, as I don’t really know what you are trying to achieve. If you are really looking for hand gestures - I am sorry, this is something you will need to implement yourself as we don’t have gestures tool integrated in the framework (yet). If you are looking for a way to get a certain part of the hand, this is exactly as documented:

xrHandFeature.onHandAddedObservable.add((newHand) => {
        // get the index finger tip
        console.log(newHand.getJointMesh(XRHandJoint.INDEX_FINGER_TIP));
    });
1 Like
9

thank you for your reply.
It means that the babylonjs framework has not yet integrated gesture tools.
I understand.
thank you.

1 Like