WebXR based VR controller input

Demos and projects
1

Hi developers!

It is not easy for me to understand WebXR controller input because there is no Playground sample in the page.

WebXR Controllers Support | Babylon.js Documentation (babylonjs.com)

Here is a simple controller input on Playground and youtube.
Babylon.js Playground (babylonjs.com)

My blog post (Sorry in Japanese)
WebXR対応のBabylon.jsでVRコントローラの各種ボタン入力を制御する方法 - CrossRoad (crossroad-tech.com)

I searched for the forum but I could not find similar topics. If you have already known about it, please disregard this post.
I hope these are useful for WebXR developers.

7 Likes
2

Hey, this is awesome!
Want to add that to the documentation page? Will be a great addition

1 Like
3

@RaananW
Thanks for checking it and nice proposal. I’m glad to add it for BJS documentation.
I’ll pull request soon.

1 Like
4

@RaananW

I posted a pull request for the discussion.
Hope this will be helpful.

Added a Playground example for WebXR controllers input by flushpot1125 · Pull Request #238 · BabylonJS/Documentation (github.com)

2 Likes
5

Merged with huge appreciation :slight_smile:

Thanks a lot!!

1 Like
6

Thank-you for sharing @Limes2018 - it’s really useful to see how you integrated controls in your playground :smiley:

1 Like
7

@brianzinn
I’m so glad to hear that! I’ll keep to contribute for WebXR especially :slight_smile:

2 Likes
8

Is there any BabylonJS API controller?
That you just put your hands in front of camera and WebXR recognise your hands as input controller?

Phone, VR and Hands as input?
Any Demo/Playground?

Greetings
Ian

9

Babylon.js supports WebXR’s hand support, so any device that delivers xr hand objects is supported.

1 Like
10

Can Huawei phone with Chrome/Chrome Canary. Browser?
How it works?
Does camera recognise Hands?

Which devices support that?

How can we see if current device support WebXR+hands recognition controller? (any detect/device info report online?)

Greetings?

11

hi Ian,
Limited device support - please see this page for details:
WebXR Selected Features | Babylon.js Documentation (babylonjs.com)

edit: some computer vision is running in browser that can run mobile, but not that advanced from what I know.

2 Likes
12

Thanks for feedback.

So special hardware and browser?

Ordinary Android Phone and Phone’s Camera and Chrome (WebXR) don’t support Hand Tracing?

Just Occulus?
https://webxr-handtracking.vercel.app/

Greetings

13

It might be related with your curious that WebXR based hand tracking works on HoloLens2.

You can see the github repo and pages sample.

drumath2237/babylon-webar-sandbox: WebAR for Chromium-based Edge on Hololens2 with Babylon.js (github.com)

If you have a HoloLens2, change “edge://flags” and access the URL below.
https://drumath2237.github.io/babylon-webar-sandbox

2 Likes