Augmented reality

Questions
21

i added some modification and i obtained this exemple : https://www.babylonjs-playground.com/#BCU1XR#795

With this exemple i want to add AR using WebXR like you said :slight_smile:

22

What happened when you tried adding XR like I mentioned here - Augmented reality ?

23

bug-AR
bug-AR1850Ɨ1052 131 KB

24

xr should be defined. is there an error when you try initializing it?
notice the ā€œawaitā€ keyword (which you probably removed?). which means - wait until the promise returns.
Also, what browser are you using? How do you simulate AR in your desktop browser?

25

itā€™s okay for Xr and await function.
you can check in playground exemple : https://www.babylonjs-playground.com/#BCU1XR#796

26

What happens when you open this?
https://playground.babylonjs.com/#8Y780Y#66

27

it work in my phone (android 10) :slight_smile:

28

This playground doesnt work because the syntax is incorrect.

29

yes i know , i just showed u the result when i added :

var xr = scene.createDefaultXRExperienceAsync({/* options, if you want */})
// default is vr, change to ar
xr.enterExitUI["_buttons"][0].sessionMode = ā€œimmersive-arā€;

30

here:
https://www.babylonjs-playground.com/#BCU1XR#797

1 Like
31

thanks a lot :)))
can i know what are you changing !!!

thanks another time :)))

1 Like
32

added async to the main function, it is required for await calls

1 Like
33

thannnks a lot @RaananW :)))

35

@RaananW Hi! is there some kind of documentation for what it is at the moment possible or not possible with AR using babylon? In short is it possioble to achieve something like this?

https://modelviewer.dev/examples/augmented-reality.html

place an object on the floor, change scale and position? what about make the AR 3D Objects react to taps?

thanks!

36

Good question! :slight_smile:

I am actually now writing the global WebXR documentation, it will be available by the end of the week. including AR support and what is / isnā€™t available.

To answer your question - hit test is implemented, plane detection is implemented, but they are going to be changed very soon, as the APIs in browsers changed as well.

1 Like
37

A glimpse at the API can be found here -

https://playground.babylonjs.com/#KVZI50#55

This has plane detection and hit-test enabled, but will only work on chrome 79. Plane detection on the latest canary doesnt work after they removed a needed function on the XRSession object. I need to check exactly why. Seems like a permissions issue.

38

cool news! I am going to take a look. Is it planed to support ios devices somehow? (chrome on ios doesnt show me the XR flags) The model viewer from google supposedly gives you the option to load .usdz and it should work with ios(havent test it yet tough)

39

It is (like all browsers on ios) a wrapper on top of Webkit :frowning: So it will work on iOS the day Apple will consider adding support for it on WebKit.

1 Like
40

Hey guys,

i bring up the topic again because i am looking to enable stereo rendering for an augmented reality application to use a head mounted device. Does this work at all with createDefaultXRExperienceAsync() at the moment?

41

Yes it does!

:slight_smile:

Using the immersive-ar XR mode. I apologize again for not finishing the documentation last week. Let me refer you to this - you can read my answer there (and see the playground example including the way to enable the background and enter immersive-ar mode: