AR / VR (Browser inside scene) and interaction with browser content

Is there any example or showcase how can we put browser (IE Firefox Chrome …) inside 3D scene
for VR or AR.
And how looks like interactions possibilities ?

How can we put browsers around us in AR/VR in scene and work with browsers…


This is not possible unfortunately. @trevordev spent a lot of energy trying to convince browser vendors to support that features but with no success

1 Like

DK, thx for info, and T-Dev… thanks for the difficult effort. Very cool of ya. Wanna try another? I need SysEx messages that are embeded in .midi songs… which are read-at/seen-at Windows Media Player (and other players)… routed-to scene.onSysexEventObserver (and maybe .onNoteOn/Off Observer). It’s for making mesh dance-to midi songs… in perfect sync. :slight_smile: Get that done worldwide, and you get $500 from me (in little payments). :slight_smile:

We have HTML video and audio elements, but what about the <midi> element? Why are they biased towards sampled audio ONLY. That’s blatant discrimination against we midi folk. :slight_smile:

Anyway, onward… on-topic.

This VR-browser question/hope is asked-for… quite often.

There is a way to “fake it”, but it is SO SO programming-intensive and prone to problems… that everyone is scared to try it. It works best… if the ONLY webpages that the user is-allowed-to VR-browse… are webpages made BY YOU.

Inside those webpages… you must set MOST/ALL html elements… with inline-styles. ie. style=“position: absolute, left: %xxx, top: %yyy,width: %www, height: %hhh, blah blah blah”.

THEN… you HTTP-request those webpages from within scene code, as needed, and “GUIfy” each HTML element… onto a BabylonJS GUI-active plane (monitor screen)… using the CSS top/left/width/height stuff… as GUI-control positioning info/data. Wow!

Would THAT work for ya?

BJS GUI - made smart-enough to read off-site webpages… and try to copy them. :slight_smile: Intense. Would it even work? Why am I still talking?

Wanna go “heavier”? @Null has been slowly fleshing-out a special version of XML… that can build BJS GUI panels. There is a special type of CSS stylesheet called XSLT, which also includes xPath and xQuery (irrelevant). Essentially, it is regexp and munging power… built-into a stylesheet.

When that stylesheet is LINKed to a Null’s-type XML file… it COULD produce a webpage… by tree-walking that XML… and converting it to various HTML elements (called ‘XSL Translation/Transformation’). SO, when that XML file is browsed from the “real” web, a basic HTML page is delivered… munge-built by the CSS that is linked-to the xml.

Conversely, when the XML file is browsed from Null’s feed-a-gui-with-xml system… a BJS GUI panel is created. By doing this… the HTML page… and the GUI panel… have common ground… the single XML file. Gruesome, huh? I hear ya. Again, that system would only be workable for webpages (xml) that YOU make. Almost all public webpages… couldn’t be used at all.

Alright… I just KILLED this thread… dead-as-a-door-nail. I’m so proud. :smiley:

Uncle Wingy’s Thread Poison! DEEEEEElicious (esp on a Melba-toast cracker). (yay, Melbania)

1 Like

It is very strange decision.
So you claim that we cannot mapped/project (like projector) to some canvas or canvases inside 3d scene.
We can’t put browsers or browsers viewport inside 3D scene?

I just wonder if we can have Augmented Reality with canvases or browsers inside AR scene around us?

This could/should be a great features because someone for example in warehouse with AR glasses could see browser and IT apps in AR like screen around user’s in AR scene…

So AR could achieve sphere screen around user inside warehouse (for example)…


I hope that WebXR will help but yeah so far you cannot render HTML content inside a 3D scene