This isn’t directly about BabylonJS (although the VideoRecorder might have to support this), but does anyone know the current state of WebXR video capture, particulary with AR? Secondary views were supposed to solve this, but I can’t find up to date information about whether they are already availa…

Secondary views! I am not aware of any browser implementing this (i believe it is still very unstable). Babylon’s architecture don’t support secondary views at the moment, but it should be very possible, creating a camera per view and adding both cameras to the activeCameras array. If you want to c…

In Babylon Native, there is an undocumented global class called NativeCapture. You can instantiate this class and pass in a frame buffer to the constructor, then you can call addCallback to register a callback that is called every frame with the raw rgb data for each rendered frame, then call dispos…

Thank you @ryantrem for the detailed answer. In an AR app, do you know if this captures the camera too?

Yes, it includes the camera if you start with the correct camera. On a phone (e.g. Android/iOS), it is mono rendering (as opposed to head mounted displays that use stereo rendering), so in the case of a phone you’d use WebXRCamera._rigCameras[0] (and just for more complete understanding, in the case…

Hi @ryantrem , do you know if there is a way to get phone camera data without Babylon objects?

Do you mean in Babylon Native, or Babylon React Native? Do you mean on the native side, or on the JavaScript side?

Babylon react native JavaScript side

And what are you trying to do with the data? Do you think you’d be wanting access to the texture (before the scene is rendered on top of it), or are you looking for the rbg pixel data in an ArrayBuffer, or something else?

I need to pass camera data without meshes to the OpenCV (imorted opencv as java module), so any of those will do. I would like to hear about all options so i can test performance between them. What do You think will be optimal for performance in my case?

I think any potential options will depend on a few more details. When you say “imorted opencv as java module”, do you mean you are using some React Native module for OpenCV? If so, can you point me to more info on this? If the image data is going from the React Native JS context to a native context,…

Ok, I agree. I imported opencv following this tutorial How to Use React Native & OpenCV for Image Processing and created my functions for processing images witch i call from JS. So yes, image data is passed from js to native side. From data i create OpenCV Material to process it further.

Current state of secondary views/WebXR recording

Questions

Ajay_Venkat February 14, 2025, 2:54am 30

Hello, I’ve been trying to solve the exact same issue and have made some good progress, posted my updates on here:

Topic		Replies	Views
Babylon React Native snapshot without 3D objects Questions react , webxr	2	590	April 21, 2021
Video recording is possible in react native app Questions documentation	7	520	May 23, 2023
WebXR Immersive Session Screen Recording (Potential Solution / Optimization Help) Questions webxr	3	137	February 16, 2025
Pre-recorded video in WebXR or Babylon Native Questions	9	301	April 5, 2023
Camera in React Native? Questions	5	1013	November 28, 2020

Current state of secondary views/WebXR recording

Related topics