Hi @RaananW and others,
I have a question regarding the render canvas and what happens to it when in WebXR. I am attempting to screen cast a user’s renderCanvas - which I can do via renderCanvas.captureStream(25) to get a stream from the canvas, which I then use in a call via WebRTC - and everything works fine while the user is in non-XR mode but when they enable XR the canvas freezes and does not update.
I have tried to set a specific canvas via outputCanvasOptions.canvasElement and also by replacing the stream when switching to XR with xrHelper.renderTarget.canvasContext.canvas.captureStream(25) but again it is blank (I think this is the same canvas anyway).
Is there a way to capture a stream of what the user is seeing in XR? I suspect it is via a canvas.captureStream() but maybe not. Or maybe a setting in outputCanvasOptions.canvasOptions but I can’t find any details on that as the documentatin doesn’t lead anywhere.
Intersetingly, when I enable XR on a PC using the WebXR emulator plugin everything works as expected, it just doesn’t work when on an actual device.
Any ideas? Need a PG (not sure how I will do this yet as many moving parts)