Hi all, I’m working on an AR project and I would like to use a screen pinch gesture to scale a single model in the scene. AFAIK pinch gestures are not built-in to the Web API, I’m using the onPointerObservable to get the pointerdown and pointerup events and reusing this code from the MDN docs: [ Pi…

Following up on this - I have enabled passing the projected screen coordinates to screenX and screenY of the pointer event: [XR] multi-pointer screen coordinates projection by RaananW · Pull Request #11495 · BabylonJS/Babylon.js (github.com) If you want to do it manually, you can do this: AR scre…

for more info, these pointer observables are being added on the scene. I’m triyng now to add them to the canvas but nothing is registering so far.

Hi there, after a lot of debugging ive found one problem thats stopping me. To make pinch work, it needs to register 2 “POINTERDOWN” events and compare their locations (by storing in a cache), before a “POINTERUP” event with the same ID is registered. The problem is having is that it doesnt seem p…

@PolygonalSun could you have a look ?

We are internally detecting it for zooming on arc rotate camera so there is definitely a solution I guess :slight_smile:

for further info, turning AR off here means the double-touch works: https://playground.babylonjs.com/#F41V6N#510 so its definitely something with the XR… ominous… :cloud_with_lightning:

XR doesn’t support pointer events. we emulate them for your convenience, but it is not a full pointer event. WebXR uses the select and squeeze events, which are of type XRInputSourceEvent ( WebXR Device API ). These interface are not pointer interfaces (think about the amount of devices XR and XR inp…

Thanks a lot for the response, thats all clear. In terms of there not being screen coordinates, I agree that there are other measurements that could be compared (from the hit test or rays), but the main issue with Babylon’s pointers is that I cant track more than one at a time, as touching the scre…

That’s interesting. So just to understand - are you getting the two pointer events but they have the same ID, or is the 2nd one is not registered at all?

So I’m logging the pointer down, pointer up, and pointer move events, and the id (via pointerInfo.event.pointerId) this is a shot of the console logs to give an idea of what goes one when i first do a single press (line 1), then press again without releasing the first (line 3), then release the fir…

Implementing custom pinch gesture in AR

Questions

sebavan October 15, 2021, 1:30pm 8

no worries @RaananW will be back on Monday and can have a look

Checking for pinch gesture in react native

Topic		Replies	Views
Checking for pinch gesture in react native Questions webxr	13	1815	December 21, 2021
Handle multi touch in AR Questions webxr , ar , pointerevents	4	123	October 1, 2024
Multi Touch Events in WebXR Questions webxr	10	1347	January 6, 2022
Receiving pointer events in AR Questions webxr	3	361	May 5, 2022
Pointer up Event fire twice in WebXR(ar) mode Bugs webxr	15	1075	May 12, 2022

Implementing custom pinch gesture in AR

Related topics