I found a solution but I do like if I was bob the handyman So I did that :
vrHelper.onEnteringVR.add( () => {
scene.getEngine().isPointerLock = true;
});
I active the pointerLock when I am entering on VR and if you want to disable when you are out of VR, you can do that :
vrHelper.onExitingVR.add( ()=> {
scene.getEngine().isPointerLock = false;
})