Confirmed that is the case.
Here is what I ended up doing to make it work on chrome -
const peerAudio = document.createElement(“audio”);
peerAudio.srcObject = stream;
const remoteSound = new BABYLON.Sound(“audio”, peerAudio.srcObject, scene, null, { streaming: true,
autoplay: true,
loop: true
});