Using the create default skybox

You have the opportunity when exporting to exclude meshes:
https://doc.babylonjs.com/extensions/gltfexporter#excluding-geometry

You can then use that to exclude the hdrSkyBox from the exported glb