So I tried the same Babylon file I have hosted (the saved scene) in my project and I had no issues with the environment map but I still got the issue with the rest of the meshes being offset and stuck in the ground.
edit So I updated to Babylon 5.0 and it’s working just fine. I’ll test it a bit more, but if that’s the fix I’m fine with that. I plan on using Babylon 5.0 anyways so this just moves up the timeline of when I’ll add it.