Gaussian Splatting Streaming and LoD

Gaussian Splatting with streaming and Level of detail is now available with Babylon!

You can navigate in 100s of million splats without hitting your frame rate.

Feature is experimental and needs your feedback for testing and improvements.

Documentation is available here : Babylon.js docs

It uses PlayCanvas awesome work’s splat-transform to convert your giant Gaussian Splatting into a usable form that can be streamed and displayed in real time.

So, PlayCanvas GS examples are now compatible with Babylon like this 11Million splats scene:

Please test it and report bugs, possible improvements,…

11 Likes

I’m seeing quite a bit of jiggle in either some of the less dense sections or the spherical harmonics its hard to tell. I could take a video for you though if that might.

And maybe its just this specific splat, Ill test it with some others.

1 Like

@Cedric
Thanks so much for this awesome work!

Here is my integration thus far.

3 Likes

nice use case @SirFizX !!!

1 Like

Amazing! Nice work!

1 Like

hmm so its not doing it with WorldLabs splats so much from looking at your video Eric, interesting I wonder if it was just the example splat being weird.

Have you noticed any of the harmonic flickering while you were moving around too and it did not pick it up in the video? It was a noticeable artifact for me.

Have you noticed any of the harmonic flickering while you were moving around too and it did not pick it up in the video? It was a noticeable artifact for me.

^^^

The file shown in the video has SH degree 0 only. I would need to use another file with SH degree 2 or 3 to test for harmonic flickering.

2 Likes

Can you drop into his example one with the skate park and use your eye to pick up on any of the things I’m seeing? Maybe you might have a different outtake on the causality.

1 Like

I will do that.

1 Like

I don’t see any major harmonic flickering.