Gaussian Splatting | Spherical Harmonics

Questions
1

Hello,
I would know if is in roadmap the implementation of spherical harmonics to render the GS.

Many thanks!!!

2 Likes
2

Hi @Klm24
Yes, itā€™s in the roadmap! No ETA yet.

3 Likes
3

Sounds good! :slight_smile:

Are there any other implementation regarding Gaussian Splatting?

4

I donā€™t want to spoil (and over promise) too much but there are planned improvements for performance.

1 Like
5

No worries,
Thank you very much!

I canā€™t wait! :grinning:

1 Like
6

Hi @Cedric

here I am again to ask you if there are any updates on Gaussian Splatting themes.

Thanks!

7

Yes, there is! Iā€™ve reduced vram footprint et Iā€™m working on a bigger PR that reduces ply parsing time and will make everything async. Compressed splat are now supported as well.

1 Like
8

Nice!

and regarding the implementation of spherical harmonics, is there any news? :smiley:

Thank you very much

9

It would be good to have but the size difference between compressed GS and SH GS is so huge people prefer smaller packages.

10

Thanks for your answer :slight_smile:
in the case of digital reproduction starting from studio lighting rigs it is interesting to keep the SH, at least for the needs encountered at the moment.

Does this mean that it is no longer on the roadmap? It would be a shame :sob:

11

Everything is on the roadmap :slight_smile:
More options to user is better. Compressed splat is fine when you donā€™t need SH. For SH, maybe this can help : spz/src/cc/load-spz.cc at main Ā· nianticlabs/spz Ā· GitHub

I need to investigate more.

12

Sounds good,
I saw yesterday about the compressed format spz. Interesting :slight_smile:

Iā€™ll ask you update next weeks :wink:

13

Splats format are not technically very complex, if you want to add support for a new format or new features, Iā€™ll be glad to review the PR :slight_smile: It tales a bit of times and schedules are sometimes difficult to organize perfectly :smiley:

1 Like
14

Hi @Cedric did you have any time to investigate on .spz?

Thanks!

15

yes, Iā€™m working on it at the moment.SPZ splat file loader by CedricGuillemet Ā· Pull Request #15849 Ā· BabylonJS/Babylon.js Ā· GitHub

1 Like
16

I am totally into Gaussian Splatting, and producing amazing results after a lot of testing.
Then I noticed, that I am missing the dynamic in the splats.
So even if there are much higher filesizes and loadtimes, The dynamism of the SHs in the Splats are definitely what makes them outstanding.

So would really love SHs in as option.

Thanks working on all the great features!

Best.Werner

2 Likes
17

Just for understanding and what the idea is.
Would we need to create .spz files and load them or does babylon then handle the fileconversion from .ply to .spz?

Just atm (because its new?) i cannot find a export or conversion for .spz files.
Supersplat and postshot, polycam doesnt offer atm (will come as well?)

best.
Werner

18

Hi @Cedric!
I saw that feature was merged and releasedā€¦great news!

I have a question, the SH works also with the format .splat or only with .spz?

Thank you as usual :slight_smile:

19

Only spz for now. it should not be very difficult to add SH support to ply and splat formats.

20

Thank you Cedric :slight_smile:

1 Like