# Gaussian Splatting | Spherical Harmonics

**URL:** <https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004>\
**Category:** Questions\
**Created:** [August 25, 2024, 9:20pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004 "2024-08-25T21:20:30Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [August 25, 2024, 9:20pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/1 "2024-08-25T21:20:30Z")

</div>

Hello,  
I would know if is in roadmap the implementation of spherical harmonics to render the GS.

Many thanks!!!

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [August 26, 2024, 8:07am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/2 "2024-08-26T08:07:50Z")

</div>

Hi @Klm24  
Yes, it’s in the roadmap! No ETA yet.

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [August 27, 2024, 4:19am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/3 "2024-08-27T04:19:13Z")

</div>

Sounds good! 🙂

Are there any other implementation regarding Gaussian Splatting?

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [August 27, 2024, 7:31am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/4 "2024-08-27T07:31:38Z")

</div>

I don’t want to spoil (and over promise) too much but there are planned improvements for performance.

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [August 27, 2024, 8:11am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/5 "2024-08-27T08:11:27Z")

</div>

No worries,  
Thank you very much!

I can’t wait! 😀

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [October 24, 2024, 10:55pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/6 "2024-10-24T22:55:11Z")

</div>

Hi @Cedric

here I am again to ask you if there are any updates on Gaussian Splatting themes.

Thanks!

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [October 25, 2024, 7:36am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/7 "2024-10-25T07:36:15Z")

</div>

Yes, there is! I’ve reduced vram footprint et I’m working on a bigger PR that reduces ply parsing time and will make everything async. Compressed splat are now supported as well.

> <https://github.com/BabylonJS/Babylon.js/pull/15734>
>
> \- replace string comparison with enum (60% faster)
> \- added async parsing method… with 'coroutine' like mecanism
> \- update SPLAT loader accordingly
> \- async \`updateData\`

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [October 25, 2024, 1:57pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/8 "2024-10-25T13:57:09Z")

</div>

Nice!

and regarding the implementation of spherical harmonics, is there any news? 😃

Thank you very much

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [October 25, 2024, 2:06pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/9 "2024-10-25T14:06:50Z")

</div>

It would be good to have but the size difference between compressed GS and SH GS is so huge people prefer smaller packages.

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [October 30, 2024, 9:10am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/10 "2024-10-30T09:10:59Z")

</div>

Thanks for your answer 🙂  
in the case of digital reproduction starting from studio lighting rigs it is interesting to keep the SH, at least for the needs encountered at the moment.

Does this mean that it is no longer on the roadmap? It would be a shame 😭

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [October 30, 2024, 9:38am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/11 "2024-10-30T09:38:05Z")

</div>

Everything is on the roadmap 🙂  
More options to user is better. Compressed splat is fine when you don’t need SH. For SH, maybe this can help : [spz/src/cc/load-spz.cc at main · nianticlabs/spz · GitHub](https://github.com/nianticlabs/spz/blob/main/src/cc/load-spz.cc)

I need to investigate more.

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [October 30, 2024, 10:47am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/12 "2024-10-30T10:47:01Z")

</div>

Sounds good,  
I saw yesterday about the compressed format spz. Interesting 🙂

I’ll ask you update next weeks 😉

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [October 30, 2024, 10:50am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/13 "2024-10-30T10:50:43Z")

</div>

Splats format are not technically very complex, if you want to add support for a new format or new features, I’ll be glad to review the PR 🙂 It tales a bit of times and schedules are sometimes difficult to organize perfectly 😃

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [November 21, 2024, 4:57pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/14 "2024-11-21T16:57:24Z")

</div>

> [@Cedric](#):
>
> Everything is on the roadmap 🙂  
> More options to user is better. Compressed splat is fine when you don’t need SH. For SH, maybe this can help : [spz/src/cc/load-spz.cc at main · nianticlabs/spz · GitHub](https://github.com/nianticlabs/spz/blob/main/src/cc/load-spz.cc)
> 
> I need to investigate more.

Hi @Cedric did you have any time to investigate on .spz?

Thanks!

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [November 21, 2024, 5:24pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/15 "2024-11-21T17:24:47Z")

</div>

yes, I’m working on it at the moment.[SPZ splat file loader by CedricGuillemet · Pull Request #15849 · BabylonJS/Babylon.js · GitHub](https://github.com/BabylonJS/Babylon.js/pull/15849)

---

<div class="post-metadata">

**Author:** ![yamaciller](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/yamaciller/32/21810_2.png) [@yamaciller](https://forum.babylonjs.com/u/yamaciller)\
**Post date:** [November 27, 2024, 2:24pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/16 "2024-11-27T14:24:05Z")

</div>

I am totally into Gaussian Splatting, and producing amazing results after a lot of testing.  
Then I noticed, that I am missing the dynamic in the splats.  
So even if there are much higher filesizes and loadtimes, The dynamism of the SHs in the Splats are definitely what makes them outstanding.

So would really love SHs in as option.

Thanks working on all the great features!

Best.Werner

---

<div class="post-metadata">

**Author:** ![yamaciller](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/yamaciller/32/21810_2.png) [@yamaciller](https://forum.babylonjs.com/u/yamaciller)\
**Post date:** [November 28, 2024, 9:32am UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/17 "2024-11-28T09:32:08Z")

</div>

Just for understanding and what the idea is.  
Would we need to create .spz files and load them or does babylon then handle the fileconversion from .ply to .spz?

Just atm (because its new?) i cannot find a export or conversion for .spz files.  
Supersplat and postshot, polycam doesnt offer atm (will come as well?)

best.  
Werner

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [December 3, 2024, 3:05pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/18 "2024-12-03T15:05:21Z")

</div>

Hi @Cedric!  
I saw that feature was merged and released…great news!

I have a question, the SH works also with the format .splat or only with .spz?

Thank you as usual 🙂

---

<div class="post-metadata">

**Author:** ![Cedric](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/cedric/32/2742_2.png) [@Cedric](https://forum.babylonjs.com/u/Cedric)\
**Post date:** [December 3, 2024, 3:40pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/19 "2024-12-03T15:40:04Z")

</div>

Only spz for now. it should not be very difficult to add SH support to ply and splat formats.

---

<div class="post-metadata">

**Author:** ![Klm24](https://avatars.discourse-cdn.com/v4/letter/k/2bfe46/32.png) [@Klm24](https://forum.babylonjs.com/u/Klm24)\
**Post date:** [December 3, 2024, 3:49pm UTC](https://forum.babylonjs.com/t/gaussian-splatting-spherical-harmonics/53004/20 "2024-12-03T15:49:01Z")

</div>

Thank you Cedric 🙂
