Support for 2D Gaussian Splatting

Feature requests
1

Since there is a class for 3D Gaussian Splatting, can you provide support for 2D Gaussian Splatting?
2D Gaussian Splatting: It is an approach to model and reconstruct geometrically accurate radiance fields from multi-view images.
(Link: https://surfsplatting.github.io/)

There are not many changes required. In theory, the 3rd dimension of 3D Gaussian Splatting can be set to a very small logarithmic value to make it work for 2D Gaussian Splatting.

I’d be open for further discussion about this, if this catches your attention.

Thank you.

2 Likes
2

cc @Cedric

3

I’ve read the project description a few times but I still don’t get it.
Is it a way to define 2D surfaces more efficiently?
Is it only a way to train the model and data is the same?

4

From what I understood, 2DGS is better at reconstructing surfaces, but is lacking for volumes.

The output is missing the scaling parameter for the 3rd dimension, but I guess it can be replaced by 0 to stay compatible :thinking:

In theory the current implementation in Babylon can already load 2DGS as long as they add this 0 for the 3rd scaling.

1 Like