Is it possible to reduce size of gltf mesh in babylon using SNeRG?

Questions
, ,
1

IIUC NeRF has the promise of real-time rendering of complex assets by taking a few pictures. This is great since more folks can create 3D models (volumetric representation and not mesh representation). For some use cases, it is ok to not have the mesh in babylon and have a data structure which replaces the mesh and displays output of the SNeRG nerf model.

I might be quite a ways off in my understanding of how this tech works, but here are questions I have:

  1. Can babylon js support adding something like SNeRG object to a scene which is essentially baked nerf model where the camera position is passed to the nerf model and the model outputs the light reflected by the object?
  2. Will the sizes of these models be lot less than supercompressed KTX2 both for transport and size on GPU aka memory utilization?

Why do this?

  • Simple model creation - photogrammetry can be a pain and 3D objects are non-trivial to create.
  • Perhaps smaller assets (don’t know for sure yet)
    See link for more details
NERF point cloud visualization
2

The viewer is done with Threejs, so it is possible to do it with Babylon.js.

I think there’s a bit of work, though, as the file is more than 1400 lines.

Regarding the size of the assets, for this chair: SNeRG Viewer

It is loading 16 files of around 3.3Mb each, for a total of 53Mb. I think those are used to build some 3D textures, so are not compressed. It seems quite a bit for this simple asset.

1 Like