Scene to USDZ converter

sebavan · July 2, 2021, 7:49pm

I can not wait for Apple support for WebXR…

samevision · July 2, 2021, 8:06pm

Yes, it does seem that this is the most efficient solution right now. It‘s fast enough to provide the users a nice experience.

How to you convert from gib to usdz? Did you handle that on your own or do you use any utility like GitHub - google/usd_from_gltf?

@sebavan
Can we expect that this will happen in any near future? I have doubts

sebavan · July 2, 2021, 8:08pm

I would have expected WebGL2 WAYYYYYYYYYYYYYYYYYYYY BACKKKKKKKKKKKKK so honestly not holding my breath but it looks like there is activity in webkit comments about it So still hoping

samevision · July 2, 2021, 8:23pm

I can’t understand what’s the purpose of making Safari the new IE. It’s just a pain for development.

mimeeq3d_neal · July 2, 2021, 11:29pm

Hey @samevision

Yes we use that script in part, but it’s part of the workflow. Material compatibility is another challenge.
Alpha’s, closely overlapping meshes etc etc.
Ironically the Apple quick look system in very fluid it adapts nicely to light. Occlusion etc. Android is not so good especially with the plethora of divorces, yet the Material compatibility is way better on GLB than USDZ.

Ultimately both GLB and USDZ are very simple in terms of materials and Babylon is very dynamic and powerful so you cannot directly translate the Babylon shaders to the other formats so you have to either limit or get creative with this.

I use Apple daily. I like Apple but as @sebavan wrote waiting on safari is a not something we felt we could wait on.

Despite all the work we put in I will be so happy to hear that XR is supported on iOS

PS - interesting fact we do all the conversions and run Babylon sever side without a GPU

Have a good weekend all

mimeeq3d_neal · July 2, 2021, 11:35pm

Another trial with a more complex product with HQ textures and materials. This is current taking longer to convert but we have some ideas to reduce the time.

jialiang_li · May 9, 2022, 1:48am

Has there been any recent progress?

Leon · May 9, 2022, 8:56am

No progress with Babylon, but Three.js has built an exporter.

Someone could try to port it to Babylon

github.com

mrdoob/three.js/blob/dev/examples/jsm/exporters/USDZExporter.js

import * as fflate from '../libs/fflate.module.js';

class USDZExporter {

	async parse( scene ) {

		const files = {};
		const modelFileName = 'model.usda';

		// model file should be first in USDZ archive so we init it here
		files[ modelFileName ] = null;

		let output = buildHeader();

		const materials = {};
		const textures = {};

		scene.traverseVisible( ( object ) => {

			if ( object.isMesh ) {

This file has been truncated. show original

As I wrote above there are many things that might not work when converting,
but it would be great not have to rely on a server pipeline to get usdz working.

sebavan · May 9, 2022, 2:00pm

cc @bghgary and @thomlucc FYI

bghgary · May 9, 2022, 11:48pm

I think we would welcome a contribution for this. It seems like a good project to tackle as it is fully isolated.

Deltakosh · May 10, 2022, 2:59pm

Can’t agree more

dnrn · May 24, 2023, 7:24am

I need to be able to export scenes to USDZ too.
If you are extra awesome you include animations.

Any update on this?

sebavan · May 24, 2023, 4:40pm

no plan as of now to support this but I would totally support anybody willing to give it a shot in the community

Pryme8 · May 25, 2023, 2:46am

Hmmm, maybe the monkey king will come to the rescue. That three js script is pretty clear and 600 lines of code is not that bad.

Y’all really that interested in this?

Someone have a link to the file specs?

sebavan · May 25, 2023, 3:07pm

THIS WOULD BE AWESOME @Pryme8

Pryme8 · May 25, 2023, 3:54pm

Ill read into this more with my coffee this morning. This kind of sounds fun ngl.

Pryme8 · May 25, 2023, 10:21pm

github.com

Pryme8/USDZExport/blob/main/src/exporter/exporter.ts

import { VertexBuffer } from "@babylonjs/core/Buffers/buffer";
import { Camera } from "@babylonjs/core/Cameras/camera";
import { Texture } from "@babylonjs/core/Materials/Textures/texture";
import { StandardMaterial } from "@babylonjs/core/Materials/standardMaterial";
import { Matrix, Vector2 } from "@babylonjs/core/Maths/math";
import { AbstractMesh } from "@babylonjs/core/Meshes";
import { Scene } from "@babylonjs/core/scene";
import { strToU8, zipSync } from "fflate";

export class USDZExport {
  static Precision: number = 7;

  static async Parse(scene: Scene, options: any = {}) {
    options = {
      ar: {
        anchoring: { type: "plane" },
        planeAnchoring: { alignment: "horizontal" },
      },
      quickLookCompatible: false,
      ...options,

This file has been truncated. show original

Ok here is the first pass at it.
Few things to note:

NO CLUE IF THIS WORKS YET! this was just a raw conversion of walking through and remapping the logic
I need to convert it to be for PBR Materials instead of StandardMaterial to unlock more of the features.
Animations heh yeah right…
Converted it all to a static pattern.
There are some TODO’s and logic I was still questioning sections about.

Need to do some more testing, and then parse something that was a loaded GLTF instead of the primitives.

But at least its started.

UPDATE Just tested it and it for sure does not work yet. Ill have to figure out more about the file specs to know why.

Pryme8 · May 25, 2023, 10:41pm

Here if the first file generated from it:

and here is the warning report:

This will take more diving in than I thought…

Deltakosh · May 25, 2023, 10:43pm

800$ ? [Open RFP] ( $800 ) - Basic USD/Z export ( Mesh, materials w/ PBR support ) · Issue #2 · BitReelCo/BJS-PR-Bounty-Pool (github.com)

Pryme8 · May 25, 2023, 10:44pm

This is the output from the three.js example… so its probably going to be quite the task.

Topic		Replies	Views
USDZ format support Questions	4	3605	July 16, 2024
USD and materialX Content creation (3dsMax, Maya, Blender, glTF)	3	3692	April 20, 2019
GLB to USDz Exporter - Expectation vs Reality Bugs	8	79	May 15, 2025
Loading Optimization Questions	7	2625	August 6, 2019
Glb export and usdz conversion Questions	9	1975	November 14, 2022

Scene to USDZ converter

Related topics