https://playground.babylonjs.com/#GCRJY6#1
I have a setup that is very close to what I need, I just have to figure out a way to calculate trying to frame the meshes in the frustum with the zoom only and if its too big just to go to the zoom limit.
Its really really close, but my math is off somewhere or I have not established a correct relationship yet.
To do it with a normal camera is EZPZ
https://www.babylonjs-playground.com/#P6JAWE#10
but to do it with a ORTHO im struggling.