Glitchy Camera Ellipsoid Collisions - Cannon

I ran into this issue where camera collision is very glitchy with a rotated cube mesh.

How can I smoothen the collision?

Adding @Cedric one of our Physics hero

Let me see if I can improve it.

After tweaking gravity and increasing collisionRetryCount jittering has disappeared.

Ground Examples | Babylon.js Playground (