Havok physics behaves unnatural when moving a box with a constraint

I had the suspicion that little jumps in the mouse movements could be an issue and I tried to mitigate this by lerping the position, but basically same result: https://playground.babylonjs.com/#P5XN43#9