I logged out the position and target. The target does actually change correctly but the position also changes. I do not know why this happens but you can work around it by also animating-not-animating the position at the same time to stay still: https://playground.babylonjs.com/#IA5B1R#1