I found a way to make it work:
Just stopping the animation and setting the speed ratio was not working (at least for me), the animation was restarting from frame 0 and not from the current frame. I needed to get the current frame and play the animation from this frame to the from or to frame value, depending on the direction of the animation.
@Cie You can check animation.isStarted to know if the animation is still playing or not to disable mouse clicks.