I was going to ask a question about how to do this but ended up figuring it out while I was formulating the question.
The scale controls for the boundingboxgizmo keep the face opposite the control being used in a fixed position so scaling and position need to be adjusted at the same time. It took me a while to figure out how to make this work for rotated meshes.