The difference is that with scene.removeTexture(temp) it is not removed from memory, and you are able to call it later with scene.addTexture(temp).
For your case I believe it is better just to dispose the temporary texture completely and free some memory since you don’t need temporary texture anymore.
Of course, it may depend on your use case.