If you can reproduce that with any other asset it means that this is something we can help with for sure! If it only happens with this one single model, it might be related to the model itself (though I am pretty sure it is not a model-related issue only).
Could you try making a playground with a publicly-available asset?
I agree. Looks more like an issue related to env or reflection coordinates/matrix. May be you have somehow linked these to your mesh or material and next when you move or dispose of the mesh or material, it breaks?
Unfortunately, I could not reproduce it in a playground. But I fixed it using setTimeout().
Just settimeout the required functions with time=0 for easy loading.