When you do this you can set options for the interior and exterior UVs and colors. Top and bottom and sides of the wall always take the exterior UVs and color.
In which case you would need to change interiorColor and exteriorColor options from a single value to an array of values interiorColors and exteriorColors.