White textures when objects are really far away on android?

My scene is REALLY big and I don’t think there’s a way around that. When objects are really far away their textures are replaced by solid white. When they reach a certain distance they become the normal textures again. I’ve tried this with multiple texture sizes and the distance where they become textured stays the same. The issue doesn’t happen when testing it on PC.
How can I get around this? Or at the very least, have a different color instead of white?

This started happening to me in a Google VR project. I switched the shaders for the models to GoogleVR/Unlit/Texture Overlay and it fixed the issue for me. (Unity 5.4.1)