Unused assets??

Does having any excess unused materials put a load on Unity performance? These are things like textures, meshes, unused items from asset bundles etc.

I think I read somewhere that every assets unused are not embed in the data folder when you build. As long as there is no reference on a GameObject.