Visual Studio always gets reloaded. Slow production for projects with more assembly definition files

I thought that the more assembly files, the faster the production due to lesser compile time. This is simply not true because the price of more...