Why did the Space Shuttle fly upside-down normally

After reading this answer I found out that the space shuttle normally spent its time upside-down. Why is that? I'd guess it has to do with shielding from the sun, but I can't back that up with anything.