Subsidized housing means that the costs are not fully covered by the renters, and instead have to come from somewhere else. In a complex like this, if I am paying full price and the next person has essentially the same unit that they're paying half the price for, that's the principle thing right there. If I have to pay market rate, I'd rather be around other people who are also paying market rate. In my experience people who aren't paying full price don't have as much skin in the game and tend to treat the properties accordingly. I'd rather live in a neighborhood where everybody has skin in the game and the incentive to keep the neighborhood clean, safe, etc.
If you paid $1000 for a nice piece of china (not the country) you'd keep it somewhere that would mitigate potential accidents. If somebody just gave it to you, you might leave it in the middle of the table, have it break within a few months, and it wouldn't matter to you because it was "free," not something you invested $1000 in. However, in that case too, SOMEBODY invested that $1000 on your behalf.
If your material possessions are the not the product of your own blood, sweat, and tears to purchase them, you will never appreciate their worth to the same level as somebody who had to work for everything they have. If I had to work for it (newsflash I did) I want to be around like-minded neighbors, not those who feel entitled to receive a higher value at a lower price.