Residents shouldn't live in a city if they don't like noise. There are plenty of far-flung suburbs that are quiet at night. I used to live within earshot of Broadview Station and the screeching from the streetcars was pretty constant, as was the constant noise from the Danforth, but I understood that that was a trade-off of living in a central location.
Of course TTC can make efforts to mitigate noise from its operations for nearby residents and users, but I don't have a very large violin for people who live in central areas who don't like noise from daily operational things like subways or emergency vehicles. I can understand construction noise to a degree.
To Monarch's point above, Chinese cities are like the final boss of overstimulation, and if a billion people can live being surrounded by city noise at all times I think the folks in the nice houses near Castle Frank can make do, too.