^^ Indeed. Short answer, no one with a voice lived in the Back Bay, South End, or Fenway at that time.
Long answer, Boston's population was at its zenith during the interwar/Depression era (IIRC, ~825K), with folks jammed into tenements in the West, North, and South Ends. East Boston's population was equivalent to today's numbers, even though my own neighborhood (Orient Heights) was practically a rural area. People had bigger families and the expectation of privacy as we know it today was essentially nonexistent.
The decade after WWII was an era of mobility and repositioning; the first wave of flight to the suburbs kicked off, Italians form the West and North Ends headed to the northern suburbs, many Irish families fled to the South Shore, Jewish merchants left Dorchester and Roxbury for Milton, Newton, and Chestnut Hill. Conversely, African Americans and Latino populations grew through migrations. In my own neighborhood, many families moved north to Saugus, Reading, and Lynnfield to escape the unabated expansion of Logan Airport.
By the time my folks got married in the late 50s, Boston was a hollowed out husk. The Navy was in the process of decamping from the Charlestown Navy Yard, and much of the regional manufacturing (shoes, clothing, paints and solvents) had migrated to southern states with far lower labor costs.
New York had
Robert Moses, and Boston had
Ed Logue. These were the "architects" of scorched earth urban renewal.
The Pru, followed by new towers for State Street, the Boston Company, and New England Merchants National Bank quickly filled out the sky, with the Hancock a final exclamation point on Boston's transition from a port and manufacturing city to a center for insurance and financial services. Our proximity to research universities with global impact fired more recent booms in computing and the life sciences.