I used to live on Woodward St. Essentially across the street from that site. Then it was a scrap metal yard if I remember correctly. Aces High Pub was around there as well.
Forgot to add that was in the early 90's.
There is something like over 5,000 wood pilings in the Back Bay. Many are under the church in Copley Square. It took over 40 years to fill in the Back Bay. Fill was from the three hills that were once present in early Boston and Needham.