At the very least you could probably match the height of Eva White on Tremont. That might be enough depending.Transitional zoning would make total sense here. The phase 1 above could be your height location (maybe a developer also grabs that parking lot at Herald Street), and then transition down to heights of Dwight Street and beyond.
Who owns Castle Square?