If you want to go full crazy transit pitch, could you have a LRT eat SL1?
Basically extend the SL tunnel with a cut and cover through the parking lot near SL way and under congress st, into a new tunnel across the harbor, landing near the ferry terminal. Street run (in dedicated bus/train)...