Characterizing The Interstellar And Circumgalactic Medium In Distant Star-Forming Galaxies