Surface plasmons have recently been harnessed to carry out processes such as photovoltaic current generation, redox photochemistry, photocatalysis, and photodetection, all of which are enabled by separating energetic (hot) electrons and holes—processes that, previously, were the domain of semiconductor junctions. Currently, the power conversion efficiencies of systems using plasmon excitation are low. However, the very large electron/hole per photon quantum efficiencies observed for plasmonic devices fan the hope of future improvements through a deeper understanding of the processes involved and through better device engineering, especially of critical interfaces such as those between metallic and semiconducting nanophases (or adsorbed molecules). In this review, we focus on the physics and dynamics governing plasmon-derived hot charge carrier transfer across, and the electronic structure at, metal–semiconductor (molecule) interfaces, where we feel the barriers contributing to low efficiencies reside. We suggest some areas of opportunity that deserve early attention in the still-evolving field of hot carrier transmission from plasmonic nanostructures to neighboring phases.