Prospects for True Muonium Physics with HPS

True muonium, the bound state of a muon-antimuon pair, is one of the smallest QED bound states in Nature and has thus far never been observed. The Heavy Photon Search (HPS) experiment at Jefferson Laboratory, designed to search for new sub-GeV forces, should have sufficient sensitivity to discover and study True Muonium. We will describe how this can be done, and explain future prospects for True Muonium physics using the nominal HPS layout and potential upgrades.