I think the easiest explanation is that it was extremely rare, the sol system just happened to have a useable deposit somewhere (probably an asteroid or two), and it was used up in the construction of the NX class ships (and perhaps their immediate successors).
Note that nobody is worried that the NX-01 component on the Enterprise might have been mysteriously de-horoniumed. They just knew they weren't going to find a fresh source anywhere.