This is not exactly the key stored in the store, but is equivalent. In
particular, it will have a Bouncy Castle version string. The armored
stream reader in PublicKeyStore doesn't give us an easy way to extract
the original ASCII armor.