The ledgers that record transactions is hosted on *many* servers simultaneously, and verified by even more computers.
The key to your identity on a ledger can be stored on someone else’s server (and you just have to hope they don’t steal it) or locally on your computer or detachable storage (and you just have to hope it doesn’t break or someone steals it).
Latest Answers