the ballots themselves are kept as a backup
Ideally they are transported and kept under watch by many different parties with a stake in the result. Is the backup watched until it's deemed no longer needed?
recounts are mostly a roll of the dice to see if enough human errors stack up
All the different parties should be watching out for errors, a human error should be difficult to happen when many humans wanting their party's votes to be counted :s