And that's just Visa.
https://www.eia.gov/consumption/commercial/data/2012/c&e/cfm/pba4.php
That lists the energy usage of banking and financial office space to be 18 billion kWh, or 64.8 petajoules. (About 87x that Visa figure.)
And even that is just office space. Doesn't factor in the manufacture, distribution, transport, storage, and disposal of physical money, or any other associated costs.