That sounds like way more effort than a credit card, especially here in the US where transfers between banks take 2-3 days.
If you really want to avoid credit, you can lock your debit card and unlock it when you make a purchase. That's still annoying, but effective. But if you're responsible, there's really no reason to avoid credit, and you get rewards on top.