I had the same thought. I'm assuming it has something to do with them wanting the wireless puck for the Steam Controller to be able to charge the controller as well.

Otherwise, maybe there's some hardware reason why making the battery removable in the Steam Controller would be difficult.