Honestly, that sounds like a great lifestyle fit for you, but for many people there is a huge risk in that lifestyle in becoming extremely isolated from other people and not feeling like there is an easy way to escape that isolation.

A couple of mile walk into town is not the kind of thing someone who is feeling down but wants to maybe meet people is going to do unless the bicycling infrastructure is pleasant and easy to use. It also leaves you heavily dependent on having a healthy body to socialize which again I think is generally a bad idea as it is the times we are in poor health that we need friends the most.