Not sure about how good or bad it is in the US, but in the Netherlands (a place that is known for good infrastructure) it's definitely not perfect.

I never realised until we got a baby and I started walking with a stroler. Way too often the sidewalk is inaccessible because of cars or bicycles. Also lots of places without ramps or elevators.