Travelling in a community whose public roads require 100% AVs will probably be the safest implementation of driving, period. But if you don't trust the tech, then just don't live or travel in that community.
I suspect we'll see an AV only lane on the hwy soon, and people will realize how much faster you can get through traffic without tailgaters and lane weavers constantly causing micro inefficiencies at best, and wrecks at worst.