I think properly funded schools with properly paid special needs instructors would leave far fewer students behind than allowing homeschooling.
Good special needs instruction includes teaching non neurotypical people like you and me coping mechanisms for situations like social interaction. Allowing homeschooling creates one more situation where people who are typically not trained or prepared are suddenly the sole source of education for a child. And schools are an important safety net for abused children. Homeschooling is abused far more than it is helpful. And in any case that it is helpful that is only due to a failure that should be remedied elsewhere.
At least that is currently my view and living somewhere that homeschooling is illegal but the schools are better funded has certainly not changed my mind. Evidence to the contrary would though.