I think that's somewhat true, but less true than most other activities. Much less true than team sports like football (any of the sports anyone calls football) or cricket. It's quite easy and normal to go for a walk through a park where people are playing disc golf. You'd never do that down the middle of a football game. Even regular golf, because of the greater distances involved and higher risk if you get hit, walking through the course (if it's permitted at all) is not an especially comfortable prospect.

It's certainly not something that should be taking up all the space in every park, but having 2 or 3 courses in a large city? Completely reasonable.