Just make them leave it off. Anyone caught using a phone gets it taken away the rest of the day.
That's what we did with anything that was distracting when I was growing up. You can have it on you, but if they see you using it. It goes into the principal's office until EOD.