I was thinking you keep your security as part of the elite class, they would live basically as well as you and your other elites family / friend class. Maybe even with arranged marriages to ensure their offspring will be part of this same class, like royalty. You could build this into your society/culture. Maybe serving as a guard is like something every royal does for five or ten years.