Just glue four individual fins onto the surface so that they'll be easy to re-attach when they inevitably break off.
If you put them in slots or something, all you're doing is making it more likely for the fin material itself to break, causing you to have to re-make the part to repair the rocket.
Modeling after the v-2 because it looks as stereotypical as a rocket can