My take: Neighbors keep dropping in on them at dinner time, so he insinuated they are doing so because they are looking for a free meal. Tired wife (who has on an apron because she’s making dinner) is thankful husband called them on it so they would go away.