Whilst removing GST seems like a good idea on the surface; it does serve some purposes which are not easily replaced.

It captures a bunch of revenue from tourists that otherwise would be harder to capture; tourists see the price and don't think about the tax that they are contributing to the NZ economy. So tourists in Queenstown are helping to pay for hospitals in Auckland.

It captures some of the proceeds of crime; I know we want to reduce crime as much as possible; it is a fact of life, the GST helps to get some of that money back. It is a bad bargain but is better than nothing.

Adding carve outs in the GST scheme for fresh fruit etc, is a bad idea. In NZ the effective GST rate (15% - admin costs of the system) is something like 14.8% I couldn't find the article that was from, I read it a few years ago. Compare that to the effective VAT in the UK, which is around 16% when they pay 20% in VAT on most stuff.