Do you honestly think that nobody has thought about that and solved that problem already? Even with all the engineers involved, and after all the real-world testing, you're the first to have considered that scenario?
Even consumer-grade products like ChatGPT can be interrupted while talking. We're talking about an AI implementation, not some rigid set of if...else statements.