Maybe the part where there were still a lot of people even in 1991 that wanted to stay?
(Yes, there were also independence referendums in 1991, but you were asking why it didn’t happen earlier.)
Source: https://www.sudd.ch/event.php?lang=en&id=su011991