My most direct use of fzf is to search large result sets for something I can't 100% remember the name or location of, so this actually sounds nice. I've managed to get fzf to slow down a few times and... well, I'm sure as hell not organizing that folder structure.