How do you know Ohio is real? Have you been there yourself? Have you seen it with your own two eyes? Or do you just trust all the people who claim to live there?
You see, believing in the existence of Ohio is exactly the same as believing that my dad works for Nintendo and I got the play their next game early. It was awesome btw.
That's what Google was trying to do, yeah, but IMO they weren't doing a very good job of it (really old Google search was good if you knew how to structure your queries, but then they tried to make it so you could ask plain English questions instead of having to think about what keywords you were using and that ruined it IMO). And you also weren't able to run it against your own documents.
LLMs on the other hand are so good at statistical correlation that they're able to pass the Turing test. They know what words mean in context (in as much they "know" anything) instead of just matching keywords and a short list of synonyms. So there's reason to believe that if you were able to see which parts of the source text the LLM considered to be the most similar to a query that could be pretty good.
There is also the possibility of running one locally to search your own notes and documents. But like I said I'm not sure I want to max out my GPU to do a document search.