In fact, I know for a fact we wouldn't, because... This existed.
Well, not something made the same way this was. And yet, still precisely this in nature. There was at one point a website with what was basically a chatbot pretending to be God. It had pretty evasive responses, very frequently got off topic, but sometimes, and I am not sure how they technically achieved it, it would give spot on answers to what you told them. Never deep trivia knowledge, but like, casual talk expressions and very simple queries, and other follow ups that made complete sense. Like it would know how to follow up on a "What's up dog?" and bark as a joke when you tried to say "I meant dog literally".
And crucially: We found it utterly unimpressive. It was a stupid toy for kids in computer class.
The technology wasn't comparable. But IMO the result for a typical end user was roughly the same.
Sometimes they would produce wonderfully on-topic responses, and other times they would go off the rails. And the end user would only tolerate so much off-the-railsness before dismissing the product as pointless.
Yes, the results here are quite a bit more impressive than historical equivalents if you analyse them at an academic level. But that doesn't matter to an end user.
And we saw the same with LLMs. Most people completely dismissed LLMs like GPT2/GPT3, despite how much progress they were making. It was only once OpenAI successfully made them follow instructions and wrapped it up as ChatGPT that the general population started paying attention. GPT3.5 wasn't any smarter than GPT3. But everyone perceived it as smarter simply because it could follow instructions (which... brings up some interesting questions about humans)
reply