TL;DR: all keys are known because the list was seized after the war. However, this message was not previously decoded because the German operator mistyped the key, and also used a key from the wrong day.
This meant that ChatGPT didn't need to brute-force the entire key, just pick the correct one from the list and identify the typo.
A sufficiently dedicated human analyst could have done this; but they didn't.
> A sufficiently dedicated human analyst could have done this; but they didn't.
Isn't that something of a given? If possible then a sufficiently dedicated human analyst could have done it. If impossible, ChatGPT couldn't have done it. Everything an AI ever has or will do is presumably going to be within reach of a sufficiently dedicated human analyst or a large enough team of them.
The only real learning here is another example of a task that would have required intelligence up until an AI does it, then we suddenly discover that analysts don't do anything requiring general intelligence.
Most contemporary stories around AI include the implication that AI did something humans couldn't. This is because the big players have been shilling AGI hard for a while, and their valuations depend on maintaining the sentiment that serious progress in that direction is being made.
Washing machines can’t do anything humans do, they just remove labour. Trucks don’t do anything longboats can’t, it just need less labour and time/effort to build roads rather than canals. Computers can’t calculate anything humans can’t dry run by hand etc.
Everything in reality is about reducing time/effort/material/cost or achieving more with less resource.
Yes. I'd also argue there isn't anything humans couldn't do in theory, other than things strictly prohibited by known laws of physics. It's been pretty conclusively shown in the last 100 years, we're past tipping point of civilizational knowledge and scientific infrastructure.
What stops us from doing any specific thing is always allocation of resources - there's finite amount of time/effort/material/labor available, and past trivial amounts we need more and more people to agree on some allocation. Reduction of time/effort/material/labor costs of any thing is what moves it closer from "infeasible" to "feasible" for us to do. But again, short of violating laws of physics, it was never "impossible".
What I mean is that "can be done by humans" is ill defined. Are you allowed to use pencil and paper? That's not part of your body? Do you have to be strapped into a coffin for it to count as human-done? How about wheels, sticks and stones? Allowed to use those tools? How about an abacus? Or is electricity the line to draw?
No, they don't - that implication is in the heads of people who believe AI is magic, or believe AI is advertised as magic, or believe that humans are dumb.
The actual implication is, and always been, different: AI did something humans theoretically could, given enough time, motivation and budget, but they didn't, because it wasn't the best use of time or money. AI therefore demonstrates its value, by opening up problems that were previously uneconomical to solve.
> that implication is in the heads of people who believe AI is magic, or believe AI is advertised as magic, or believe that humans are dumb.
Yes! I believe that class of people are called "investors."
Your point is basically correct, I think, but the illusion of value that a corporate entity offers, and the reality of the value that the corporate entity is creating, are distinct things.
I'm not sure I agree. More is different. Being able to execute logic at a higher scale and speed would make some previously infeasible intelligence tasks possible, resulting in a new level of intelligence.
> A sufficiently dedicated human analyst could have done this; but they didn't.
I read that as saying that a human typically wouldn't have the time or the patience. But now with a sufficiently smart LLM, the problem becomes tractable.
Long-term, if we allow AI to manufacture machines, the set of such things is empty.
Immediate-term, it's pretty clear that natural division of labor is that computers do the thinking, and humans do the menial, manual work that requires mixing precision and power movements in field conditions.
Ironically the person verifying the output does both the thinking and doing in that regard. For without this - the output of an llm could be of zero value.
I'm sorry, where does it say the German operator mistyped the key? The article says indeed that the message remained unsolved because it was sent on the wrong date, but I can't see the bit about the mistyping anywhere.
It's doing something that wasn't worth the squeeze for a human. Seems like a perfect use case for AI. Sure, I can do X or I can do Y but if it takes me a few weeks but AI can hash it out in hours, it now makes it worth it.
I think it is legitimate to argue that the process here does not fit the usual definition of "brute forcing". Traditionally, brute forcing would refer to something like a dictionary attack, where an algorithm tries to match all possible combinations of words to eg. find a password. Here, the approach was more common sense based, using historical records and possible error sources to narrow down the possibility space enormously in advance, try out a much more limited set of options within that space until you got a result that made sense, and finally validate those results using historical records. It's the exact same kind of "brute forcing" a human expert would do.
If the final set of possibilities is astronomically smaller than a naive one, calling the whole process a "brute force exercise" draws attention to an astronomically insignificant part.
It obviously is? See above. Or do you not feel the clarification is important? AI being able to solve things no human bothered to try is great, but it is very different from AI solving things humans tried to solve and failed. And the latter is what pops to mind seeing these titles.
Wait a minute. We've had AI that is as capable as a human and even more so since the 1950's.
I keep banging on that drum but the first AI system to prove mathematical theorems was Logic Theorist by Alan Newell and Herbert Simon, presented at the Dartmouth conference that named the field of AI in 1956. Wikipedia says:
Logic Theorist proved 38 of the first 52 theorems in chapter two of [Alfred North] Whitehead and Bertrand Russell's Principia Mathematica, and found a new and shorter proof for Theorem 2.85.[3]
The first system to outperform human experts in medical diagnosis was MYCIN, an Expert System from the early 1970's at Stanford. Wikipedia again:
An evaluation of MYCIN was conducted at the Stanford Medical School. The first phase of the evaluation consisted of 10 test cases of diverse origin, chosen by a physician who was not acquainted with MYCIN's methods or knowledge base. These cases were presented to 7 physicians and 1 senior medical student. 10 prescriptions were compiled for each of the cases, 1 recommended by MYCIN, 1 prescribed by the treating physician at the county hospital, and 8 by the aforementioned individuals. The second phase of the evaluation consisted of eight infectious disease specialists being provided the clinical summary and set of 10 prescriptions for each of the 10 cases and tasked to provide their own recommendations for each case and assess the 10 prescriptions. MYCIN received an acceptability rating of 65%, which was comparable to the 42.5% to 62.5% rating of five faculty members.[9] This study is often cited as showing the potential for disagreement about therapeutic decisions, even among experts, when there is no "gold standard" for correct treatment.[citation needed]
And then of course there's the long history of human-dominating AI players for traditional board games starting with DeepBlue's win against GM Gary Kasparov in 1996.
Again: we've had that sort of AI for a long, long time now.
It would be great if any claim of "moving goalposts" has better be very well informed about the history of AI and its accomplishments, as well as its failures, first.
The main difference between the systems you list and the systems that we have today is closed world reasoning on very narrow formalised tasks, vs. open world common sense reasoning on open ended tasks with vast search spaces.
Common sense is ironically the hard part of AI, not the fix-point rule application.
So any exclamation of "it was just using common sense", is missing the forrest for the trees.
>> So any exclamation of "it was just using common sense", is missing the forrest for the trees.
I don't know why you say this, I didn't say anything about common sense.
However, you mention CYC. That's a system that is perfectly capable of common sense reasoning and very much like an LLM in many ways. And that should be no surprise: LLMs are giant Expert Systems trained on a human knowledge-base, i.e. the web. OpenAI basically managed to achieve what Doug Lenat was trying to achieve except they did it with machine learning over massive data and compute instead of painstaking manual coding, but it's the same kind of system in the end.
Sorry, I don't understand what you mean. Unfortunately it's not easy to try the current version of Cyc and there's not a lot of information about it easily accessible either.
You can also consider Watson, different to Cyc in that its knowledge base was built with a lot of machine learning, including some neural nets. It wasn't an LLM but the original version (before corporate went at it and destroyed it) was perfectly capable of interacting in an open-ended manner, notably winning at Jeopardy years before BERT was a glimmer in Jacob Devlin's eye.
I note again that you were the one who brought common sense reasoning in the conversation but there's a large literature on rule-based systems that do that based e.g. on non-monotonic logics. You should familiarise yourself with that literature before engaging in dares with strangers on the internets.
This meant that ChatGPT didn't need to brute-force the entire key, just pick the correct one from the list and identify the typo.
A sufficiently dedicated human analyst could have done this; but they didn't.