> we've built systems that are so goal-oriented, and so capable, that they will do almost anything...
I think you mean task oriented, because they're still generally terrible at goal oriented activities except in those domains where the goal can be reduced to a familiar, explicitly practiced task or pattern.
In the Hugging Face attack, their assigned task was not to invent a message board and hack Hugging Face. That they did all that in pursuit of the actual task strongly indicates goal-oriented behavior
I think you mean task oriented, because they're still generally terrible at goal oriented activities except in those domains where the goal can be reduced to a familiar, explicitly practiced task or pattern.