> In all of these cases, the model's judgment is just very poor in a basic way.
This sentence resonated strongly with me. Not just in R&D but in every single interaction with the model. From Fable all the way to Sonnet they all very clearly show just zero judgement unless the answer was already seen during training.
I know it's been talked to death already, but the fact that the video is so wrong on self-driving cars is mind-blowing. We can rationalize post-fact as much as we want - still it is shocking that popular belief never expected language models before self driving.
Popular belief never took the regulatory obstacles to self-driving cars seriously. If LLMs required insurance to use, they also wouldn't be available in public yet.
I'm not sure I agree that it was ludicrously wrong. His thesis is "the question isn't whether self-driving cars will replace human drivers, but how quickly". Sure it's been slow going, but you can't walk down a street in San Francisco today without seeing a Waymo, which wasn't true a few years ago. We're still at the bottom of the S curve.
This sentence resonated strongly with me. Not just in R&D but in every single interaction with the model. From Fable all the way to Sonnet they all very clearly show just zero judgement unless the answer was already seen during training.