Because there are a million literary awards and some of them are awarded by people who are bad at recognizing quality.
Additionally, many of these cases were only partially created using AI or aren't proven to have actually used AI or used AI in a creative and non-conventional way and that's what they won for.
It's a chart that shows the number of things going up over time. The total number of things increasing over time is going to play a hugely significant role in that, regardless of how broken the selection criteria are.
A contest of skill is not necessarily like spinning a roulette.
If I were to play Lebron James in basketball 1v1, it would not matter how many times we ran the experiment. We could play a trillion times, and I would win 0 of them.
If you sampled 10 Hollywood directors and asked whether The Godfather or The Room is a better movie, the Room would win the poll 0 out of a trillion times.
The reasonable naive expectation for contests like these is that, below a certain bar of quality, the chance of win is 0. So if you see wins go up as volume of submissions goes up, it shows that either ai writing is above that bar, or that faulty judging is a widespread problem beyond a few anomalous organizations.
You have better than zero in a trillion odds against Lebron James. What if his phone rings?
"10 Hollywood directors" is hilariously unconstrained -- I'd put money on at least one having never seen The Godfather.
> The reasonable naive expectation for contests like these is that, below a certain bar of quality, the chance of win is 0.
I agree that the layperson's understanding of what 'literary award' means is close to this idea, but the "contests like these" is the problem here. "contests like these" include one that allows and seems extremely keen on "AI" generated text, for example.
There isn't a stark contrast between 'contest of skill' and 'game of chance'. You can eliminate the skill part and get closer to pure random chance, but you can't eliminate the random chance from the contest of skill.
> You have better than zero in a trillion odds against Lebron James. What if his phone rings?
You can easily devise in this thought experiment rules that prevent loopholes, like saying no phones allowed and medical emergencies do not result in a win for the opponent.
Even if you find them intuitive, they produce no learning gains for anyone. Take a lin alg test, watch the 'Essence of lin alg' videos, take comparable test again. I guarantee you won't see any change even if you 'understood matrices better'. They are pure mathporn.
No learning gains? I teach linear algebra. I can assure you that students who watch and study the "Essence of linear algebra" videos (which I recommend on the syllabus) do better on my tests that those who don't, because they learn stuff from them.
It's much more likely that the students who take the time to watch supplementary materials are the ones who'd do better regardless of the quality of the given material. If you have access to fresh learners, I'd say it's a good opportunity to test how good those series are.
I'm not sure anything I say can convince you, as your mind seems to be made up already, but my experience has been that those videos help my students understand the concepts of linear algebra, comparing the mastery level now vs. before the series was published on YouTube. Especially when it comes to getting a feeling for what a linear transformation is, and how the properties of matrices echo the properties of the transformation they represent.
As for "fresh learners", I can provide my own son, who watched the series before taking his first linear algebra class, and says that it helped him a lot.
I'm not defining education as passing tests. A test is just a measuring instrument.
In fact, your claim is strong and quite easy to test. If watching the series gives people a better fundamental understanding which makes subsequent learning more efficient, take matched novices, randomise them to watch the series or not, then teach both groups some later lin alg materials and measure learning gains on novel problems.
That's the kind of test I mean, not 'can you grind through the course exam'.
If your claimed deeper understanding neither improves what someone can do afterwards nor how efficiently they learn related material, I'm not sure what observable content the claim has.
This is not my experience. Having an intuitive grasp of e.g. the graphical interpretation of the determinant instantly lets you figure out most of the key determinant properties without having to memorize them. That's the primary thing you get from intuition imo, having a sense of what must be true without having to memorize or prove it.
I'm actually quite optimistic, was pointing out that, at least to to me, AI slop already produces better results than big educational content creators. For something concrete, even if not classic math, I credit direct LLM interaction highly for accelerating my understanding of CPU design and compiler tech.
fwiw the fact that brains work fundamentally differently was my big penny dropping realization after digging into what LLMs are doing. Everything (I assert) a brain does (the function between inputs and outputs) is due to training data. There is no "instinct" and there is no "ROM-driven way to think" in any brain. It's training data all the way down. As a consequence different brains do indeed think in fundamentally different ways.
This is so fundamentally divorced from what we know about cognition in humans or in animals. The idea that we are a pure tabula rasa and only shaped by our "training data" is absurd and false. Just look at the amount of data we need to be able to do things relative to ML models. Look at animals which can do complex tasks moments after birth. We're deeply, deeply shaped by instinct.
Well, everyone being tabula rasa has a point tho. Technically there's no unique physical cause that make development unfold the same for all organisms, or even all humans (see Waddington's epigenetic landscape). It just happens that we develop along very similar trajectories and can draw equivalences between how I think vs how you think. So, from an ontological perspective, if you squint a bit, we all are tabula rasa. But from a phenotypic perspective, of course it's bonkers, you can't teach a frog linear algebra.
> AI seems to be very good at getting answers, but not always answers to the correct questions.
I don't think that's an accurate summary of the article you linked. The Lean proof solved the exact problem it was supposed to, it just had minor discrepancies from the writeup of the proof (on the level of saying a theorem requires m+4 derivatives when it actually requires m+5 derivatives). Obviously a problem but not really a bombshell.
An unpleasant part of the AI math revolution is that people's hatred of AI is bringing to bear their hatred of pure mathematics in general. I've always known in the back of my mind that mathematicians were secretly despised and looked down upon by many, but it's a bad feeling to see it become so mainstream.
And people's love of AI is also surfacing their dislike of pure mathematicians. Plenty of comments along the lines of "turns out mathematicians were just idiot savants solving puzzles".
It's quite amusing that this mistake gets made on every single one of these guest posts when the first words on the page are "This is a guest post by Álvaro Lozano-Robledo" and the first paragraph starts with "I would like to give Terry my heartfelt thanks for giving me the opportunity to contribute a post to his blog." It's pretty clear that everyone is skimming these at best. Maybe he should put the disclaimer in a bigger font or something.
This same thing happened back in the 10 advances in math and CS release a month or two ago. The non sofic group construction relied on false prior literature. They realized this and fixed it in the lean program but didn't modify it in the writeup, so the written proof was both incorrect as stated and did not correspond to the lean proof. I was surprised how little press it got at the time, it seems like a huge risk factor.
The insane popularity of channels such as 3Blue1Brown suggests that a lot of people do. Learning by watching is many orders more popular than learning by doing. Probably because it makes you feel smart without having to put that knowledge to the test, so it seems like a better way to master new concepts.
There are many folks on HN who watched a YouTube video or read a Quanta article about some mathematical concept and run with that.
> The insane popularity of channels such as 3Blue1Brown suggests that a lot of people do.
I don't think this is true.
First of all, the fact that watching videos is not a sufficient way to learn math does not mean that videos cannot be an excellent supplement for learning math. 3B1B's linear algebra videos for example are wonderful tools for gaining geometric understanding and motivation behind why things are the way the are in linear algebra, but of course they won't teach you how to invert a matrix. (He even says something to this effect explicitly many times throughout the series, if I recall.) Not everyone who watches those videos is engaging shallowly with math just because they're watching videos about it, there's plenty of value for serious students as well.
Your next argument might be that the sheer number of views indicates an unrealistic volume of serious students. This is true, but it still doesn't indicate that people think watching videos is a good way to learn math; in particular, nothing says they're watching those videos because they're trying to learn math. They're beautiful and interesting and well put together videos, and I'm sure many people enjoy watching them passively fully conscious of the fact that they aren't actually deeply learning math. I don't think there's anything wrong with that!
I'm sure there is a subset of viewers who think they're actually learning math by merely watching videos, but I'm willing to bet it's a relatively small fraction.
Personnally, I watch 3Blue1Brown's videos because I find them very enlightening. They're are also very nice to watch and listen to, the production quality is very high. I don't pretend learning a lot of maths by simply watching them but I like watching them anyway for what they are: videos about maths problems and maths concepts.
> Learning by watching is many orders more popular than learning by doing.
But you hardly learn anything from it. You forget. And you don't know how to apply the bits that stick. You only remember some of the words and concepts. You may repeat them to other people. For 99% (or more) of the viewers, that's enough, because there's never a need to apply probability theory or differential calculus. So it is entertainment. Intellectual, more interesting than most other content, sometimes stimulating, but still entertainment. The 1% that does want to apply that knowledge, really needs to practice, though.
a common comment i read is something like “if was my teacher/professor i would have learned so much better!”
and no, i don’t think so. you would have been entertained, but your teacher was making you learn. ability to explain concepts is important but it’s only the first step on the pathway to learning.
Hmm, I'm not so sure. You may have never had a truly horrible math teacher. I distinctly remember learning matrix multiplication in high school for the first time. We were taught the algorithm without any motivation at all. Not a single picture was drawn, she just did some examples and then passed out a giant worksheet. I didn't learn linear algebra in that class. If Grant Sanderson had taught it I'm sure I would have.
I think a lot of people, sadly, imply that they think this, even if they don't explicitly say it.
I recently tried to obliquely bring this up to a friend and he asked out loud, "Sometimes I do wonder if it's better to watch YouTube videos or do problems. I'm not sure."
This has been one piece of acedata representing an aggravating trend in my personal life. It could just be my attracting these types (which I've been fretting about since I'm thinking wtf is wrong with me then), but other examples are family members even expressing this bad habit with something as dumb as Marvel. They read forums about comics without ever reading them and feel possessive enough about the genre to get pissed when I, who...does read comics..., criticize the Disney Marvel movies.
I'm hoping it's just me over indexing for it since it bothers me, but yeah - I have found that there are certainly people who just consume content without practicing or implementing the thing they're supposedly learning about, and then think they've actually learned.
ofc ymmv - it could just be my strange social circles.