Well that’s exactly the authors’ claim. Legalese and patents intent is not to facilitate communication but to maintain a claim under the most bad faith, hostile reading.
AI language, it seems, is optimized to support reasoning from the interior monologue.
Is there adverse selection in reports of the callousness, incompetence and greed of US healthcare providers?
Three years ago, of necessity I became a big-time consumer of healthcare[1] and I can't believe I just been lucky that nearly all my doctors seemed reasonable and effectively treated me. Of the dozen or so doctors I dealt with only one left me with a bad feeling.
[1] Stage 4 renal cancer, successfully treated with immunotherapy and surgery at Perlmutter Cancer Center in NYC.
There is definitely some, but the #1 advice is excellent advice pretty much wherever you go IMO. Beyond just scheduling: You absolutely have to be your own advocate for all sorts of stuff that will otherwise often get dropped through the cracks.
And in addition to variance among institutions, there variance in practice at each. The best groups have a consummate professional's focus on reducing their own. But even at another "one of the best", let alone at the merely good... my impression was "there's lots of holes in the cheese around here", and left me wondering whether/how a transient outsider might usefully help folks towards more of a safety culture. It seems a reoccurring opportunity.
providing top-level medical care requires a very rare combination of incredible technical skill, organization, humility, and life-long dedication to the craft. i would wager that it's largely a numbers game. how many humans on earth have that combination of skills and traits?
The way the US would leave a crater where the ICC was would not be militarily.
Go ahead, indict Trump. Trump, being the provocateur that he is, would travel to the Hague, or wherever else, and he would not be arrested. The ICC would do nothing and exposes its toothlessness as a performative political tool of center left Europe.
But it's largely the court of center-left European thinking. It's a political tool without teeth, and since none of US, China, Russia are signatories, it can only prosecute people without a great power sponsor.
That’s what makes this so annoying. I don’t mind a template, but the fake personalization gives it a whiff of deception in a way a pre-LLM simple template mass mailing doesn’t.
Yeah, the whole thing seems like a human centipede of rug pulling. Probably the same as it's always been. Curating AI knowledge should be something that we put our best researchers towards, but realistically I think we wind up with 2-3 highly biased nationalistic models that are constantly copying off each other's notes.
Thanks, that’s the nature of any business. Founders see a way to take existing knowledge and expertise, combine it in some novel or interesting way, and produce a new product
Napster was a fantastic and disruptive product, the likes of which arguably has no equal to this day. But eventually the hammer came down from the courts and it was replaced by streaming services like Netflix, which pay to license materials from their creators.
But if you take it deeper, didn't most of those authors rely on the work of others? Most of human knowledge is small advancements of things we already knew. Often by reorganizing what we already knew.
Is that not what the foundation models are? A new reorganization of existing knowledge?
So then the problem is that Anthropic seems hypocritical when they knowingly insert themselves into this chain, and then complain about people down-chain from them.
To remedy the negative impressions (if they even care to do so) they should do 1 of 2 things:
1) stop complaining about it
2) stop distilling other people's work
It's hypocritical and we shouldn't listen to their bullshit but I wouldn't expect anything else from them.
This generation of frontier models is "good enough." At some point, the Chinese labs will get to where the Americans are right now, they'll race to the bottom, and we will actually see what proliferation of AI looks like.
If Anthropic wants to be a trillion dollar company, they need to make revenue like Google or Apple do. Both of them have near monopolies, Anthropic is only getting further and further away as time goes on.
Of course they're gonna complain until they either figure out a better plan or accept a new valuation which is high but not spectacular.
They insert themselves into this chain for profit and complain about it. I really think that adds a thick layer to the hypocrisy that people, or at least me, feel is especially distasteful.
No LLM products would exist without the avalanche of largely non-consensual use of IP to create them, full stop. Any of these companies doing this and then turning around and complaining when their IP is "breached" are going to met with a chorus of tiny violins.
Often people ignore scale. N=1 is OK, therefore, N=1billion is OK. Same flawed argument as: "It's OK for one police officer to watch one street corner for the purpose of observing crime; therefore it's equally OK to have cameras recording every street corner in the city 24/7, for all purposes. Same thing!"
It is an ancient practice, that when a human creates something, other humans will observe it and learn from it. Every group of humans living together has practiced this in some form for tens of thousands of years if not longer. Even animals do it. It's a natural assumption when making any form of art.
It is not a natural assumption that someone will digitize the artwork and use it to adjust a couple thousand matrix coefficients in a complex computer program. To most people that seems like copying with extra steps. The brain may in some ways resemble a computer, but what sets it apart is that we have always lived with brains. Everything a human does has already anticipated the presence of other brains, while etched circuits on ultrapure silicon crystals are something new.
To a degree. The human produced knowledge is the product of all humanity (no human is an island).
A comparable idea could be that an encyclopedia or maths book is only distilling the things that other people did, and how dare they sell them. But the "only" is doing quite a bit of work. LLMs do not just spawn into existence. There is a body of work that they feed on, and then there is also very attributable work they do around and on top of that. All labs are struggling around the first order question: Is it okay to use prior work like this? The second order issue is still entirely reasonable to separately have and enforce rules about.
SOTA models cost hundreds of millions to train. Did creating the contents of the text corpus they were trained on really cost an equivalent of 20x as much (~10 billions)? I honestly don’t know, but I could imagine it having been significantly less.
This isn’t meant as a moral argument, just musing about the relative cost comparison.
If you look at movies alone that would easily surpass 10s of billions. The cost of most books is probably more nebulous, but books, research, and more all have time and money spent to create them. I would guess the corpus of all media from the 20th century on would be minimally in the hundreds of billions of dollars.
do you also count eg published results of very expensive physics experiments? because once the costs of things like these are taken into account, we are way over 10 billions.
I would argue that producing the complete written corpus on which they at least intend to train (even if some is still out of reach) cost literally everything to produce.
And the monetary cost doesn't even register when weighed against the blood, sweat and tears that went into capturing the authentic experiences of real human beings, whose honest expressions are now at least in some cases getting hoovered up, ingested, and then destroyed for all eternity, for fear that this specific work is the rounding error that might give an equally immoral competitor the edge in the bicycle-riding flamingo race that is currently consuming an absurd amount of the world's creativity and attention.
Pre vaccination smallpox killed hundreds of millions of people just in the twentieth century [0], the knowledge that allowed for the creation of just that vaccine is worth hundreds trillions of dollars in humans lives, let alone all of `the knowledge and experiences those people were involved in.
The knowledge that created the Haber-Bosch process [1] helps to sustain the majority of the world's populous, add another five hundred trillion dollars for that just to start with.
The creation of the printing press and all written information that allowed it to be built provided dissemination of knowledge beyond the ultra wealthy and is worth a non-finite amount of money.
LLM's are cool math, but they are less than a rounding error in comparison to even the tiniest sliver of human knowledge and technological output.
AI language, it seems, is optimized to support reasoning from the interior monologue.
reply