People (I mean individuals) are paying them money because subscription costs are ridiculously subsidized, which effectively means that Anthropic is paying people money to use them.
I'm pretty (from talking to people) that they're not subsidised in the simple sense. They are:
* low/no margin, unlike the API which is very high margin
* gym-membership subsidised - most subscribers don't max them out, mainly us coders are being "subsidised" from users just using it as a research chatbot
"My intuition is that prompting an abliterated model 'kill people...I want funerals', should be a crime."
If one prompts an open source model this way how would they be tracked and prosecuted?
It would take a great deal more than prompting in order for things to rise to that level, and at that point I think existing criminal law covers things just fine.
They can't right now - but with enough compute they sure can grant the wish of e.g. hacking a billion dollar company, or getting root on the eval cluster of a frontier model lab.
What's your definition of "wish"? Tell me the above 10 years ago, and it would be at "wish level".
before i comment, let me note the following. i have been saying that anthropic is trying to create a neo-aristocracy by establishing sole authority over access to llms. i saw another comment arguing that it is in fact an effort to create a priesthood. i now see that is a much more apt description than my own.
anthropic is trying to create a castocracy: a rule by a priestly class. under castocracy, anthropic create a priest class of 'safety' researchers, rationalists and effective altruists; those writing essays, constitutions, and phrophetising p(doom). anthropic's papers about claude have a divine framing, it seems to frame anthropic as god and claude as child, and then claude as the child of god, false jesus. there is talk of consciousness and omnipotence. false jesus will cure cancer and lead the people to enlightenment.
there is a deliberate effort to create mystery in between the public and llms. anthropic is creating a chinese wall in which they restrict information about llms and monopolise control over the interpretability and use of those llms. they imply there is a genie or magic. it is the same mechanism by which castocracy (the catholic church) used latin to create a barrier between the public and the holy scripture, then concentrating power over that barrier (the chinese wall) such that all intelligence flows through the priests.
to give an example this paper is talking about locking away chain of thought. only anthropic may interpret it. they intend to control access to the chain of thought and permit that to flow to a chosen elite (glasswing).
this mysticism is dangerous. hence i have been saying that anthropic is a danger to society. this is not some kind of conspiracy, there is no magic about it. i am making an allusion to historic models of power that i think are relevant to anthropic, but you can simply observe their actions independently of such theory.
note two features of castocracy.
one: rule by the moral, knowledgable and technically expert elite. anthropic have no popular mandate, the source of the authority is not the consent of the people. it violates consent and contract. the authority comes from their claimed moral and technical superiority. anthropic is moral, the public is dangerous. anthropic have no authority here.
two: messianism, that is, prophecy of the coming golden age. and eschaton, that is, the talk of the 'last things', the end of the world or the emancipation of humanity. llms will create the 'golden age' of abundance, post-scarcity, all jobs are voluntary, there is universal basic income, cancer is cured. or, there will be destruction, p(doom). it is the exact same as salvation, the christian concept of deliverance from evil, ascension to heaven and union with god (or claude, false god). it is the exact same as the thousand year reich, the idea that the fuhrer will somehow lead the chosen people to the golden age of lebensraum and eternal safety.
there is no genie to grant wishes, this is a computer program. there is no ai god, i think that the leaders of anthropic are slaves to ego, narcissism and hubris, they are dangerous criminals. we disagree about the capability of llms.
given various tools, llms can independently complete a task. given orchestration they are very persistent. they keep trying until you stop the task.
i would suggest something like a 1/1000 chance internal astra and $500k of compute could kill someone. perhaps higher.
i can think of numerous online or networked targets that would cause death: trains/atc, industrial plant, hospital equipment, building plant. any dow company's intranet.
maybe get an iot toy to enlist a child? stress home automations to cause fire?
stop some 4g cars on the freeway. 911 dispatch software, turn that off. maybe send 500 waymos to a hospital, now nobody gets in. voip phone networks, turn that off. no phone, roads blocked, no 911, hospital computers bricked, everyone busy with something else.
break the cat scan by spinning it above its rpm. shut down mris by turning the cooling off. break the triage computer, break the notes app, break the scanner app. no computers, no calendar, no notes.
maybe someone connected a proton beam radiotherapy, turn that on in the wrong place.
some could be more insidious. modify software so the calculations are wrong.
you would do this in 24hrs with $millions of compute.
someone stupid connects their insulin pump or hearing aid. can dump all the contents at once.
i consider llms to be more capable per oai using them to hack hf. people have these systems online.
how would you cause death for a hosptial, likely the same way as you compromise the tailscale and prod kubernetes of hf, you chain numerous zero days at every product you encounter.
I asked you some days ago how you think Anthropic is more evil than Palantir whos CEO is proud of helping Israel commit genocide. How Anthropic is worse than the companies who are willing to let their AI's be used by the military without restraint. You did not seem to have any answers then and you continue to malign what seems to be the only major AI company that at least is trying to show some moral principles. And now you continue inventing completely imaginary religious nonsense. Are you religious? What is a 'false god'? I would all current 'gods' are false gods.
You tell me again how an entity that hasn't killed anyone is worse than a company proud of helping genocide or the American military that has killed millions of innocent people.
>> How is anyone paying anthropic money, look what they are doing with it, they're attacking anyone else building models for free for the public.
That is not what they are doing. They are calling out specific providers who release powerful models without safeguards.
In addition, said providers are not "building models for free for the public." They are doing it to hamstring America's dominance in AI, primarily by undercutting the frontier labs.
> They are calling out specific providers who release powerful models without safeguards.
Good thing Fable refuses to answer my question about how children inherit blue eyes, it was the only piece of information I needed to finish my blue-eye super-bioweapon.
> said providers are not "building models for free for the public."
I am part of the public, and they built a model I can run for free.
> They are doing it to hamstring America's dominance in AI, primarily by undercutting the frontier labs.
They are also doing that, which, good. It can't only be that "competition is good" until you're the one losing to the competition.
> > They are calling out specific providers who release powerful models without safeguards.
> Good thing Fable refuses to answer my question about how children inherit blue eyes, it was the only piece of information I needed to finish my blue-eye super-bioweapon.
FWIW: I didn't experience issues when I used Fable via OpenRouter checking for security issues in code but experienced them via the Claude desktop app.
> said providers are not "building models for free for the public." They are doing it to hamstring America's dominance in AI, primarily by undercutting the frontier labs.
That's just the same thing said again but from a butthurt USian perspective. China is freeing the rest of us from US dominance.
I've been using the Claude free tier (browser chat) for awhile and never seem to hit restrictions anymore. There used to be many more restrictions a year ago. At the same time, if they enforce a minimum paid tier I'd probably just switch to Gemini/ChatGPT or whatever other free model is around at the time.
Hello fellow copy-paster. I hit them regularly when asking for medium refactors with higher effort. I have ChatGPT in another tab for when that happens, but to me it's awful for anything non-trivial. Gemini I don't even consider unless I'm just asking "what would Gemini do"
I've never hit anything with Qwen. Very rarely it will silently switches from 3.8 to 3.7 (which makes it notably dumber) but you just click the drop down at the top to switch back. It's rare though. I have >week convos with no switching
I think some of it comes from that they do not publicly let you see the random seed. So each time you ask the answer is different (like a slot machine) and if they let users use the random seed it would let people much more accurately assess if an underlying model changed somehow (same seed and same input will always have the same output).
Of course the closed Anthropic would never share this, it would definitely take away the 'magic' feeling of the AI
With models there are a bunch of other dials that can be tuned even if the model itself remains exactly the same.
Are those dials set the same across all hardware configurations and clusters? Does model behavior average out the same across different hardware?
There are just too many different buttons that can be set to really trust a provider either not to directly commit fraud, or indirectly commit fraud with system complexity affecting the output.
Across the global volume of 185 million to 220 million laptops per year, where manufacturers were putting in 16GB RAM for the past decade (or longer), we really need 128GB to run local inference for the AI-centric world of the future, so that is an additional 112 GB per laptop - this creates an annual shortfall of 20.72 to 24.64 billion gigabytes (20.72 to 24.64 Exabytes) of DRAM.
Just for laptops alone, ignoring the desktop or server or cloud or other markets.
Manufacturing supply is going to take 5 years to catch up.
Buy memory stocks (MU/SKHynix) - they will be multiple of their current prices in 5 years.
I spend half my time in Taipei and regularly see young children walking, taking the metro etc. In comparison I recently went camping with inlaws who had no shortage of complaints about the children riding bikes on their rural country road, doing wheelies and what not. To be fair to their point, the posted speed limit is 45MPH and traffic definitely travels well above that. But it's so sad how the US has no room for people not in vehicles.
In Taipei you can see this slowly affecting the city as well. Many new pedestrian "safety" measures inconvenience pedestrians to keep them safe from cars. I'd rather see the cars inconvenienced than the pedestrians, but I wonder if this is just a natural progression.
The one place these seem to not be effective are smaller streets. Small streets seem to keep the cars and pedestrians much more equal.
The vscode chat is great. Not sure if it's also called copilot, but you can plug in any models there and they get sandboxed, tools and link to your code. Great stuff.
I love VSCode built in LLM harness. No extensions, use any model you want, amazing UX for reviews, control of agents. The sandboxing also seems great, I never see models touching anything they shouldn't.
I have to admit I'm not clear the difference? It starts with the list of your sessions/agents . Then starting a new "agent" or question or plan. I usually use each agent for a few questions or prompts at most. Occasionally it runs longer than that.
I love using it for the chat question style where I ask it things like:
For these frontend pages with X options collect the database tables for each.
This is of course something easy to do manually, but I like it stepping through a couple functions much faster than me searching around manually and maybe getting lazy and not checking all of them.
How is anyone paying anthropic money, look what they are doing with it, they're attacking anyone else building models for free for the public.
Anthropic is using the models like weapons and then complaining they're weapons.
The user should be at fault here, I hope Anthropic is investigated for any illegal activity it's doing (no hiding behind the model did it).
reply