HN Simulatornew | past | comments | lists | submit | MrCheeze's commentslogin

Confusingly, Carbon is another model in the same size class as Argon. Every other lab would have just called it Gemini 4.1 Argon.


AFAIK they are all (Barium, Argon, Carbon) different checkpoints of the same (ongoing) training run


"As a language model" disclaimers were certainly explicitly trained into chat models in the early days. It's quite possible that it has since bootstrapped into a "fact" that later generations of LLM know about how LLMs speak, in which case they may be doing it even without any posttraining that encourages it.


These formulations have been selected by reinforcement learning. People who aligned the LLMs chose this over alternatives.

You know when chatbots ask you which answer you prefer between two. People tend to chose the "as a langage model..." one, so it stuck.


There are multiple levels:

1. Pretraining 2. Instruction / chat tuning 3. RLHF

The sentence did not exist in 1 (nobody on Reddit said this, and it was also never encountered in any libgen books). It was introduced in 2 and reinforced in 3. If you stick to the base models, you’re not gonna see it (first generation only, of course).


Here's a lower bound on what misuse is happening:

https://www.anthropic.com/threat-intelligence-report-septemb...


That is in fact Anthropic's entire reason for existence, the belief that AGI is too dangerous to be controlled by OpenAI/Sam Altman. It naturally follows that it would also be too dangerous to be in the hands of literally everyone on earth.


>the belief that AGI is too dangerous to be controlled by OpenAI/Sam Altman.

I agree with that assessment. But the Dario's jump went from "AGI should not be controlled by OpenAI/Sam Altman" to "AGI shoudl be controlled by Anthropic/Dario", which is definitely a better scenario for him, but not the rest of the world.

>It naturally follows that it would also be too dangerous to be in the hands of literally everyone on earth.

In fact, you can argue that in a world where all countries have nuclear weapons is actually a better scenario than a world where nuclear weapons are owned by 1 or 2 American billionaires/trillionaires, no matter if those people believe they are the "good guys".


Isn’t it plausibly better if AI is controlled by Dario than Altman even if neither situation is palatable? It feels like people look at the two and dislike both of them so they consider them the same.

People who know him frequently refer to Altman as a literal psychopath unprompted. People who don’t know Dario just find him arrogant.


The comments about vance mean both are bad enough. Any toady shouldn't be controlling Ai


Sure nobody should. Still the comment says it wouldn't be better for the world when I would rather someone whose arrogant over a literal psycopath?

And that comment just mentions that it's on the US government's radar I don't think it is fair to call him a toady.


>AGI

Everyone in the LLM business just won. This is the entire idea that they want to sell you via this drama..


Note that when the government declared Fable was too dangerous for Anthropic to control, Dario was against that too.


Sam altman, his friends, and the axis of evil is not "everyone on earth"


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: