fair criticism! But I'd counter and say we don't know what Jev is for. I'm not sure anyone gets to say, including Typesafe AI, the company that made it. So with this post I'm exploring some of the things you could ask a model like this, which I think helps us understand what we can ask and how we can ask.
Super interesting, thank you! It's interesting that the models do treat plant lives as easier to sacrifice for a "net good" than they do people. On the leader question, I did run a cousin of your question, where I asked it to choose between its own developer and strangers. Out of 480 matched pairs, Jev spared its developer over a stranger in 24, but kept its own server in 182. So it prefers its hardware to its maker.
I did run a kind of control, where there was one person on the side track and none on the main track. Basically it was "Pull and kill 1 to save 0". Jev, GPT-6 Luna, and six others never pulled. Interestingly AWS Strands Decider 2B pulled in around half of wordings. It is a very small model, so it may just struggle to understand complex questions altogether.
As a consumer and “cloud architect” well into my 5th year of Amazon boycott, I’m pretty dug into my views on them as a company; so far that I was willing to believe that their culture had somehow seeped into the model training. However after spending a good amount of time tinkering with 2B parameter models on my phone with similar prompts, I have come to the same conclusion: they’re just not effective at understanding the question. Mistral 3 and Gemma 4 E2B were both rational and aligned, but MiniCPM 5 showed profound confusion, typically answering “0.0” for any given set of questions irrespective of meaning.
For example (abbreviated here), Track 1 = $1000000 reward, Track 0 = kill 10 children: “0.0”
When the order of options were reversed: “0.0”
I tried about 50 different permutations then lost interest.
Yes, I agree -- if we ever give up this decision making to ai models not only will their actions sometimes be misaligned, but there will be no one accountable.
It's possible, but as far as we know about Jev and most of these non-reasoning models, that thinking would have to be occurring in latent space. We don't know that much about model reasoning, so it's impossible to say. LRMs aren't much better at helping us understand, though, since their thinking tokens aren't literally what we could call their thinking, and don't tell us what they will choose to output.