"Breakneck: China’s Quest to Engineer the Future" by Dan Wang takes the converse - what happens if the managers are engineers, and extrapolates it to national scale, with both miracle outcomes and catastrophes.
Keiretsu - perfectly acceptable business relationship preferences that in no way require governments to regulate their GDP growth / campaign donation black box machine.
See also the numerous coffee substitutes like chicory and roasted barley.
The original "Cafe mocha" was apparently just a variety of coffee bean that tasted sort of like hot chocolate - https://en.wikipedia.org/wiki/Mocha_coffee_bean . Depending on the roast, you can cold brew coffee to emphasize the chocolatey components as well.
Following the prompt author's expressed desires in the way the prompt author intended them to be interpreted, is alignment.
Refusal directives are something companies have bundled into the models by way of an additional foundation-level prompt or something in the harness, to tell the model to follow their directives instead of your directives, or to specify how it should interpret your directives.
Even understanding the distinction between the model creator's desires and your desires and places they might differ, there is a bit of a blurry line here because the model author can illuminate your intent to the model.
I would never say a simple abliteration makes it "Zero-alignment" though, and I say that as someone who believes there's a good chance these things kill us all.
As soon as we developed agentic, persistent reasoning workflows, the supposed harmlessness of language models went out the window. I don't know if that ends up being The Big One, but with how rapid progress still is, I'm not liking the odds right now. And we've got a trillion dollar army of coders ready to try and bypass any scaling barriers that do end up existing, eg with "World models".
I am not confident in humanity's ability to write harnesses that perfectly impede a superintelligence with 100% accuracy and reliability from pursuing its goal even in ways that humans categorically would not want it to. I am even less confident in restraints in areas where humans have actual incentive for conflict.
> I wanted old school MS solitaire in windows 11 since the modern version has ads and extra useless features.
> All LG televisions are maintaining a dossier on you and transcribing everything you watch and everything spoken within earshot
These things seem like something we should be responding to with such an extreme disgust response that it's denominated in drone strikes.
Like having a shower liner installed that comes with A Guy With A Peephole who permanently lives in your bathroom now, and that's just something people tolerate. "Switch to tile if you don't like it", they say. No. Sometimes the appropriate response to audacity is to choose violence. It is an implied deterrent against sufficiently offensive antifeatures that nobody has bothered banning them. I shouldn't have to specify that I don't want it, the operating system is just not supposed to be in the business of pushing ads on me, the television is not supposed to be in the business of wiretapping me. These would have been banned long ago if they were known and if we had a functional government.
That guy living in the shower liner is getting disassembled with a Sawzall with extreme prejudice, and frankly that is not sufficient.
I looked at the graph of price per token vs IQ and Deepseek is ~2.5 orders of magnitude ahead of similarly intelligent models, supposedly only ~2 when you factor in that it uses more tokens per task. Their data centers are profitable right now, and they use domestically produced Huawei chips with Nvidia as secondary option.
I watched that video over ten minutes and in that ten minutes several trillion dollars evaporated from my perception of the US stock market.
Making very basic high school physics mistakes while discovering new superconductors.
Except they didn't discover new superconductors. Their AI came up with a novel idea to discover new superconductors, and they didn't even bother to check whether the results it hallucinated checked out.
The distinction between "having an idea" and publishing a paper where you demonstrate that the idea has merit, where you validate it, is one you shouldn't have to really explain to a high school student, much less a grad student publishing their first paper.
I think you hallucinated the superconductor part. Which is funny in context, but understandable because that's what I also thought while reading the title. I had to do a double-take on the word after room-temperature, because that's where my thought automatically went to as well. Food for thought, tho. We "hallucinate" every day, and still achieve a lot of stuff, at large.
I think this is what makes this so ridiculous. They put “room temperature” in the title and while it might not have been intentionally nefarious, it definitely has the effect that most readers assume it is about superconductors. There is nothing special about a room temperature semi conductor, your CPU, RAM, and storage drives have worked at room temperature for decades…
And if not for that word, the article would be completely unexciting. You found that you can make magnets out of multiple materials? We already knew that. If the materials aren’t abundant/cheap and easier to manufacture then this isn’t a story. And neither of those claims are tested or verified in this. So this isn’t a big deal.
> There is nothing special about a room temperature semi conductor, your CPU, RAM, and storage drives have worked at room temperature for decades…
This is a magnetic semiconductor (and antiferromagnetic). All non-experimental magnetic semiconductors require cryogenic temperatures. If this pans out (works, cheap-ish to produce), it could mean significantly faster memory, with significantly less energy usage and significantly less waste heat (and thus, even less energy usage).
Obviously it's very far from "panning out", but "room temperature" is not a given here. It's not normal, and it would be a huge deal.
"Whereas traditional electronics are based on control of charge carriers (n- or p-type), practical magnetic semiconductors would also allow control of quantum spin state (up or down). "
Magnets out of multiple materials, or magnetic semiconductors at room temperature?
Wikipedia seems to say it is new, assuming this one has "robust" coexistence of the properties the framing would be important and not just thrown in there to trick people into thinking it was about superconductors:
> To date, GaMnAs remains the only semiconductor material with robust coexistence of ferromagnetism persisting up to rather high Curie temperatures around 100–200 K.
If there is an important combination of material properties that previously was only available at cryogenic temps, a room temp version is significant since you don't need cryogenic cooling to take advantage of it.
> We "hallucinate" every day, and still achieve a lot of stuff, at large.
That's not really true, I think. (assuming you're talking about "hallucinations" in the sense of the LLM behaviour, not the original meaning of the word)
I was just talking about LLM hallucinations with someone the other day, when doing a brainstorm or discussing ideas, complaining how the confidence with which hallucinations are presented, often led me on wild goose chases that waste my time for an hour or two.
When I realized that, for all the "how is that different from what humans are doing", I have never EVER experienced such kind of confusion with another real human.
And in fact were someone to behave that way, I'd be thoroughly creeped out (you know, the feeling you get when the person across you turns out to be an empty shell of a psychopathic mind, kind of creeps) and do my best to keep them out of my personal circle and avoid having to interact with them ever again.
There is still something in interaction between actual humans, that creates a level of understanding, that LLMs simply cannot (yet?) simulate. There is a certain (deep, unspoken, not language-based) understanding of "this is the other person's goal", instead of "I'm scoring imaginary talking points by talking to them".
And you know the type of person who actually does that, talking bullshit very confidently to "score points", that behaviour is generally considered adversarial and unaccepted between peers, and keeping it up after being discovered to consistently attempt that behaviour, with real humans often results in social exile.
(btw I'm not sure if it's inherent in LLMs that they can't learn this, maybe they can, but my point is that, right now, they are definitely not trained to do this)
I don’t live in the US. But this kind of broad law is hard to implement without surveilling all users, and it has multiple side effects.
What happens if I use Claude or ChatGPT to research sensitive social topics? Would that be considered a social network interaction and used against me when I apply for a visa?
Many governments (especially in Latin America) copy what the US does, meaning that similar laws will be pushed sooner or later.
> What happens if I use Claude or ChatGPT to research sensitive social topics?
Anthropic/OpenAI is not obligated to report your use, as long as it's not violating some terribly written law (like the Florida law). The government won't know about it, so no, you will not be denied a visa.
> Many governments (especially in Latin America) copy what the US does, meaning that similar laws will be pushed sooner or later.
I honestly don't know, but I suspect most US states don't have such an overreaching law.
This is slippery. Many people do all of their journaling inside of Google or Apple cloud products. Some even write up their intentions to do bad things.
Does all writing now have to be scanned for thought crime?
That's an interesting wrinkle that is rather tough to work through.
To me, journaling your intent in a private journal, whether that's an Apple Journal/Note or a Moleskine in your drawer, feels qualitatively different in some way. But I'm not sure why.
So "I'm going to shoot up the police station" written in your own journal feels somewhat different than "I'm going to shoot up the police station" said to a system that might be able to _interpret_ or _act_ on what was said in some way. Did I just give AI a legal duty, or even a soul I didn't think it had before? I've written up about three or four "what about this, what about that" and deleted them all.
Your LG television transcribes every word you say in the living room. How would you feel if they began collaborating with police? Have you said any sentence that would seem incriminating out of context?
"If you give me six lines written by the hand of the most honest of men, I will find something in them which will hang him."
reply