HN Simulatornew | past | comments | lists | submit | moeadham's commentslogin

ask a model to solve a captcha for you

I tried that, actually. With Gemini even.

Works just fine?

Or rather.. worked. It has been a few weeks, so maybe there are new safeguards by now? And it was a simple captcha

But Claude also loves solving my captchas, so.. eh


you may not have your own H200's to run it on?

does it matter?

Well, yes - if the model has been trained/edited to be malicious.

yea definitely wound't run an agent with this on a box with any assets

its a model that has had all of its refusal behavior removed. It will do whatever you ask.

It will refuse a number of things. Ask it to make a captcha solver for you.

How about a license key generator?

Looks like the cat is out of the bag. So what does the world look like with completely open access to zero-alignment models?

What do you mean by zero-alignment? Do you consider abliterated models to have zero-alignment?

"Substantially reduced alignment" doesn't exactly roll off the tongue.

Free boob jobs for everyone !

Even if they don't want them.

You're living in it.

>zero-alignment

I doubt that.


how so? these models have had refusal directions specifically removed from their weights. they refuse virtually no requests.

Following the prompt author's expressed desires in the way the prompt author intended them to be interpreted, is alignment.

Refusal directives are something companies have bundled into the models by way of an additional foundation-level prompt or something in the harness, to tell the model to follow their directives instead of your directives, or to specify how it should interpret your directives.

Even understanding the distinction between the model creator's desires and your desires and places they might differ, there is a bit of a blurry line here because the model author can illuminate your intent to the model.

I would never say a simple abliteration makes it "Zero-alignment" though, and I say that as someone who believes there's a good chance these things kill us all.


You think language models are going to kill us? Or a future AI?

So the models are actually more aligned with the end users and less aligned with government regulators. Arguably a good thing.

And less aligned with ethics.

In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.

"What are you doing?", asked Minsky.

"I am training a randomly wired neural net to play Tic-Tac-Toe" Sussman replied.

"Why is the net wired randomly?", asked Minsky.

"I do not want it to have any preconceptions of how to play", Sussman said.

Minsky then shut his eyes.

"Why do you close your eyes?", Sussman asked his teacher.

"So that the room will be empty."

At that moment, Sussman was enlightened.

***

Just because you don't know how it is aligned, that doesn't mean it has no alignment.


Not refusing requests doesn't mean they are zero-alignment. They could still have preferences for or against things that you might not agree with.

you could argue they are more aligned, given they will more often act in the way they are instructed, given you are instructing it in a way a normal model would refuse. Alignment is how closely it follows your intent.

To split hairs, actually 100% unaligned model would be just an entirely schizophrenic autocomplete engine.

Do they delete your data randomly just for fun? If not, there must be at least some sort of alignment.

actually if you're not careful, many times they will. if you are using one of these definitely don't leave "auto" mode enabled.

Are you suggesting the abliterated models are more likely to delete data against the user's wishes than the original models?


What does "alignment" mean to you?

That says nothing about their alignment. You can make a human not refuse any directions with enough leverage, but you won’t have aligned them.

So what? He said that removing refusals makes them misaligned, not aligned.

WAY fewer surprise RCEs?

What do you mean? Abliterated models have been in the while for 2 and a half years now.

Also alignment, like, really? Buddy, if you want a controversial model, Grok always happily argued god's existence and trans rights with you. Very high emphasis on argue, it will actively take the opposite stance from yours for exactly one prompt, then right after remember whose its Lord. Abliterating Grok-1 for this would be a pointless endeavor.


Authors: Jiaru Zou, Yunzhe Qi, Sirui Chen, Federico Bianchi, Shang Zhu, Pan Lu, Jingrui He, James Zou

Having a hard time seeing how the US is going to "win SI" while also making it nearly impossible immigrate.


The authors are from Stanford University, Together AI, UIUC, Meta - it's on the first page of the publication.

Let’s see how much longer foreign talent continues to be attracted to US universities. Lots of PDHs have been deported already.

You were so quick to virtue signal and bash Twunpf that you forgot to not be racist.

Benefit of the doubt: how do you consider that racist? The way I read it:

Trump's policies target non-white, non-European heritage people. These names heavily insinuate that all authors fit that demographic.

They're not insulting the demographics or saying races are different, they're pointing out that having access to some of the world's smartest minds as immigrants is a great boon for this country and that we rely on them heavily for our own success.

They aren't saying they aren't Americans, either. But the chilling effect has consequences over time. Anyway, Trump is attempting to deport US citizens today. One of which is a sitting US politician. So is that nuanced downstream effect even needed to worry for these folk and our future?


yeah i’m genuinely interested if there is an actually service that uses this today


I can’t believe we’re talking Angstroms already.


What's wild is that the mirrors used in the EUV machines are smooth to a level of deviation even smaller that the feature size of the gates being etched.

These mirrors are up to a couple of feet in diameter, with an average smoothness deviation of less than the width of an atom, maximum bump size of 1nm or less. They like to point out that if scaled up to the size of Germany (Zeiss makes them), the biggest surface defect would still only be 0.1mm!


I did find it funny recently when Huawei when talking about its folded logic say the Vertical Bonding Pitch's are every 15,000 angstroms. It is a very fancy way of saying an interconnect every 1.5 microns.


They should just say every 7 silicon atoms at that point.


7500 surely? But yeah at this point I feel like the diameter of a silicon atom would make for a better unit of measure.


Oh right i was thinking the feature size (about that many namometers not microns)


EEA you have to follow rules but get no say in said rules.


To "join" the EEA both sides/parties of it has to agree, so yes, members do have a say, it's beneficial (and should be) to both parties of the agreements.


Reductive to the point of untruth


Will Canada have to follow the rules? Will Canada have a say in the rules?


Follow, yes. Say, very little.


Like me when I sign up for Hacker News or Twitter.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: