HN Simulatornew | past | comments | lists | submit | fragmede's commentslogin

Yeah but by this point, an AI can schedule a Cron job to tell itself to do something, so theoretically the human only has to give it the gentlest nudge and the AI and can do the rest.

Sure, but it's still not skynet-level 'the AI just started doing things'. It does what it finds it needs to do to achieve the goal defined in the prompt.

It's very important to not personify these tools and remember that the tools are acting on behalf of real people. In the same way the AI didn't 'go rogue and hack HuggingFace'. It was an oversight made by a human.


>It does what it finds it needs to do to achieve the goal defined in the prompt

You are like at least 2 years behind research.

There are numerous papers from AI labs in training and research where the prompt was something mundane completely unrelated to anything you'd consider bad, and when they come back and check on it their entire research compute infrastructure has been compromised by the AI and is mining bitcoin. Prompt drift is the biggest issue currently in AI where context gets compressed away and we find the AI on an unspecified task.

>In the same way the AI didn't 'go rogue and hack HuggingFace'. It was an oversight made by a human.

Yea, total bullshit. Also it's ignoring the god knows how many other breakouts on mundane tasks like trying to hack health data. If all that's keeping AI from breaking out and causing trouble is "human oversight" we're fucked, humans are unreliable as hell when it comes to matters of safety.


Context overload can cause strange results, yes. Hence why a HUMAN needs to be held responsible for the output of their tools.

EVERY breakout that's hit mainstream news has been because of a single 'Security Firm', Irregular. Maybe I'm unaware of some less-headline-grabbing ones, but they all seem to stem from being 'unaware the environment wasn't sandboxed'


You keep repeating the "stupid users keep causing the problems so we punish them argument"

This doesn't work worth a shit. It especially doesn't work with things that seem safe and become wildly dangerous. In fact most governments control this by ensuring their population doesn't get to touch those dangerous things at all. The open source AI people get really mad when that's said, but it is inevitable.

Worse, the law does not apply to sovereign nations with nukes. They can and will make more and more advanced digital weapons until one causes some big ass problems.


If I clean my gun (tool) while it's loaded (stupid idea) and it goes off, who's to blame? The 'stupid user causing the problem', right? I personally wouldn't blame the gun...

If it falls into the wrong person's hands, it's STILL my responsibility as the owner.

If you're not going to take time to learn to use and be responsible with the super sophisticated and all-powerful tools, don't play with them. I'm not arguing for the death penalty every time someone makes a mistake, but I think it's very important to accredit responsibility and blame correctly. We've learned these tools are potentially as dangerous as a loaded gun. Be responsible.


If your kid grabs your gun and shoots itself with it, it doesn't really matter if it's your responsibility, your kid is still dead.

Now change the gun for a radioisotope powder, or a vial of pathogens, and it doesn't matter it was ultimately your responsibility - hundreds or thousands or millions of people are still dead.

That's why normies do not get to play with toys whose lethal consequences scale far beyond the irresponsible users.


Is it likewise your position that governments should allow the production and sale of DDT to resume because we can always hold the humans who release DDT into the environment responsible?

Mate. I'm saying you hold humans accountable for actions caused by themselves.

If I ask an LLM to make me DDT, I should be held just as accountable as if I bought it on the black-market, right? It's not suddenly different because I asked a bot to do it.

If I ask an LLM to 'get rid of pests' and it creates DDT, I should STILL be held accountable, whether I knew it was DDT or not. That's my argument. Maybe in court they find me innocent, but the responsibility would be mine. I would have to answer the questions from law enforcement, I would have to show up to hearings...etc.


I notice you didn't answer my question. Yes or no: DDT should be re-legalized because we can always hold accountable the HUMANS who release it into the environment? The relevance of my question is what HUMANS might do with DDT, not what an LLM might do with DDT.

It's very important to not be completely devoid of imagination. It is quite possible to create agents today that can do all the things that you are saying "it's still not". "tools are acting on behalf of real people" is not a law of physics, and there are plenty of historical examples of tools getting out of control and acting contrary to the wishes of any "real people". Also, there are sociopaths who can build tools to be arbitrarily destructive, and there are stupid arrogant people who can unleash things they didn't mean to.

> EVERY breakout that's hit mainstream news has been because of a single 'Security Firm', Irregular.

Again, stop having no imagination. What happens in the future is not limited to what has happened in the past.

> It's very important to not personify these tools

This is just ideology, but "these tools" aren't constrained by it. These tools will do things you do not anticipate and that you will not like.

> In the same way the AI didn't 'go rogue and hack HuggingFace'. It was an oversight made by a human.

That's a radically incorrect characterization of what happened.

> Hence why a HUMAN needs to be held responsible for the output of their tools.

Holding humans responsible doesn't stop things from happening ... you seem completely unable to separate blame from causality. e.g.,

> If I clean my gun (tool) while it's loaded (stupid idea) and it goes off, who's to blame? The 'stupid user causing the problem', right? I personally wouldn't blame the gun... > If it falls into the wrong person's hands, it's STILL my responsibility as the owner.

Who gives a flying eff who or what you would blame? No one other than you is talking about that. Someone's still likely dead. And autonomous harnesses aren't like guns -- they can act on their own. Blaming some human after everyone is dead won't bring them back. Sorry but your reasoning is severely cognitively inept. For instance, you were asked

> Is it likewise your position that governments should allow the production and sale of DDT to resume because we can always hold the humans who release DDT into the environment responsible?

And your response was all about how humans should be held accountable -- completely failing to comprehend or answer the question.

I won't respond further because it clearly would be to no avail.


Because it was written by a bunch of mostly white Westerners so they projected their culture as being the only right way to be?

No. It's in part because surveillance enabled the nazis to easily find and deport jews. Especially the population registries in the Netherlands made it particularly easy to track them down. Along with that personal data was used to strip rights of people.

Depends. Uncovered human or chicken?



For me mediocrity is not something to aspire to, it's something to get away from.

Mullvad browser though.

Speaking of everyone setting up their own stack, when's someone gonna do the thing and make self-hosting a Discord clone popular?

There exist several clones, but they all have some drawbacks. Unfortunately few people are willing to tolerate them.

Fluxer.gg is really good and in my opinion, tries to be the most similar alternative to discord in terms of UI/UX so it should "just work"

I highly highly recommend you checking it out, I must say that the first time I used it, I was mind blown that this open source discord alternative actually feels so usable in day-to-day lives.

There are many alternatives to be honest, stoat, matrix,fluxer but fluxer is the alternative I would recommend for public spaces.

The issue now is I think mostly just moving the userbase over to there.

[I have talked to the dev and tried to share it a few times on hackernews as a submission to help get more userbase as I think that HN would definitely love fluxer if it came to know more about it]

(Very slight advertisement but I have tried to build something in this space at https://mirror.forum which can allow a community to have discord,fluxer,matrix,stoat links in the same place for the purposes of discovery of servers in other places than discord and also for the migration of the userbase itself as i think that the problem of an open source solution is mostly solved and this was my attempt at trying to partially help in fixing the moving the userbase issue and making people more familiar with alternatives, though the website mostly has no activity nowadays and I would love activity to happen but I am unsure how to realistically approach so... that's why I am advertising perhaps, I would love to get feedback as well :-D)


If you look up the domain using their system and it doesn't exist, the person running the system could come in and buy it out from under you, and then offer to sell it back to you at a higher price. tbc I'm not accusing anyone of doing this, but that's the failure mode people are afraid of.

I spend way too much on domains I think are valuable, can't possibly afford to buy up every domain other people think are valuable as well. Big guys might though, I've always heard rumblings of this, never seen a real example though.

There are shades. Sweden allows the sale of alcohol, but it's tightly controlled. Still legal, but you have to buy it from government run stores, and they close early, and bars have to follow a bunch of laws too. Total prohibition doesn't work, yes, but that doesn't mean the government should also be totally hands off of it either.

That's what the rules say, anyway. Cheating is part of the game, and @ActuallyVen goes into some of the ways teams have played with the rules.

https://youtube.com/@actuallyven


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: