I used Grok Bot and gave it all my financial details and connected it to my wor...

hoppp · 2026-10-10T15:33:52 1791646432

Sounds like the problem was the human, not the LLM.

Whatever data goes in, it will output it in some way. Humans gotta understand that.

tempest_ · 2026-10-10T15:48:17 1791647297

Sort of, and in this case definitely.

"Agents" can be very "persistent" and when not sand boxed appropriately can get at things they were not meant to get at. Even if its only 1/1,000,000 that one time that one time is going to keep making the news

Explaining that to the general public when facebook is pushing Muse on everyone will be difficult so its going to get worse before it gets better (if it gets better)

logifail · 2026-10-10T15:57:00 1791647820

> "Agents" can be very "persistent" [...]

I've had that within the last few days.

I happened to be vaguely watching an agent at work on a longer task and spotted it attempt to find a way around not having access to a local service that would greatly help it achieve the task, I immediately chimed in with a "STOP! if you need access to X then just ask!".

I suppose my prompting could be improved :/

panarky · 2026-10-10T17:30:26 1791653426

> prompting could be improved

You can't stop an agent from leaking your information by telling it not to leak your information.

To prevent information from moving between your work domain and your personal domain, or between your communications-with-board domain and communications-with-journalists domain, then the agent for one domain must be physically and deterministically blocked from accessing information in other domains.

vorticalbox · 2026-10-10T16:22:13 1791649333

I had an agent working on a bug decided the fastest way to fix this was to write one off javascript scripts that loaded the database uri and query the data.

I mean it’s not wrong but I was like maybe not do that without asking first.

watwut · 2026-10-10T16:05:41 1791648341

Not so much prompting as network restrictions.

InsideOutSanta · 2026-10-10T19:45:52 1791661552

The problem is neither the human, nor the LLM. The problem is companies selling a faulty product and telling people to connect it to their bank account.

toppa33 · 2026-10-12T01:48:45 1791769725

100%. Having something as simple as a name be the thing that inadvertently publishes sensitive data is a product / judgement fault. You can’t ask for the keys then not know what to do with it

talon8635 · 2026-10-10T16:47:52 1791650872

Maybe. But if these tools are marketed for this dangerous purpose, and average users are totally ignorant on the risks, then it’s a system designed to fail

grey-area · 2026-10-10T15:51:28 1791647488

Or perhaps the problem was that AI companies have sold LLMs as intelligent agents, and not word generators?

Humans will continue to mistake these 'agents' for agents with agency and understanding because of the way they are sold and described.

MattDaEskimo · 2026-10-10T16:15:00 1791648900

Exactly this. Why does nobody blame the company advertising "connect your financial & health data to our model"?

Why is it that somehow LLMs are given full clearance to dox, hack, spam, and scam without any liability?

lotsofpulp · 2026-10-10T16:16:58 1791649018

I expect people to do at least some due diligence, and adults to be skeptical about lofty claims in marketing.

runarberg · 2026-10-10T18:09:08 1791655748

And I expect regulator to take down dangerous, damaging, or otherwise user hostile products away from consumer markets.

I guess we don‘t always get what we expect.

watwut · 2026-10-10T17:12:29 1791652349

That creates incentives to lie, A/B test your lies and when they finally work, blaming everyone but the liar.

simonkagedal · 2026-10-10T17:25:34 1791653134

So are you saying that if they were intelligent agents rather than word generators, they wouldn’t make mistakes like “send a message to the wrong (similarly named) group”? Are humans intelligent agents?

runarberg · 2026-10-10T16:00:29 1791648029

Foot guns are not fit to market and under any sensible consumer regulatory framework are recalled and banned until proven safe.

AI products are not regulated like every other consumer product. If your bank’s app had a big green “share” button shadowing the “close dialog” which shared your personal info in the same manner, any sensible regulator would like a word with your bank’s IT department. If your teller handed you a paper with a small print saying “by signing you approve this transaction being shared with your boss” likewise regulators would put a stop to it.

leptons · 2026-10-10T16:17:33 1791649053

Why hasn't Venmo been investigated? The amount of financial transactions that I don't want or need to know about is bewildering. People don't seem to know or understand their transactions are public by default.

runarberg · 2026-10-10T18:05:58 1791655558

For the same reason XAI hasn’t. Just because regulators are bad at what they are supposed to do, doesn’t mean they ought to be.

willmadden · 2026-10-10T16:00:43 1791648043

The thing most people here don't understand: all CEOs are sales people, and only some of them are technical.

Brian_K_White · 2026-10-10T20:43:54 1791665034

Silicon Valley (the tv show if not the real thing) showed us that CEO is about as meaningful as "car owner" or these days "President of the United States".