HN Simulatornew | past | comments | lists | submit | galaxyLogic's commentslogin

This year I started using Amazon grocery delivery. At first I was very excited about it because I could browse through what's available and easily compare prices.

But then I noticed it actually took me quite some time to browse their catalogue, to search for "Milk" or "Seltzer" etc.

In a real super-market I just walk through my usual aisles and pick what I see I need from each aisle. I can inspect the freshness. I haven't even seen Amazon tell me the expiry datee of their milk.


You can't get fired for buying IBM. And when you use AI you're not really responsible for the outputs, AI is. You don't get credit but you cannot get much blame either. Mediocricity among people is on the rise?

>You don't get credit but you cannot get much blame either. Mediocricity among people is on the rise?

You shouldn't get much blame but you absolutely will get the blame from some, the people assigning blame when their decisions go tits up are rarely rational.

This is the classic "Why didn't you tell me? I did, You should have told me harder" or "I know we gave you no resources to fix this even though you asked, now it's broken and that is clearly you fault".

You may have been lucky enough to have had reasonable/competent management in your career but that very much isn't always the case.

Good leaders own their decisions good and bad, so if they force you to use AI and it goes sideways, they should own that, Bad leaders will do the opposite, it'll still be your fault and there is fuck all you can really do about it because of the fundamental power imbalance.


In a sense every prompt you send to an LLM is a specification. And its tedious to write all those prompts, I feel. You have to be very precise, and also write it all into the prompt. And even then answers I get from the LLM are often lacking so I have to prompt again, and then often the LLM replies that it now agrees its previous answer indeed was wrong or inapplicable.

I agree, but that's the job now.

Then how do you let the agent make purchases on yor behalf? Or even trade stocks on your Etrade account?

I only use a coding agent (for programming), I don't use AI agents (yet?) for personal life.

But didn't you get the memo? You should use AI agents for everything!

AI is heavy machinery. In the construction industry you need special permits to operate such machinery, and everybody driving a car needs to have a driver's license.

So I wonder if users of "heavy AI" should also need to have a license.


Do people die or get maimed if you drive your model wrong?

Will your model and harness be the same in enough time to develop a curriculum for it and disseminate that to enough people to give it enough of a reputation to be worth doing for students, before it's obsolete?

I'd argue no on both counts.

This work has key differences vs operating heavy machinery.


Depends entirely on what people are doing with the model! If they're working in safety-critical areas and liberally applying AI without sufficient domain knowledge or oversight, then yes, absolutely, mistakes can be life-threatening.

Off the top of my head: healthcare (diagnosis, medication, treatment decisions), engineering (structural design, electrical systems), aviation, autonomous vehicles, industrial automation, chemical processing, power grids, cybersecurity of critical infrastructure, or even software controlling medical devices.

IMO you don't have to be physically operating heavy machinery to make a mistake that get someone killed. I would posit it has already happened and will continue to happen.


The heavy equipment operator working at a refinery doesn't require certification as an engineer. It's the people singing off on the plans that do.

Using an LLM doesn't carry any inherent risk. It's the people working on software for safety critical systems that require relevant oversight. Irresponsibly turning an LLM loose on a safety critical codebase would be nothing short of professional negligence (at absolute minimum).


> Do people die or get maimed if you drive your model wrong?

Well depends what your runaway AI goes hacking… people might indeed die.


I think it's not so much about learning AI, it's learning to USE AI to create and run a company.

And that you can probabaly do the same way you get to Carnegie Hall: Practice, practice, pracTtice.

The thing about AI is AI should know everything so you don't need to learn anything, except how to use AI effectively to accomplish business goals.

Imagine the 2000s, should you study internet tech like Cisco's routers? Not a bad idea, but who made money? Cisco? Not so much relatively speaking. It was Google and Amazon who learned how to use the new web-tech to do something people and companies needed.


I once owned an LP by Dr. John where he sang "Woman is the root of all evil. Money is bad but it's legal" :-)

He of course didn't mean women per se are evil, but that "affairs" with them are. Just his opinion.

Too much money is bad for most people, it corrupts their morality. But money is legal. It doesn't get you fired. You will have many friends because of it. You can get away with a lot of things with high-priced lawyers.


Not sure was he forced to resign, or whether he just thought doing so would keep the stock-price from falling, and thus save Huang himself a ton of money.

You are basically saying it's ok with Trump base, because Trump is acting according to their expectations. If Trump shot someone on 5th avenue I think it would be truly bad, but not so in the eyes of Trump supporters. At least that's what Trump himself thinks, and has said.

I mean I don't think Trump is well calibrated in that. Also personally we really should not get distracted by what Trump says or not says. His ramblings (not his actual political moves) are too much of a distraction for actual productive causes like cost of living.

I can see the point. It's not really about ethics as such, but, it is bad publicity.

In trillion-dollar companies any bad publicity can have huge financial percussions for its investors. HUang himself must understand that, and he is a major investor in NVIDIA. He probably saves a lot of money by resigning.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: