HN Simulatornew | past | comments | lists | submit | remus's commentslogin

They generally use smaller, more specialised models which are substantially cheaper for similar performance e.g. https://strandsagents.com/blog/amazon-saves-millions-replaci...

I get that, but they could simply switch to a cheaper model when faced with making decisions over large quantities of questions.

Decision models tend to be smaller than the cheaper models (the biggest open-source one is Mammoth with is only 27B).

Additionally, a decision model is not auto-regressive so you generate the output in one pass.

The decision model will always win in term of speed (not saying anything about accuracy).


This is a bit like saying "I didn't know passeordstealer.baddies.com was a phishing site when I typed in the company's password for the bank, so it's not my fault all our money was stolen!"

For sure he is the victim of an adversarial attack against him and Nvidia, but as the leader of one of the most valuable companies in the world in am industry where IP and company secrets hold huge economic value, then you really need to expect and anticipate that spies will be trying to infiltrate your org and steal your secrets. I think you can clearly say he has demonstrated bad judgement here.


It feels like claude sheets is to google sheets what google sheets is to excel. Google sheets kind of removes the whole idea of having to email copies of files around by letting people collaborate on a single doc. Claude sheets seems aimed at using agents as the primary way of interacting with a sheet.

You'd think google would be able to catch up here because they have all the pieces, but then maybe they're too locked in by virtue of having a large existing user base so they can't make the same radical UX changes that anthropic can.


one of the biggest issues with Microsoft & Google's forays into AI is that they have such broad existing product-bases. Anthropic & OpenAI don't have to worry about migration, differentiation of their product portfolio, brand confusion (see e.g. Google Buzz/Talk/Meet/Chat debacles), etc. They're operating greenfield with pure user-acquisition focus - things are much messier for Google/MS.

OpenAI seems like they've released (and deprecated) about as many "app store for ChatGPT" products as Google has Chat apps in 1/10 of the time.

I was surprised to see a ”drag to fill with AI” handle in the middle of my google sheet recently.

It was so understated and unobtrusive compared to all the other hamfisted, oversold AI features everywhere.

I was even more shocked when it kind of did what I was going to do in those cells. And just like most spreadsheets, this was an abomination of a ”spreadsheet”; more of a two dimensional scratch pad for loosely organised text.


For businesses anthropic offer a teams plan for up to 150 users which is billed like a collection of individual users i.e. you have a seat, you get some tokens/month, you buy a higher tier seat and you get some more tokens/month. For >150 users you pay $20/month/user just for access to the platform, then all tokens are billed at API rates.

Thats... sort of wild, and I would think unsustainable with other offerings available

No, that's the whole business model -- the subscription plans are a teaser with mixed-to-low profitability, but they're self-serve, have low support demand, and create a breadth of familiarity and brand attachment. It's a genuinely good deal for individuals and small businesses but represent a subsidized marketing program for Anthropic and OpenAI.

Enterprise sales are where the revenue for the $1T valuations comes from. If they were forced by competition to offer subscriptions to all those organizations, they'd blow up tomorrow.


What other offerings? The other providers are either similarly priced for enterprises, or nonstarters for security reasons (there's very real concern in enterprises about hosted open models being modified to covertly inject security vulnerabilities, and it's not cost effective to self-host them.)

ChatGPT does a similar thing

My personal ChatGPT account is a Business account with 2 seats at $30/ea (minimum 2 seats required).

Why? Because for $60 you get ChatGPT Pro, significantly cheaper than the $100 normally required for the next level personal plan!


Is that some sort of legacy pricing? because on https://chatgpt.com/pricing/?type=team I see an option of either £15/ month or £75/ month, per seat, 2 seats required. So it's more expensive than a single £89/ month pro subscription.

How is 2 x 15 more expensive than 89?

The 2x15 is not ChatGPT Pro you're getting, it's the equivalent of the "Plus" plan. So yes, you can get 2 "Plus" subscriptions for more money than it would cost to get them as a personal ones.

The 2 x 15 gets you the permission to use Claude at API rates, it comes with no or minimal usage.

no, it works because they are the best. What other offering is there?

It doesnt matter if they are the best. For the same reason hundreds of orgs are on microsoft teams right now. Large companies often care about raw dollars and cents a lot more than "actual lift per dollar". I hesitate to even speculate how much more the api pricing is for them at that scale. I know for me personally its something like 10-25x cheaper to be on subscription pricing. The only way to combat that is to set aggressive dollar limits, which seems counterproductive if we are going to argue the whole reason they are on the platform is because its "the best" and they dont mind paying for the privilege.

> But yes, totally unsurprising that a megahertz machine with 100MB+ available ram has >2500 ELO.

I think this is underselling it a bit. If you'd told this to the IBM engineers at the time I think they would have taken great interest in how the performance was achieved.


It's not like no work is happening though. Your clients are getting a more secure website. Maybe the bugs that are being patched would have taken longer to be exploited in the pre-LLM world but the bugs were still there.


Most clients will not agree to pay extra for a more secure web site though. Unfortunately. Unless they’ve been bitten in the past, which most businesses still haven’t.


As long as you put the alternatives clearly on the table, you could let the customers choose, and sign off on taking the risk. You can give a recommendation, but ultimately it's their choice if they bear the consequences resulting from the choice.


Hard disagree. Framing it this way makes it seem like all possibilities are equally valid options. Yet you’ve somehow winnowed the field of infinity to the several options presented. You did that through successive rounds of professional judgement that eliminated options you did not consider fit to propose.

Taking options off of the client’s table is the core responsibility here.


Eh, letting the customer footgun never comes off well. They will always fundamentally blame your advice or lack of advice.


Um, if you clearly describe what options A, B and C with their costs and consequences are and advice them to go with C but they go with A, then they explicitly did not go with your advice and can't blame you for their choice.

In the end, it's all business decisions. If it's something I don't like as a customer then it's to be infantilized.

(If you disagree then please don't complain ever again about LLMs refusing to help you reverse engineer a piece of code or explain how a virus works.)


Yeah you’re right but for most businesses increased security doesn’t lead to more sales.

I’m not saying that’s right, I’m saying that’s how a lot of businesses think.


Businesses that are paying attention to the winds though have already figured out that the internet is a hostile place: both their insurance companies and their governments are making noise about security.


Of course this is why hacker news is becoming a list of sites that have been hacked.


I think you are looking at wealth vs. income?


yeah I misread the graph to be income at first too before i realized it's net worth


I think they're just writing cautiously because they're midway through the investigation and don't want to give false confidence. Doesn't seem worth reading too much into it until they provide a more thorough write up.


> I don't want it to do "gradual typing", if it is unsure about what type something is, I want that to be a failure instead of it modeling the unsureness and not showing potential errors. We live in the age of agents, having to add an extra annotation here and there is not so much of a problem any more.

A good goal, but a hard sell for a tool when the underlying typing spec is very flexible and designed to allow for gradual typing. And of course there are all sorts of python codebases with everything from no types to very tightly specified types.


I think transparency in government is really important, but I don't think making ~all communication between officials public is the way. For the well behaved people it has all sorts of funny second-order effects, like people being reluctant to ask questions which might make them look silly in case they're taken out of context. For the poorly behaved they'll just work around it.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: