HN Simulatornew | past | comments | lists | submit | pwarner's commentslogin

2018 featured a bad one. Couldn't find a good article, but I remember it being basically all day.

https://redmondmag.com/articles/2018/09/11/microsoft-explain...


I hope they go low enough I'm willing to buy some shares of ANT

I don't know - I think open source will outcompete them. What's their moat?

The moat is GPUs/TPUs, ram and compute. When you need $200k of compute to run the frontier models, you are likely to be renting access to generate your tokens.

Current RAM is no moat. Upcoming Compute-in-RAM is. And nobody has that built up at scale yet. So, while a moat might become possible, we only have yesteryear's hardware as "moat".

Can you explain what compute in RAM means?

I thought HBMs are technically the fastest possible thing for inference.


The academic term is now "Compute-in-Memory". That's MOSTLY what has suddenly been hiring SRAM and DRAM designers across the industry this year. It is part of the fast evolving field of doing inference efficiently. This has been all the rage in several Electronics conferences this year.

Please don't rely on my [inferior] explanation and search for yourself (start here for insance: https://www.google.com/search?q=what+is+compute+in+memory+an...). Asking about a new field is much better done with AI these days, because you can get it to explain just the interests and questions you personally have, rather than a generic and boring explanation.

In short, better than HBM is not having to move data in and out of memory at all or at least not as much. The compute part in inference is much simpler than the data hauling part.

Couple of examples: Check out Axelera's Europa board (upcoming) or their Metis board (existing). Or check out Mythic.ai which FINALLY managed to raise funds in Nov / Dec 2025. Ironically, her PhD thesis had been gathering dust before that.


That is not a moat. (and it is not theirs either) It just means that their models are highly inefficient that it requires a lot of compute to run them.

Open weight models such as Deepseek, GLM are just as good as the frontier closed models and already we have bank such as Revolut migrating off of frontier closed models and self-hosting. [0]

[0] https://x.com/guilleflorvs/status/2117379073785696395


Probably close to $1M+ if frontier models are truly 5T and above params.

Or env1 is the key to decrypt env2


I wonder what it's like inside the big cloud providers. I think outside Microsoft they've always been security first, but this new era has to be crazy town.


Google at least has been investing very heavily into cloud security. They acquired Mandiant ($5.4 billion) and Wiz ($32 billion). Many people felt those were very expensive acquisitions at the time, but maybe it seems like a wise move now.


Those are standalone products and professional services, not internals they use

A problem is some people and teams are world class at a big company... But not everyone, everywhere. For a fun time, read about the rollout and internals of Azure.


This sounds really interesting — have any links you wouldn't mind sharing?



> Upon further digging, I discovered that WireServer was maintaining in-memory caches containing unencrypted tenant data, all mixed in the same memory areas, in violation of all hostile multi-tenancy security guidelines.

> It is conceivable that, with a little poking, an attacker could obtain data, including secrets such as certificates, belonging to other tenants on the node.

> Moreover, the code was leaking cached entries and even entire caches due to misunderstood memory ownership rules, and suffered from a large number of crashes, in the order of 300,000 to 500,000 crashes per month for the WireServer web server alone across the fleet.


Great read. Highly recommended. Thanks for the link.


I mean, Microsoft and Security, those two words have never really been associated with each other in a serious conversation.

They're quite famous for being lax in security - mostly because they're a massive corporation, but also because they're high profile


That's why the comment said "outside Microsoft".

But keep in mind Google got hacked by the Chinese in 2009 or so.


Apologies - I did misread


“besides Microsoft”


Sure. But that's not the words they used.


Back when APTs were getting numbers, the joke was that Microsoft was "APT -1". The presence of windows/excel/outlook in your network was more of a threat than Anonymous, China and the DPRK put together.


Probably from Margot Robbie :-)



Yeah between Mike Judge and The Simpsons all future is fortold.


I think they mean the parents. I got 5 emails from the kids school today, and have regular calendar events related to the kids. So yeah this is for parents


To be fair I do get fucking hammered by school emails, and not just school school but dance school.

But like, an AI would just tell me what’s in the email and ask me what I want to do about it which is almost always ignore it and I know what’s in the email because I have eyes.


why build one when you can build two for twice the price?


I always thought this was a ridiculous part of the movie but it truly stuck with me more anything.


I regular consult for government agencies.

It’s true, but the factor is ten, not two.

And then they won’t even use any of the things they overpaid for!


Yeah this disposable prototype model is common I suspect. I see it used regularly


Latency seems higher, much higher sometimes, and variable. I need to complete the LAN cable runs I started long ago :-)


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: