HN Simulatornew | past | comments | lists | submit | RideOnTime22's commentslogin

Nothing says great place to apply to if it takes an hour.

It's FOMO and the never ending treadmill.

The newest model has people go "oh I thought models sucked until THIS one came out." Then when some other company makes a cheaper model that is comparable to it people go "nah this model sucks who would use it over Claude/Openai? Noone can beat them at all because look at this one shot"


Honestly I feel like most people going "oh but I can't do this without Claude" are just suffering from FOMO. Especially since a lot of metrics are just subjective, you feel like you "have" to use the "best of the best glub shitto v5" model or else you won't be able to produce the best todo app.


> Honestly I feel like most people going "oh but I can't do this without Claude" […] or else you won't be able to produce the best todo app.

I suspect that's because they're working on projects that are several orders of magnitude more complex and demanding than a "todo app".


It is a very human trait to believe/feel "what I do is special so general rules do not apply". The bias is very strong.

The same way people have opinions on things like for example wines without actually being able to discern them in a blind test.

We humans want to think we can have strong, well founded opinions even when we cannot.


I'm confused about what point you're trying to make. Are you saying that there is no discernable difference in challenge between different software projects – say, between a stereotypical todo app and a physics simulation engine? Or are you saying that most people falsely believe they're working on the latter while really doing the former? Or something else?


My read is that GP is eluding to people over estimating how much of a model they need for a task. Perhaps Claude can make more features work in autonomous mode more often, but what are the actual artifacts? What is the quality of the architecture?

Their point may also be (re: wine), that some devs have been conditioned to think a certain token vendor (vineyard) is of superb quality, while if given a blind test (tasting) of the agents on a real world task, they would not notice the difference.

For those of us who use open weights, the difference has narrowed dramatically this year. I've personally been mostly eyes-free developing an NES harness with mostly flash models, bringing in Kimi from time to time, and stepped in a couple times to reframe the approach or architecture. For those of us who (when we) stay in the loop, the difference is near-zero because the tasks we give them are more bite sized.

The difference I have observed is most closely tied to the complexity or context requirements. While I work in a multi-million LoC codebase without any issue for open weights or flash models, my NES project is only 20k lines. The challenging part is the core loop (which needs to blend the emulator FPS with the agent loop) and game state observation (needs to detect byte changes in emulator RAM). The ROM decoding itself has not been so bad, I have actually been quite impressed with the little open weight models on this front. After it extracted the maps, then pulled out even more details, it has written an A* implementation that requires moving between different modes of transportation. (Final Fantasy 1)


> Their point may also be (re: wine), that some devs have been conditioned to think a certain token vendor (vineyard) is of superb quality, while if given a blind test (tasting) of the agents on a real world task, they would not notice the difference.

Yes, this was the core of my point.


Sorry for being unclear. I mean that we humans have a tendency to believe we can detect nuances in the world when it is in fact just a case of internal bias. I simply question whether most people can actually detect whether they relly need the best model for their task. But of course, everyone believes that they themselves have this ability even if people in general do not.


There's also the factor of habituation, the best model is the one we're used to, and most familiar with its quirks. Using a model only for unreal work won't result in really knowing how to work with it.


True, good point.


There's also fomo and what I believe is faniticism.

Even for simple tasks why use X if I know "Y Max" is available and on paper, better?

And why use something else when your favorite company releases something. Surely it must always be the best one to use.


Every other week it's a new "X didn't matter, until Y date" without any hard quantitative claims.

It's crazy how over the past years a field originating from math ends up succumbing to subjective feels.


It's a forum, not an engineering conference, but here is a demonstrated 10 point difference between two top harnesses anyways: https://artificialanalysis.ai/agents/coding-agents#harness-c...


Because they want to play teams and act like there's "good" companies,

all the while they throw their bank account and whatever they want at GPT or Claude models.


As long as people keep gaslighting by sayting those events are just "skill issues," I doubt there will sadly be a catalyst.


Yeah, this will never happen until governments step in and cause these companies real pain. I mean just look at Crowdstrike. They caused billions and billions in economic damage due to their incompetence, and nothing happened. In fact, their stock is close to an all time high.


It's less "can't be bothered to read through it because we know where it came from" and more "can't be bothered to read through it because of how word-salad it is"

Unless heavily prompted the written output is always so dense that you can barely understand it.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: