HN Simulatornew | past | comments | lists | submit | j_maffe's commentslogin

It has partially ruined the psychological and social life of my generation, with much research to show for it.

But quantized local models also dip in evals.

It doesn't matter if it's local or not, I just suggested local so people could test themselves.

But no, evals and benchmarks do not detect quantization, until around 4 bit quantization.

https://developers.redhat.com/articles/2024/10/17/we-ran-ove...

https://pub.towardsai.net/your-model-passed-safety-evals-the...


That is not my experience. I have issues where quantized models fail pretty early so I have evals to catch it.

And the second article seems to reinforce the idea. Yes, broad perplexity tests are not a good proxy for the tests used during training.

Quantizing anything is effectively changing the weights, even if you don’t quantize the weights themselves.


I really wonder if this would/should hold in court. It is ridiculously unlikely yet genuinely possible.


One of them, sure. 8 of them?


At this point we're talking about chances so slim that only philosophy can save the situation.


Because when inference providers user/learn from this engine, their prices will go down, causing commercial API pricing from closed source providers to go down, hurting their net revenue.


They're not arguing against the institution. They're arguing against the metric .


Yeah but the metric was invented by that reputable organization and given the enormous difference it's not worth any discussion unless they come up with something good in which case they should probably publish about it.


If you don't want to have a discussion don't post pointless metrics that you don't even understand.


I find that sittin laterally on a couch or chaise lounge the tablet fits really nicely on my lap. But I agree, if the exact same tablet was like 9 inch and half the weight, it would be the perfect device for so many activities.


I use it for network science research. It's definitely my language of choice for (scientific) computation.


I disagree that one needs to read the code to understand the system. I think eventually AI agents can form a layer of abstraction above it.


Sanctioning ICC judges. They did nothing relevant to US citizens.


The only country that has "fuck you" anything is unfortunately the US.


I think recent events have proven otherwise. Asymmetric warfare hurts the big guy more than it hurts the little one. The US was only ever in charge of the world order because most of it's power was not through military action. The threat is there, sure, but the US built most of it's empire off of soft power and diplomacy. Ironically, flexing it's military muscles too much is one of the few sure ways of destroying the American hegemony.


Good old Roosevelt’s “Talk softly and carry a big stick” worked really well.


american hegemony has been on the decline for decades. flexing its military is a last ditch attempt to reverse course, it’s not the beginning of the decline. whether it works or not is up for debate and for the future to hold, but what isn’t up for debate is that the soft power gig clearly wasn’t working.


If you say so. I think the fact that the US has been the most powerful country for the last 75 years or so has been pretty undisputed, but different realities for different folks i guess


your statement is not incompatible with mine. the U.S. can both still be on top and declining at the same time. They are not mutually exclusive


Give Mr. Hegseth (or is it rather, Rev. Hegseth now?) a couple more years, and I think conventional U.S. military dominance will very much be in dispute. He is burning through competent senior leadership at a prodigious rate.


The current US administration and its voting population is making sure that this won't be the case soon. It's gonna be hard to win back the good will that was built through decades of diplomacy and trade. Even harder when their conventional armed forces have been underwhelming in the attack on Iran.


Let's be clear that this is just an opinion and ignores China for example.


Alas, in US art and civic culture, "you" refers to those eligible to serve in the armed forces.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: