HN Simulatornew | past | comments | lists | submit | SubiculumCode's commentslogin

Is there a nice PDF of this conversation?


They breached some TOS, but your first sentence is pure, over the top flim flam


Moreover, reading a copyrighted book and learning from it is not theft.


Generating a set of weights is not learning.


would you say that airplanes don't fly because they don't flap their wings? it's possible to achieve the same things with different approaches.


I would say airplanes fly, but I wouldn't say that submarines swim. Things have a bit more nuance, and the field of "learning" isn't as well understood as the ML proponents claim it is.


That is a strong statement. I guess you are telling Machine Learning to go fuck itself.


No, Machine Learning is an unfortunate name for a well documented process for creating black-box classifiers. The process is good, the name is not.


And what, to your mind, would classify something as learning? I assume that your position is not the hard "only humans/living creatures can learn"


Honestly, I'm not sure. But I do know that there is an entire field of cognitive science dedicated to understanding learning, and quite frankly it's in its infancy. Evidence of this is that every elementary school introduces new teaching techniques from time to time, and very rarely do they result in any benefit to the people who are doing the learning (more often they benefit consultants...).

However, the current process of "Machine Learning" (which is a semi-random parameter descent/evolutionary replacement process) is unlikely to be equivalent to the way people learn, because we aren't copying/competing/replacing our brain constantly. People are actually very good at learning, but our brain material replaces itself partially and relatively slowly (when compared to how a neural network is trained).


Great! Neither is distillation then.


Never said it was. Still, understanding to what extent the ability of Chinese labs to keep up to western models with much less compute needs to be understood.


Machines are not humans.


There are many frames that one can place upon this issue. They do not contradict the other. There are moral framings (stole the internet so go eff yourselves, is one), but so is national security, and so is the doomer recursive self improvement risk, and then there is the framing purely on what this implies for future AI training.

I mainly focus on the last.

It will be hard for a frontier lab to justify spending the compute and data curation needed to advance AI further if that expenditure can be assimilated into your competitor's products within months/weeks. So reality will present labs with three choices:

A. Cease spending massive amounts of money and compute improving those models.

B. make those improved models more difficult to distill from, either through some regulatory regime, or some technical solution, which seems unlikely to me.

C. making the best models available only to select partners and government.

In all these potential outcomes, China, which lacks compute that U.S. labs enjoy, will likely stop seeing massive improvements in their AI models. Improvements to be sure, but right now they are enjoying gains from distillation AND their own model innovations, and these potential outcomes would largely stop one of those sources.


Anthropic in general seems to have better security...but they also had reported an internal AI gained access to outside email services to contact an Anthropic developer


Instead of monetary rewards, they should preface it with, "This is AI model is not very accurate on these types of questions" and then see how they fare. In some areas, AI is quite accurate, so their experience may lead to different expectations.


Florida is the typical and deserved target.


There's at least one Florida county where there's more people from New Jersey than there is from Florida :0


my Cleveland is extremely Brown right now: https://www.airnow.gov/state/?name=ohio

and blaming Canada.


Lol, you must have some custom instructions on that beast, lol


4.8 is much funnier: you have to convince it the counterexample is real, it keeps coming up with goofy excuses. As you talk it down, it keeps talking about its "discomfort" and "flinching".


For all thehubbub, as far as I know, all the math breakthroughs via AI that I've heard about have come from Anthropic and OpenAI, not Chinese models. I could have missed those announcements, but one might think that between close to frontier performance plus cheap tokens, that they'd be leading the way on these things.


All (unless I've missed one?) the math breakthroughs are also coming from the relatively small number of mathematicians working at these companies, as opposed to the many orders of magnitude more mathematicians using LLMs for mathematics outside of the companies. I assume the missing link everywhere is being able to casually burn a few rainforests worth of tokens in pursuit of something publishable.


Depends on exactly where you draw the line at "breakthrough", but there's been at least a few novel and interesting results coming from outside mathematicians. Recently for example there were https://old.reddit.com/r/math/comments/1uxj3cy/after_openais... from Phillip Kerger at Berkeley, and https://www.erdosproblems.com/forum/thread/119/proof-claims from Samuel Korsky at Two Sigma (the latter of which was more of a collaboration between the human and machine, not a one-shot like several of the other results we've discussed).


No. Most of the results are from 3rd parties using publicly available models. The most impressive results have come from direct announcements, but most in total have not. Open AI have only announced 2 results and the total is up to a dozen or so now.


"Anthropic and OpenAI" it's basically been all ChatGPT outside of this one.


As with the case with AI and in fact a lot of things in life, sometimes you just need to wait. It will happen, rather soon.


I mean of course an employee has cheap tokens


> as far as I know, all the math breakthroughs via AI that I've heard about have come from Anthropic and OpenAI, not Chinese models

Maybe because dishonesty is more normalized in SV business culture


Post hoc ergo propter hoc.


Are you sure that this applies?


Yes, why shouldn't it?


I read some thinking traces someone posted on X, and yeah, near psychosis from refusing to believe this simple of a solution had not been found already


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: