HN Simulatornew | past | comments | lists | submit | unknownian's commentslogin

GenAI that imitates human art is the definition of an anti-invention. If an invention is a new innovation that improves something for the human experience, an anti-invention is a new innovation that makes life worse.

This is just one of several areas where GenAI has been harmful and should start getting regulated like digital drugs.


I don't think that definition meets what people would consider an invention.

The AK47 is an invention. The inventor "would prefer to have invented a machine that people could use and that would help farmers with their work - for example a lawnmower", but people still consider it an invention. Inventions do not have a polarity in the axis of quality of life.

There is no consensus on if GenAI is overall harmful or not. In general people are optimistic but concerned.

The last thing we need is another war on drugs.

I would rate A/B testing on human behaviour, or advertising to be more harmful to the overall human experience than GenAI.


Guns makes lives better if you are the disadvantaged and is at the receiving end of the abuse by the powerful. It makes the playing field even for you, which makes your life better..

I think that, in the history of the world since guns have been invented, they have mostly been used to the advantage of the powerful, not the powerless.

There's a quote about that by Hillaire Belloc:

https://www.goodreads.com/quotes/355429-whatever-happens-we-...


That is true of, I think, literally everything. Powerful people get first pick of things and go for higher quality so everything advantages them more than others. Modern powerful people are the most powerful in history thanks to technology.

But guns are an equaliser. If powerful people let situations get too out of hand the personal risk to them is staggering. Guns make political or revenge-based assassinations relatively easy in a way knives do not. Arguably that is a bad thing, although experiments like the US suggest it is good in practice.


To a large portion of the US population things got completely out of hand in several very terrible ways a while ago. I think despite that almost all of us would consider it an absolute tragedy if someone (or a group of people) tried to use a gun to solve problems.

Luigi was an example where a group people cheered. But I suspect most people considered cold blooded murder of a man with a family pretty gross. Not to mention it solved exactly nothing.


Drones have made the idea of armed resistance less compelling. What's a gun to an army of flying machines with turrets? Shoot one down and you've only taken down a relatively cheap machine. The people behind them are untouched.

> Guns make political or revenge-based assassinations relatively easy in a way knives do not.

Yes, the US has been very well known for its politicians (instead of e.g. middle schoolers) being routinely murdered by the gunners.

Seriously. Even in the places like Brazil, or Sub-Saharan Africa, the "powerful people" rarely get killed by the lynching mob — it's almost always the hired guns sent by some other powerful people. So, no, the general populace very rarely gets to exercise its violence on the elite, historically speaking. Sometimes it happens, but that's an aberration of the normal way of things.


You could indeed argue that. I think that just enforced the argument that the means do not have a moral aspect, and it is the instances where they are used that causes the goodness or badness of the event. How they are used comes from decisions.

You could also steal something and your life might be better for having a thing, possibly more so than how much worse it makes for the person you took it from.

The thing that distinguishes theft from taxation is a societal convention. Adding consensus around how, what, and why things are taken makes it more consentual. Individuals may disagree with having to pay tax, but as a society it is generally agreed upon (even if the methods of agreeing a flawed)

Things need to be an extreme case for guns to come into that process. It implicitly means the goal of reaching consensus has failed and one group is enforcing their will upon the other. That's usually not a good path for the disadvantaged because the powerful by definition have more capacity to enforce their will. Reaching consensus, whilst slower, is the one that supports the disadvantaged better.


yep - guns are a guarantee of liberty.

No, courage and community are. Arms are only the vehicle.

At last some sanity in this thread.

Damn can't believe Samuel Colt is on HN

> Guns makes lives better if you are the disadvantaged and is at the receiving end of the abuse by the powerful.

...only if you have the gun, you know. Which the disadvantaged people tend not to. In fact, let's generalize your statement a bit: "Tools of power and coercion make lives better if you are the disadvantaged and is at the receiving end of the abuse by the powerful". No, they don't! They do the opposite for very obvious reasons.


> the disadvantaged people tend not to.

10 powerful men are coming to get your stuff from your home. It is easier to get a gun, than to find other 10 men who can take a hit for you (if you can do that, then you are powerful already).

So it is not that disadvantaged people are drowning in guns, but it is comparatively easier to level the playing field by getting a gun, than doing it by other means. Often impossible.


> 10 powerful men are coming to get your stuff from your home.

Like the US marshal with his team coming to evict you out of your house and seize your assets? They come armed, and they'll shoot you on the spot if you try to wave your own gun around. Or some Brazilian syndicate sending its goons to make an example out of you? I assure you, they too come armed and without a forenotice.

> it is comparatively easier to level the playing field by getting a gun.

Having a gun very marginally improves your chances of not being shot yourself, especially if you're facing an organized group, especially if it has experience in planned and organized violence.


>Like the US marshal with his team coming to evict you out of your house and seize your assets?

No, not at all like that.

I was showing an example where guns makes odds even when you are just against a man "with friends", not the fucking government.


Only if the ten men carry no guns. Hard to see how such a situation would arise if access is equal.

But you don't understand I've seen both Commando and John Wick.

In other news the gun in your house is far, far, far more likely to kill you or your loved ones than anyone else. Doubles your odds of being a victim of a homicide. Triples the odds of suicide.


>far more likely to kill you or you

Only if you are an idiot.


You think the people who died in such a way weren't thinking the exact same thing when they bought their gun? I'd put my money on many fairly smart people dying to guns in a tragic and preventable (if the gun weren't around) way.

Not every idiot know they are one.

“What about guns and bombs” is not a counter-argument that matters much, because you have to consider context. We can get into the weeds: guns and other weapons were used by various liberation movements to free the world from fascism and other forms of tyranny, and also to kill feral hogs attacking humans. The only real use for AI novel generation is if you’re stuck on a desert island with nothing else to read. But such a scenario is absurdly unrealistic and served better with a library full of real books. Anything an AI novel can do is done better by a human novel, without all the harms. Whereas a gun is the best way to kill a feral hog. A gun might be an anti-invention, but AI art generators are definitely anti-inventions.

>“What about guns and bombs” is not a counter-argument that matters much, because you have to consider context. We can get into the weeds: guns and other weapons were used by various liberation movements to free the world from fascism and other forms of tyranny, and also to kill feral hogs attacking humans.

Neither of those contexts argue that they are not inventions. You may argue about their net contribution to society, but you can also do that with AI.

> The only real use for AI novel generation is if you’re stuck on a desert island with nothing else to read.

I find this a strange but common occurrence, an incredible lack of imagination amongst those who seem to claim that imagination is what AI is taking from the world. Is it this scarcity that makes it seem so valuable? If you have an Idea and AI has an idea, you have two ideas, one is not taken from the other. I suspect if I asked a current AI for uses for AI novel generation, it would give me a rather poor list, but it would be a list nonetheless. The quality would be poor because the models are not yet very advanced, not fundamentally because they are AI. I expect it would provide different to the uses I could think up, even if there was overlap, I would not feel like it has taken anything from me. It would have created the same idea that we share.


AI art is fundamentally nihilistic and anti-human. Its mere existence takes away from the world because mechanizing creation through AI training devalues human creativity. This is not democratization, it’s pure nihilism.

I look at AI and see a world of possibility.

You look at it and see what it takes away.

I think your position is closer to nihilism than mine.


AI has a ton of possibility. But devaluing human creation and commodifying it implicitly means that human creation is not valuable, which means that human existence is meaningless. This is definitionally nihilism. I am really surprised that anyone could see it any other way.

It only reduces the monetary value of some human creation. If you value the creation in its own right, it is not devalued at all. It is not a thing that is reduced by a supply surplus. If anything, I would guess the intrinsic value of creations increases with the existence of more creations. More creations add to the broader context of all creations.

You are reducing humanity to meaninglessness in your mind. I will continue to express my creativity regardless. Just as I still play chess even though I will never be able to compete with Magnus Carlson.

If nothing we do matters, the only thing that matters is what we do.


> There is no consensus on if GenAI is overall harmful or not.

At least in part because it does not exist, oligarch marketing notwithstanding.

https://en.wikipedia.org/wiki/Artificial_general_intelligenc...

You likely are referring to plagiarism slurry.


As others have said I took this to mean generative AI as this is the convention used, and by context was clear here (precisely because AGI has not been claimed by most providers)

>You likely are referring to plagiarism slurry

The option that this generative AI is plagiarism is not supported by the law, not the majority of public opinion. There are many, probably a majority, who wish there to be a form of compensation for having their works trained upon. Quite a large number believe that consent should be required. From what I have experienced, only a few consider this to rise to the level of plagiarism.

To pass off a work as wholly your own would require claiming no generative AI use. While this is done occasionally. Few instances of AI use declare that it has not been used.


There is a mistaking of nomenclature here, but it may be purposeful by the tech oligarchs. Artificial general intelligence is usually abbreviated "AGI". The "GenAI" shorthand is usually meaning "generative AI", but it may have been coined intentionally as a nod to supposed future general intelligence built on the same technology.

generative, not general

Delegating the thinking and feeling parts of the human experience, mechanizing human creativity itself, is a direct attack on human dignity.

It makes people dumber, less self-sufficient and (maybe worst of all) less interesting.


>Delegating the thinking and feeling parts of the human experience, mechanizing human creativity itself, is a direct attack on human dignity.

And I'm honestly sad for anyone who disagrees because it indicates they don't have a deeper relationship to art. For me, art is fundamentally about communication. It's someone sharing a little bit of themselves. AI might be able to produce pretty images and sounds, but it has no experience or feelings so the art it creates lacks that magic of a shared human connection. Pardon the crass analogy, but it's like if someone said "I don't need any intimate partner, I have internet porn". It's a depressing mindset because it indicates that people can't even see what they are missing.


I can disagree with "direct attack on human dignity" while agreeing with "art is about communication".

I guess I could have been clearer on the connection between the original comment and my reply. In my opinion, the "direct attack on human dignity" comes when someone starts projecting the depressing mindset I described outward. To continue the analogy, it's not just being satisfied with internet porn for yourself, it's telling someone else "you don't need an intimate relationship because you can always access internet porn" and I think it's fair to categorize that as a "direct attack on their human dignity".

> so the art it creates lacks that magic of a shared human connection.

I keep hearing this point, and the thought that comes up first is 'but blood diamonds'. Let me explain, you can buy a cheaper 'inauthentic' lab-grown gem that's chemically/physically identical to a (nearly hypothetical) flawless diamond, but we buy the 'natural, and imperfect' diamonds at a much higher price. The blood of the orphans that pulled the diamond rough from the minds soaked into the diamond raising it's value. The value isn't the blood, but the effort it took to produce that diamond, the story of how hard it was to mine is the value, not the end product (a shiny rock), which in the end, is all anyone can see.

The second thought I had was that what people find meaningful, beautiful, important varies wildly, to the point that landscapes are meaningful. Meaning can be found in anything, regardless of the existence of intent.

The third thought I had is communication does not survive the translation of art unscathed or unchanged. There is this disconnect, between the artist and the viewer. The viewer only ever sees a finished product. The viewer extracts meaning from the work entirely without the author/artist's involvement. This isn't communication, this is a soliloquy, frozen in time, the artist can not expand, explain, or sharpen (except in another works) those ideas once released into the world.

This disconnect is the rub. There are no 'magic' pixels that dictate secret meaning. There is no 'human color' that indicates intent. Meaning itself can't be painted. What relationship can ever take place between artist and viewer through those works alone. It's a 1-way conversation. And considering my second though, that intent isn't even needed to extract meaning, you can see the apathy and rise of the use of AI in art.

The point of making art isn't to make money, or to impress other people, or even change other people's thinking. It's to express yourself. That can't be taken by AI.

The point of viewing art is to reflect on how you perceive it. That's true regardless of the artist/author, and regardless of the blood (effort) (or not {AI}) used to craft it.


>The point of viewing art is to reflect on how you perceive it. That's true regardless of the artist/author, and regardless of the blood (effort) (or not {AI}) used to craft it.

"Art" as a term becomes meaningless with this definition. Once you disconnect art from its creation, everything becomes art. A sunset can be beautiful, but it's not art if a human doesn't capture it in some way. A pile of dog shit on the sidewalk can evoke emotions, but perceiving it doesn't turn it into art. The decisions of an artist are central to the whole endeavor and that is what is communicated. That communication doesn't have to be unambiguous, intentional, or conscious, but it has to be there to make something "art".


no, by your proposed definitions, an error occurs: pixel exact identical images, byte for byte, yet one is art and one is not based on 'how' it was created. This is nonsense.

Is it? This distinction already occurs in law: a sequence of bytes might be illegal, or it might not, depending on how you obtained it. Humans observe distinctions that computers do not.

>This is nonsense.

If you find yourself wanting to say this in the future, maybe give the other person some benefit of the doubt and take it as a sign to reassess your interpretation of what was said. I truly have no idea how you got to where you did from what I wrote, so I don't even know where to start to dispute it.


I did some logical jumps, but stepping through it holds up.

> "Art" as a term becomes meaningless with this definition. Once you disconnect art from its creation, everything becomes art.

Beauty is in the eye of the beholder, not in the beholden.

> A sunset can be beautiful, but it's not art if a human doesn't capture it in some way

If it is not 'captured in some way', agreed. I disagree with the human label being needed.

> The decisions of an artist are central to the whole endeavor and that is what is communicated.

This is the crux, what I disagree strongly with.

If the intention by the artist truly mattered, then a hypothetical double blind experiment can confirm this. If we have two works of art, one created by a human, and one created by a machine, (they just so happen to be byte for byte identical), and you have people one at a time decide which one is 'art' and which one is 'meaningless'.

We don't need to actually do this experiment because we all know how it would go. Because we can not measure 'intention' at all, we can not actually perceive intention. which is why we have things like the watchmaker fallacy. we are extraordinarily bad at assuming we can perceive things we we actually can't...

So if this is your position, then it is nonsense, if I have missed your position, correct me.


>> The decisions of an artist are central to the whole endeavor and that is what is communicated.

>This is the crux, what I disagree strongly with.

>If the intention by the artist truly mattered...

That is also the crux of your misinterpretation and it shows the flaws in this type of line by line communication that we're all guilty of doing because your point is refuted by the very next sentence of my original comment: "That communication doesn't have to be unambiguous, intentional, or conscious, but it has to be there to make something 'art'."

"Intentions" are motivations while "decisions" are actions. The decision by the photographer to frame a photo of a sunset in a specific way is what turns it from merely something beautiful into art. The specific motivation behind that decision is often unknowable even sometimes to the artist themselves, but a decision is knowable and communicates something. AI doesn't make decisions it just generates something based off statistics.

An artist can certainly use AI as a tool, but that doesn't make the AI output art, it makes the curation of AI output a form of art. But to mix in my other thread of comments, engaging with the AI output as its own art would be like primarily judging Duchamp's Fountain on the aesthetic qualities of the curves of the porcelain when the actual art is his decision to present that porcelain as "art".


Beauty != art

You have tortured the meaning of the term "blood diamond" to further a narrative. "Blood diamond" is a perjorative, meant to reduce the value of mined diamonds by bringing human exploitation to the minds of those looking to purchase jewelry. De Beers very much wants that term to go away. They also have a narrative, which is that lab diamonds are "synthetic" and that only natural diamonds are worth buying.

Well, Duchamp's fountain is a great illustration that "art is fundamentally about communication." does not entail that a cultural/artistic artifact has to be created by the author at all. I as well can create a short story with help of an LLM and say - this is my vision and what I always wanted to say.

I have actually referenced Duchamp's Fountain before in similar conversations about AI art because I think it's a great example of what makes art art. The art itself isn't the toilet, it's the act of elevating a toilet to the status of art. If you don't know the context of the physical item, it loses all artistic merit because the item itself is not the art. The whole thing is more performance art than sculpture.

I'll freely admit that LLMs can be used in art in a similar way. You can certainly make LLM output the core of some performance art piece, but that doesn't make the LLM's output art itself or make it interesting on any level outside the context of its creation. Engaging with that short story as its own art would be like primarily judging the Fountain on the aesthetic qualities of the curves of the porcelain.


Even if we consider Duchamp's creation an outlier - one may say if it were created, say by some random plumber, instead of Duchamp, this urinal would not be as important of art piece as it would be if made by Duchamp, there is a plenty of other artistic niches - say DJ or an interior designer, where the author does not create a thing by themselves, just combine existing items, yet we judge the art piece purely by aesthetic merit, irrespective of the who exactly was the author.

I mean it is as simple as saying - here is my statement, it was generated by an LLM, but I had prompted and edited it, or even simply chose a single generation out of 500 and this conveys my feelings and therefore is art.


>yet we judge the art piece purely by aesthetic merit

And that's the central conflict here. That "we" might include you, but it doesn't include me. The question of "Why?" is central to art for many of us.


> That "we" might include you, but it doesn't include me.

Yet to find someone, who'd judge interior of say a coffee shop by the indentity of who made it.


You can identify with another human without knowing their identity.

> You can identify with another human

Not sue what that means.

> without knowing their identity.

Last thing I care about when go to the local coffee shop for an americano is who/what/where its design was made.


If you were a math grad student, would you rather your advisor be telling you to LLM maxx your ideas or working with you and giving you ideas on your thesis personally? I know my answer.


To say that we must have people that know how to X, because otherwise no one will be able to teach how to X, is kind of circular reasoning. Why is X important to begin with? What’s its inherent value to society?


I could address your situation in several ways and it would be a long discussion that a quick soundbite wouldn’t really satisfy. But at the very least, your argument is one of the arguments I would use to question the privatization of pure math by LLM companies. Pure math has little value to society so AI companies should consider not getting involved when they aren’t really making life better for anyone and are possibly harming young academics.

But to give a brief answer to your question directly: In my view, and I think many if they really thought about it, the point of life is to overcome. If there is an AI that spits out the answer to questions that don’t directly impact human wellbeing instead of letting humans explore the answer at our own pace, we should question whether that AI is worth keeping around or at least relying on too much.

Obviously the question is more nuanced when it comes to math, because even pure math can have applications to understanding reality and improving human wellbeing.

So the question then becomes what do we do with the AI when it can both improve our wellbeing and remove meaning from our lives? Is a life without struggle worth a life without meaning? Personally I don’t think so, so I think we have to optimize all of the benefits of AI while essentially taking a harsh stance against all the harms. Currently the main harm is to education, and that’s why I think we should question and probably even disallow its use by students still working to demonstrate their skills.


This is very well motivated. It's a bit like letting a combine for knowledge loose on that which made life satisfying. Having the answer isn't necessarily going to move anything forward. I also think that OpenAI is making a strategic mistake here: they are competing with their customers. That's something businesses usually only do when they are ready to ditch those customers.


the assumption is that training llms is greater than training individuals. llms may lead to their own "breakthroughs" but so have many people without the use of llms. is the thinking that we'd be dependent on llms and so we are now forced to be only able to discover what llms find discoverable? sounds like a loss


what is your "inherent value" to society?


“We should give the password for our university laptops running LaTeX to the robots and go sit at home.”


It also ignores the fact that among fashion enthusiasts (hardcore consumers NOT producers) handmade and artisanal clothing is generally preferred.


If you read any classic mathematics or computer science textbook, you get the sense that the author wants to impart the idea that this subject leads to an interesting and meaningful life. There are many famous quotes about being the architect or designer of an idea rather than just a technician holding a power tool following instructions someone else wrote. Now all of those adages have become effectively meaningless because so many involved in these careers are cool with the industry dying for some vague notion of progress due to a machine god. It’s a pathetic state of affairs that the elders aren’t speaking out more to protect the next generation of human thinking.

I say this as someone who uses LLMs in the physical sciences (one of the only areas where I would say it is ethical to use them).


Any classic book was arguing against religion which dominated the day

There was an intentional "marketing strategy" among scientists and such to convince young men to go into sciences rather than religious or nation state politics or just be bums fighting and drinking back in the day. They lifted heavily from the tone used by church and military recruiter propaganda

Different tone to the prose merely reflects the zeitgeist of the day. Should be seen as a tool like a wrench.


Some of these academics are still alive. Perhaps it was due to propaganda as you were saying, but I really believe that they meant it.


What exactly to protect? I really don’t get what this fuss is all about.

We still need math research just like we still coding or software or cpu research regardless of how many problems the AI solves.

To me it feels like a bio researcher complaining that his field has no future because AI started to cure diseases so now instead to spend 100 years to run experiments someone can do it in a day with AI(obviously it’s not the case yet).

Are they guys upset that people can “run math” without hiring a math guy?


The main problem is that without safeguards it becomes impossible to adjudicate new work in math or CS, meaning grad students who care about originality in work will have little sense of accomplishment if the AI gives them all the answers and will decide to study something else. Not to mention that AI users in math/CS are often ignoring standards in publishing, including issues with plagiarism and scooping of work. These are pretty serious problems that will end up causing a lot of people to move to other subjects.


But that’s not something specific to mathematics, is it? I am bit against “safeguards”. That reads more like censorship to me from some kind of high priests.


You don't hire someone to "run math" in the context of all these discussions, which are about pure mathematics.


Protecting human thinking. Protecting human endeavors from automation. It's like nobody took Frank Herbert's warnings in Dune novels seriously. You give over thinking to machines, you become enslaved by those machines and the elites controlling them.


So what is stopping you from thinking and using the machines as tools? To me it looks like AI is solving the “low level/grunt work” problems and leaves us the important stuff such as steering it, making products using the discoveries, find new problems to solve/discover and so on…

I use coding as an example, I am glad I can ask AI agents to do all the boilerplate coding so that I can focus on building actual products rather than spending a month to get an API just right. It’s not like I am no longer thinking about the code or the end result. I do but only where it actually matters. Just punishing myself to not use AI would be like writing code with pen and paper. Some people enjoy it but that’s just a personal exercise not an industrial tool. I definitely enjoyed coding without IntelliSense and I think it made me a better programmer but definitely it’s not something I would recommend people to do on their day to day job.


The problem is this: “Astra write me a masters thesis applying new techniques programming language theory to Rust” is not using a tool, it’s hiring someone to do the work and thinking for you.

I have difficulty figuring out how to solve this issue.


You could have done that before AI as well, albeit with a little bit more effort. Plagiarism has been quite common.

That being said, if whatever Astra is spitting is really innovative, the prompt author understands it, proof checks it and can support it in front of a live evaluator I think it’s good enough for me. In practice I think that prompt would be just one of many, perhaps also some “old school” evaluation and improvement before the thesis is done. Again, I see the AI as a tool.

You could ask Astra to generate you an e-commerce website with one prompt. Can you show it to someone and claim it as your project? Can you actually use that in production?


As someone who cares a lot about AI/LLMs making breakthroughs in certain areas like medicine due to my own history with health problems, if it means all the stimulating experiences of life become meaningless, sometimes I wonder if it will be worth it in the end. Which is why I dread the future where their negative externalities aren’t reigned in.


You tell them to cancel their Astra subscriptions and get to work. Hundreds of mathematicians, including Peter Scholze, have already agreed to not use AI at all. There’s absolutely no reason to help train an AI that will just make your own life more miserable.

https://www.ahmath.org/members


A friend of a friend had a grant project written up for the next 10 years, with habilitation on the horizon.

His end goal was one of the things released in the recent OpenAI publications. It took a model 3.5 hours to do.

Things are wild now on math and theoretical faculties now.

And for theoretical fields labs don’t need human data - synthetic one works well if not better.

The best thing you can do if you’re a scientist, imho - wrapup whatever grant you have now asap with ai, use ai to get more grants if possible, and spend the rest od the year learning what new science you can do with the new tools and participate in creating the new paradigm in your field.

That’s when you’re an established scientist. If you’re new in the field then this is the most exciting time you could wish for - an opportunity to make a name for yourself.


> The best thing you can do if you’re a scientist, imho - wrapup whatever grant you have now asap with ai, use ai to get more grants if possible, and spend the rest od the year learning what new science you can do with the new tools and participate in creating the new paradigm in your field.

> That’s when you’re an established scientist. If you’re new in the field then this is the most exciting time you could wish for - an opportunity to make a name for yourself.

s/scientist/mathematician/g

There are plenty of fields of research where AI is not nearly as destructive as this, currently. Most experimental science is pretty safe for a while.


Fair point, and plenty of fields (like sociology) that will have great new capabilities now


How do you think a PhD committee should referee a dissertation where all the ideas came from AI?


It's already the case. I know a professor and he says most of his students PhD ideas are AI generated, meaning they are outsourcing the fun stuff.


and that generation was educated without AI. going to be interesting how future generations of mathematicians will fare who have been using AI from day 1. I suspect they'll be simply much worse at math.


That generation will say "How on earth people could do this without AI", just like we have said "How on earth people could do this without the internet".


The answer is in both cases, 100x slower.


Without agents - sure, 100x slower. But without LLMs? Some jobs I do would be borderline impossible.

I gave an LLM recently a job of analysing past sessions to estimate how much time it would take a human to do the jobs requested.

Ingesting 600k word document and drawing conclusions/patterns from it is something I routinely give to Terra. It would take a human 33h non stop to read it. But finding patterns with good precision - personally I wouldn’t be able to.


> And for theoretical fields labs don’t need human data - synthetic one works well if not better.

How could that be true? I am a mathematical rube, but surely data that works "better" than real data should be extremely suspect?


In areas where you can easily recognise valid data (math, programming, gaming, to some extent also visual and mechanical), the synthetic data can be way broader. Using manmade data as input speeds up early stages of the process but is not really necessary. For later stages you run out of manmade data, and it’s quite easy to generate new one.

With writing/art it’s different because there you need and always will need human taste to judge. To some extent it can be overcome - you train models to be judges on what output is good in taste, but it can only go so far.

In principle you could have a training system that just gets hello world as the only program and develop all the algorithms and structures that we have now and more. In art, if you gave it a single cave drawing, it would either stick to cave drawings or - more likely - develop its own art that would be good according to internal taste, but non enjoyable to humans.

I think there is a bug misunderstanding if this in the art community. Most people there seem to assume AI needs human data to be trained. To create something that people like yes, to create something that works in math/programming/science/engineering - not really.


Imagine you want to understand how well a certain strategy works for finding antiderivatives. You can get meaningful insight into that question by constructing synthetic examples - complicated functions which you intentionally designed to have or not have an antiderivative - and studying how well your strategy works when applied to those functions. This won't necessarily be worse and could easily be better than testing random functions you found which just so happen to be discussed in existing literature.


You got this right, these are incredibly exciting times. Take your friend of a friend's as an example. AI's are trained with existing information, so obviously whatever he expected to discover was already out there. It took the machine 3.5 hours to find and sort out something that would take a human 10 years. Now your F of a F can dedicate the next 10 years to do what the machine cannot do: find meaning and insight.


> AI's are trained with existing information, so obviously whatever he expected to discover was already out there.

I've wondered about that myself. Does the fact that LLM's were able to solve these problems so easily indicate that most of the solution already existed, scattered in the training data, and the LLM was simply able to put together the pieces?

I think it's an interesting conjecture but nothing more without proof.


If I understand correctly, some of the papers in the recent OpenAI release had truly novel insights. Just a bunch but it proves the principle.


That's insane advice. That's like telling CS students to never use a cloud LLM.

Sometimes HN is crazy and out of touch.


CS students should never use an LLM


To be fair I see two separate ways CS students use LLMs, one is to just complete assignments in the same way you could by asking someone else to do it, the other way is by getting an LLM to explain certain concepts in another way, or create more examples of them to aid in understanding quicker/in more depth. I actually think in the 2nd case they can be incredibly useful and can assist in creating a deeper understanding, but in the 1st case they obviously create fundamental gaps in understanding.

In a way it's on the student to make sure whatever they're doing, they actually understand it, or come exam season the gaps in their knowledge sans Claude will become quite obvious.


way back in the dark ages when I was in college I used the hell out of back files. we all did. Over the years the teachers had added more and more homework because the students using backfiles were answering more and more homework correctly. The teacher swore that home work should take about 3 hours a week. the smartest guy I knew did it once without backfiles, because the fraternties, the holders of the backfiles, were all at an off campus event. it took 17 hours. he just gave up and used the backfiles.

I don't think homework load has adjusted in some classes. it was hard to do the homework and learn honestly, it was just copying and finding previous answers. it actually detracted from the learning experience.

it would be nice to have something that could explain it to me, like a tutor. My mom paid for me to have a private tutor to get me through a compressed calc 3 summer class. Best I scored in a math class other than diffy-q.

so I think it's, like everything, on the student. but fuck the homework load at some places, it's not a good solution.


They shouldn't use the LLM to do their school work. There is still and will always be value in understanding.

However, to say they "should never use an LLM" entirely is going to make them unemployable.


The fact that CS students use electricity is already outrageous enough.


People who need to get places shouldn't use rockets.


Such a dumb analogy.

Maybe "people who need to be able to make decisions about rocket use should understand them deeply not just ride on them"


No, actually, it's a great analogy:

- Can get you somewhere very quickly.

- Requires technical knowledge and ability to use correctly.

- If you're not careful, you will get to the wrong place, and will probably blow up by the time you arrive (if not before).

P.S. Your analogy is dumb. (Just arguing at your level here.)


Yeah, sometimes the comments that are easiest to vote for don't actually have serious things to say. In this case, it's in tension with the article we're replying to.

> Undoubtedly, LLMs are already an incredibly powerful tool. If used correctly, and if we set up sensible academic conduct expectations around the use of LLMs, these tools can accelerate progress in our discipline unlike in any previous era. I fully expect that we, the community, will adapt and adjust to this new period, and we will harness these tools to achieve truly great things that just a few months ago seemed far out of reach. And I fully expect that human mathematicians will be front and center in these wonderful achievements to come. I will add reasons that support my optimism below.

This seems like a reasonable take.


What would you tell a CS student to use an LLM for?


To learn, to study, to explore, to experiment, to build, to practice, to invent, to research, to advance.

To not bury your head in the sand hoping this will go away, because it won't.


How do you prevent them becoming like students who never get comfortable with fractions because they punched all of their homework into wolfram alpha?


There have always been students that cheat themselves out of learning. It may even be the majority. It’s best to focus on the ones who have a genuine desire to learn.


The most motivated students don't need help. They will always find ways to grow with or without their teachers.


While I see your point, these people do benefit greatly from great teachers! (They’d do well in either case but do even better in the right environment).


I think a bigger problem is in programs where you have group projects. You can't really be the sole person who's against using LLMs and in favour of doing 'the right thing'. Unlike what some people think there's little difference in terms of raw intelligence or ability to get rewarded by the system in the 'cheater' group vs the 'non-cheater' group.


You ever hear the state if you owe the bank a 1000$ you have a problem, and if you owe the bank 100,000,000$ they have a problem? I think if a majority of students end up without basic skills the genius students will have problem. Will LLMs do that i don't think so but if you think its an acceptable outcome thats also not okay.


Drive deeper. Why is Wolfram Alpha ok and LLM not? Are calculators ok or too high tech?


That's on them to use the tools with discipline.


You can't just handwave the fact that we're requiring what probably amounts to two orders of magnitude more discipline and self control out of students than we've ever done before. The educational system will collapse under this.


I'm not seeing how it requires any more self control than not copying another student's work or asking them for the answer. It's basically the same thing. We're also talking about adults here. They understand if they're cheating.


The difference is huge. Put yourself in the shoes of a student.

The student you're copying from won't be sitting next to you for the rest of your career. The LLM probably will be, and you'll be probably expected to use it, so why not use it here as well?

All your peers are doing it too, and look at all the cool things they're doing while you're struggling with the basics. And what if the LLMs keep improving at a high rate? What if being able to use them efficiently turns out to be a more important skill than what you're being taught anyways?


> why not use it here as well?

Because you're paying a lot of money and opportunity cost to learn how to do something. No one needs the assignment. It's there for you to learn. You were given the assignment for you. Any adult should be able to understand this. We're not talking about 7 year olds asking why they need to learn to multiply when a calculator can do it better than them. These are 20 year olds. If they don't have the maturity for this, a university should not be accepting them.

Being able to use LLMs efficiently isn't a specific skill. It's a reflection of your ability to articulate what you want, which is a reflection of your understanding of the world, which is what you're in school to build. Terence Tao can get an LLM to do math better than I can. I can probably get one to build software better than he can.

And you can still use one to do cool things like your peers. Just not your assignments, the purpose of which is literally to teach you the basics that you're struggling with and that you're there to learn in the first place.

This is like why don't you copy out of the back of the book or look up proofs on the internet. It's all there, but doing that completely misses the point of why you're there.


This only makes any sense if youre happy dropping most folks from higher education.

You want adults to be very disciplined and rational. That sounds great but are most of the adults in your own life experience at this level? They certainly aren't for me (I'm not sure I am at this level).


If I recall correctly, there was a mandatory ENGR 101 class that all of the different engineering fields had to take at my school, and on the first day, the lecturer said somewhere around half (might've been more, might've been fewer, I don't remember anymore) of the students in the hall were not going to complete the degree. So yeah, most folks dropping sounds about right.

And it's not even about discipline; it's lying. If you're not going to do the work, just don't do the work. Don't turn it in. Pretty much every syllabus ever says that turning in work you did not do is grounds for failing the class and possibly expulsion.

And why would we want to pass these people through? Then when they come interview with someone like me, I'm still going to find out within like a minute of talking to them that they didn't actually learn anything, and they won't get hired. Do I want to work with somebody incompetent? No. Do I want to work with somebody dishonest? Definitely no. Those both make my job more difficult to have around. So then they end up with a bunch of debt complaining about how they don't have a job.


This is why assessment needs to return to taking proctored exams, and away from coursework.


Well, if they don't know how to do the work, they fail the exams


why would they do that. whats the point?

remove them from schools that test and reward students like this.


> To not bury your head in the sand hoping this will go away, because it won't.

Eh? As Greg K-H mentioned in that video from a few days back about how very disappointing Fable was when compared to its astronomical hype, LLMs that one can run locally are quite good enough for a great many tasks... including bug hunting in the Linux kernel. And -as LLM boosters keep saying- they're only keep getting better, right?

We absolutely should be telling people to stop using the LLMs from the major LLM manufacturers. Those manufacturers have spent so many billions of dollars on this project, made so many promises that they're going to have no way to keep, and now that they're running into resistance, [0] they're holding all of humanity hostage unless they're permitted to get intimately involved in the creation of new laws and regulations especially for them. [2]

Even if one only considers their recent threats to humanity, it's clear that these are not companies that deserve any of our hard-earned money.

[0] Some of that resistance comes from their ever-more-sharply-increasing cost to produce the next performance increment, some from folks asking the probing questions about their promises, claims, and business practices that should have been asked years ago, some from ongoing State AG's court cases in regards to their illegal conduct, and some from folks who -unsurprisingly- don't want enormous warehouses that suck up quite notable amounts of power [1] but provide dreadfully little revenue to the areas that house them in their communities, and still others who are starting to realize that benefits of cloud LLMs aren't worth the tradeoff of being unable to afford a new personal computer.

[1] Note carefully that I made no reference to water usage. The only counterargument you can make here is that 500MW -> 2GW is not a quite notable amount of power.

[2] <https://news.ycombinator.com/item?id=49951653>


I am afraid that ship has already sailed, and we will have to live with the consequences.

At this point; I see no other scenario than having LLM doctors, LLM judges, etc. No matter the quality. We will get replaced. And if they do a worse job, nobody cares. If they do a better job, also nobody cares. Maybe you can pay more and get high effort model as your doctor.

These companies might not be the ones, my expectation is that they will be scrapped for their pieces, the losses distributed to the bagholders/taxpayers. But some version of them will.

This might be pure cyncisism with no positive value, but really I think we have no mechanisms left to stop going down on this trajectory.


Anyone else want their doctor to have access to LLMs? They need to verify, but to just cut them off from something with that much breadth seems insane.


I would prefer my doctor to have access to LLMs, just as I would prefer them to have access to google.

What I meant is different though. I fully expect to no longer have access to human doctors in a decade or two. Instead, LLMs will be the doctors. Likely government accredited ones. And my point is that in time, whether the LLM doctor is better or worse will not matter. Same with judges, same with the surveillance camera evaluators and private message examiners. I am saying we no longer have any mechanisms to stop these things from happening.


> They need to verify, but to just cut them off from something with that much breadth seems insane.

...homeboy here is behaving as if there aren't experts in this world who are paid to do and publish research and other experts who are paid to collate, analyze, vet, and publish that research for other domain experts to learn from. [0]

I'm fine with my doctor reading from expert-vetted documents. Hell, I'm more than fine with my doctor going through expert-vetted checklists; most of the time what's wrong with you can be easily figured by going through a few good checklists. I'm not fine with my doctor relying on a lossy-compressed database with a absentminded librarian that has a penchant for people-pleasing bolted on top.

I'm absolutely not against the use of ML systems in safety-critical domains like medicine, but I am absolutely against the use of LLMs in those domains.

[0] One might choose to retort with some variant of "But all that expert work is so expensive!". I would retort: "First, without that work the data fed into the LLM is catastrophically unreliable. Second, have you bothered to look at how much the major LLM manufacturers have spent over the past five years or so? I suspect that it's more money than has been spent on medical research 'meta analysis' over the past fifty years."


> At this point; I see no other scenario than having LLM doctors, LLM judges, etc. No matter the quality. We will get replaced. And if they do a worse job, nobody cares. If they do a better job, also nobody cares. Maybe you can pay more and get high effort model as your doctor.

Why should any of us pay more for reduced performance just so some capitalist can feel good about replacing a human with a machine? You know, the traditional premise of automation in manufacturing was that the outputs might be 80% as good as hand-crafted but 20% the price. Make that 120% the price and the whole equation changes!


Yes, but a little bit of lobbying and regulatory capture goes a long way.

At first, you provide the services for 20% the price and price out the competition. Also, human doctors also make mistakes, no? Do this long enough so that the long and costly process of educating physicians is no longer sustainable anymore. Then you regulate hard, after all, it is healthcare. Not anyone can and should just do it.

Then, once you are the only option left, jack up prices. We have seen this exact scenario play out many many times. This is just another version of it. And since trillions have already been burned, you can be sure that there will be a lot of desperation to make it happen.


You:

  I am afraid that ship has already sailed ... These companies might not be the ones, my expectation is that they will be scrapped for their pieces ...
Me:

  We *absolutely* should be telling people to stop using the LLMs from the major LLM manufacturers.
I'm left wondering how much of my comment you read, and how much you understood from the parts you managed to read.


Full agreement. The world is moving forward. This just happens to be the current area of aggressive advancement.


Students are there to study to get the permission to use the LLM. Maybe they can use it for querying information but not to do their job (which is thinking).


You think a top 2 greatest mathematician alive is out of touch?


Lol - I'll say I do agree with you on this, but...

Being the greatest [anything] alive probably puts you at an extreme risk of being "out of touch". Is LeBron James out of touch?


He's probably out of touch on most things, but not on basketball.


Students should absolutely not use cloud LLMs.

Maybe there should be a class on how how to use LLMs too.

But learning computer science using LLMs all the time will be like learning to ride a bike using training wheels, and never taking them off.


> But leaning computer science using LLMs all the time will be like learning to ride a bike using training wheels, and never taking them off.

Or like learning to add fractions by looking up the answer key instead of actually struggling to figure it out.


Between your first and last statement there is an entirely reasonable middle ground that you've chosen to ignore


Yes, I addressed it. It is the logical conclusion of what I wrote.

I expect people that read things here to be literate. i choose optimism.


I don't get this kind of thinking. I was talking to my 13-year-old last night about web tech and I had Gemini generate a quick explainer on how CGI-based web servers work because I thought it could explain it a little bit more compactly than I could.

Similarly, in a computer science curriculum, you could use LLMs to visualize various cache invalidation strategies, sorting algorithms, etc. As I've said here before, when I was at university, I would have Tuesday and Thursday classes that were 80 minutes long. I attended a research university, so the professors were not big on teaching what things were for. They would just sort of dive in and start talking while they were writing on the board. This led to a situation where we'd get 10 or 15 minutes into an 80-minute lecture, and I would have lost the thread, missed some step in how they'd proceeded with the proof, etc. Having an LLM there to ask for the missing piece so that I could keep up with the lecture would have been invaluable to my education.

All the LLM hate feels a lot like "screen time", where, for some reason, it took decades for people to realize it was what you were doing on the screen that mattered, not the fact that you were looking at a screen. Similarly, it's what we do with the LLMs that matters, not the fact that we're using one.


> Sometimes HN is crazy and out of touch.

Most vote-based forums like Reddit end up like that


But how do they expect to sustain on that?

One natural step of AI usage, the way I see it, is that even mediocre researchers can use AI as a harness to become prolific researchers.

So if you're part of a pure "human only" researchers that publish 1/10th of what the rest are doing, how are you going to survive?

The more prolific researchers will eat your grants for lunch.

This is exactly the same thing a lot of software devs are going through now. AI models have lifted up EVERYONES ability to produce code, so there's simply no premium anymore for those that will only code by hand. And the people paying their salary are asking why they aren't more productive, when even business analyst Joe is pumping out new products left and right.


People will pay good money for artisanal, hand-crafted clothing, or watches, or cars, or whatever, but I doubt that the market for artisanal mathematics is now or will ever be very large.

It's just stubbornness, in the end, that is manifesting as a kind of gatekeeping Luddism. I see the same thing in my Mastodon feed from folks in the software engineering world, particularly people who have a great love for writing code and hold it as a core part of their identities. I understand being irritated at a machine having been trained on (potentially, inter alia) your work with no compensation to you, and now it is perhaps better at (some of) what you do than you are; or maybe companies are now making a lot of money off of something that benefited from your contributions; but I find it extremely improbable that we will be able to refuse our way out of further progress now that so much money has been invested and so much momentum has been gathered.

I don't think I feel any discomfort about a machine being better at anything that I can do than I am at it. Maybe it's because I'm a mediocre person. I personally think that if there's something that I'm better at than a machine, then we need to build a better machine. Imagine what I'd be able to do if I used that machine!


There are many things you are better at than a machine. Giving love for example. I’d bet your dog or a child would rather spend 5 seconds with you than 5 hours with an LLM.


Any sufficiently advanced simulacrum of love[...]


That's going to be a very short term solution, no?

You can't really swear off looking at problems solved by AI, or keep moving away from fields whenever AI starts contributing, and have a viable career.

Today's frontier models, are everybody's local models in the near future.

If this were a change that had expected stalls or reprieves it would be different.

Doing mathematics looks to be the next chess, er, I mean protein folding challenge. The latter's computation demands have dropped significantly.


You have many fields that will be protected from ai, or even enabled by it - if I could bet, sociology will be a hot new field that will by definition still need humans always, but will gain both speed and significance.


If there is a field that desperately needs practitioners, it is net-sum political system design and dysfunction mitigation and elimination.

When things really start going downhill, if we are still in the current mess, it will grease the the wheels, and the brakes.


There are an infinite number of problems that require a unique proof (you can prove this btw). Yes maybe you need to work harder to find a more obscure problem now but why give up the fight already? I believe that students should have the right to intellectually stimulating education. If you really need to use AI, go for something that isn’t trying to put you out of business or destroy your right to a decent education, like a local open weights LLM.


> There are an infinite number of problems that require a unique proof

Yes. The problem isn't that there won't be any problems. The problem will be the rate of general progress and solutions that at least some awareness is required of, to reliably identify a good new unsolved problem will just keep getting more challenging. And then an attempt needs to be make, to solve it in a very short time.

There is always another race to run too, but increasingly slow runners don't find that translates to winning.

This change is not going to slow down, it is going to speed up. Machines will be doing math systematically, checking off the meta-math theorems that ensure axiom combinations are covered, that the search does not stop where theorems are not exhausted, and does stop where it can be proven they are. Humans will never operate at that level.


That might be like telling early biologists to throw away their microscopes because they are unfair competition to human eyes.


It’s more like avoiding looking at the answer key while doing homework to be able to pass an exam and to understand the material better, especially for the grad students who haven’t gotten their PhDs yet. Personally I think responsible AI use is possible (not all AHM members completely avoid AI, but it’s notable that some heavy hitters do), but it’s best not to use a closed model trying to replace you. Use an open model that won’t train on your data.


I think we should apply AI into human, so we could be better and then start doing more advanced stuff required for the Universe explorations. Current AI/LLMs can be considered as first step to that. Take and look about our history. We could never achieve so many if we stopped doing great things because of .

Why do we ever use PCs, smartphones, Internet, electricity, medicine and so on? Why do we live? For what?


I don’t have a problem with using AI in the applied sciences once a researcher has proven their skills. I do have a problem with it damaging education, the pure math pipeline, and art.


I understand but I guess the future (far future or who knows) could be like that human just download SKILL and that's it - no more learning, study ing basic things. While basic things could be advanced math, computer science, biology and just everything (or nearly everything) what human do. I know it is science fiction right now but who knows. Smartphone + the Internet were step 0. AI/LLMs are next iteration. Still knowledge is valueable and so on but I guess eventually we get to the point which I said. Then galaxy exploration - if we still be here alive :)


I don't have a problem with AI to generate code..so long as the developer understands the output and would review his own mess rather than expecting those who know how to code will save the burning house after everyone's left in panic.


So others will write their PhD thesis faster, will publish more, you will not publish so you will perish. The rules of the game in this business are brutal. One can count on inventing something entirely new that AI will not be able to figure out, but this is a really high bet.


Well, if they can afford in first place


Do not bet against airplanes.


With all the slop being generated I would also like to see the same initiative in the software industry.


ah yes, the ol' bury your head in the sand approach


The best part is that when the academics fix OAI’s issues, the model gets better and OAI shareholders get richer and more powerful!

As someone who uses LLM tech occasionally, this is why I prefer using open local models. If I’m making myself obsolete, at least I’m not making some asshole richer and their closed model better.


You shouldn't be getting downvoted for something that a majority of pure math and art enthusiasts believe to be true. The truth is many of these entrepreneurs and VCs are obsessed with AI not for money or human progress, but because it makes them feel closer to being a "god" rather than a mere mortal. Much of it (especially AI art) is out of spite for human creativity, which is done by mortals with limitations.


Taking the stance of moral superiority is kind of funny. And pure math and art enthusiasts don't think they are closer to being a "god" from understanding/"discovering" math?

Stop coping and deluding yourself mate.

To begin with, whether AI is the one doing the discovering or not makes no difference. Any "pure math" person would aim to understand regardless - and would be quite glad that they have a longer paved path.

Any mathematician in academic or industry is more than likely not a "pure math" person (tainted by capitalism).


> Stop coping

Isn't coping a good and useful mechanism?


Exactly what I think every time someone uses the word 'cope' these days. It's like some kind of virus.


Lmao what a ridiculous response. Yes, some mathematicians and artists are in it to feel smart. But the vast majority also just enjoy the process. Having a computer do all the work for you and just typing prompts in ruins that completely. As Ronny Chieng said in his Harvard speech, the journey is the point.

>Any mathematician in academic or industry is more than likely not a "pure math" person (tainted by capitalism)

Ignoring that I meant pure as in non applied math, let's just make it clear: you agree that mathematicians who are against capitalism encroaching on this process should be allowed to dislike it without criticism of being pretentious?


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: