I agree their phrasing is a little strange but I feel like the meaning is still clear. They are (I believe) saying that an LLM can’t generate anything other than facsimiles of existing content. It can’t actually explore novel ideas and branches, it can’t innovate and create on its own. Everything is inherently derivative yada yada, I don’t mean it in the usual “everything is derivative” way we often refer to when people make music and such. It can’t ideate and express something personal.
I think there’s a lot of nuance and caveats to that kind of claim, assuming I am representing them correctly, but it’s a valid stance and I see where they’re coming from.
All possible books live somewhere in L-space (ook). Exploring that space efficiently is equivalent to creativity. The claim is that the space that LLMs learn is somehow sufficiently limited that it doesn’t contain novel ideas? I never saw a convincing argument why LLMs output can not be considered creative.
But LLMs don't "explore" L-space, the training process just maps all of the available conceptual landmarks inside that space. There are still enormous (infinite?) tracts of unmapped territory that LLMs never reach, and that's exactly the space where novel ideas live.
OK, I still an confused about what point the extension of the analogy was trying to make, because I didn't consider the parent comment to be arguing for or against LLMs being able to be creative.
Seems like this might be true given current implementations but not ANY implementation of the technology.
If we’ve mapped all of English, there are still ways to construct stories that haven’t been told from the mapping. The most simple would be a subtraction of all objects minus all objects that have ever been used as a murder weapon. Leaving you with a list of never before used objects at your disposal.
There are also probably close vectors conceptually but not in semantic use. Or trying to interpolate or extrapolate what exists in voids of space. Turning up the temperature and adding random generation of words. There’s tons of ways to tune these things to be more creative than regurgitative.
This is a very clinical approach to storytelling that I think makes it no longer art or creation. Writing is not just the mere assembly and reassembly of words in new and different orders. It’s about intent and communicating something one wants to say.
People who haven’t had this happen to them really don’t understand what it feels like. It feels very violating. You almost don’t believe it’s happening when you see it. You’re essentially watching somebody pretend to be you.
I think that’s why so many of us get so angry when people just dismiss the theft claim. They either lack imagination or experience. We can debate it and that is valid, but to dismiss it out of hand is not right
What should be a developer's position that's about to release software entirely written by him/herself? Are there any legal frameworks to protect open source developers at all?
It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?
If you are releasing software open source, why are you upset when someone "steals your authorship" ?
If you don't want your code copied, then don't open source it. If it bothers you that others are going to look at and "get inspired by", "make derivatives of", "copy", "fork", etc then you shouldn't be putting it out in the open.
That's not how copyleft works. You want your source to be open and the source it's part of to be open too, because at the end of the day this is not about your source this is about users being free.
I think you don't understand how open source works. If you release open source software under for example the GPL you still need to comply it.
You still have to give the source back and attribution has still to be maintained of its original authors, regardless if is a fork, a derivation or whatever you want to call it.
There are situations where none of these clauses have been complied nor its violators faced any legal consequences. That's what I'm talking about.
Now on top of that you can basically instruct and LLM to generate variations of what someone released and cover that up under the excuse that is a different project when is actually not.
Because it has been generated by a computer then we go into muddy waters about if the code generated is to be considered stolen or not.
Edit: Effectively what LLMs produce is authorship and attribution dilution.
> If you are releasing software open source, why are you upset when someone "steals your authorship" ?
because I am not releasing it into public domain, but under license that requires (for example) attribution or releasing derivative work under the same license
lolwhat. You're effectively just saying "there are bad actors who will flagrantly disrespect your code license and therefore the law, duh. So y are u mad?"
People who care about being respected on the most basic level are not going to stick around in a community that disrespects them. I'm not the person you were responding to, but I am mad because the social contract (not to mention the legal contract) of open source has basically been destroyed, and a lot of people have poured a large portion of their life into that community based in part on the assumption of that contract being upheld. Imagine a social contract that is important to you being violated to such a degree that you cannot go back to that society.
> It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?
Don't worry; the "developers" who generated your code will get their own law back when they find out it's almost impossible to monetise their theft.
I'm frequently amused by the number of "developers" on HN who claim that they poured weeks or months of effort into some product, and that they are the differentiating factor, but can't see that their weeks of effort can be cloned in a few prompts once they release.
I think they just want to be able to take whatever they want without consequence, so it's convenient for them to define it as being different from theft
I honestly find his podcast a little grating and his personality needlessly abrasive/smug at times, but at the end of the day I still read and listen here and there because the dude does nail it often enough to warrant some of his attitude.
meh, he's like Burry predicting doom and gloom no matter what. Burry was right ONCE and then pretty much never again. I don't pretend to have the truth but life taught me to chill it when I see stuff that doesn't make sense TO ME because markets have this way of staying irrational way longer than I can stay solvent.
The whole point of dumping all your infrastructure onto these companies in the first place is CYA. “Microsoft is down? Well that’s basically force majeure as far as I’m concerned.”
You get to pass the buck and management can’t be mad at you (sort of)
reply