To be fair, Open Source has always been a threat to proprietary software. To be concrete, and I don't care what anyone else says, I will always prefer Krita to PhotoShop (because it is free, open, _and_ better, IMHO).
LLMs just make it possible to get a minimum-viable-clone very quickly (whether it is as good as a traditional open-source re-implementation, is a different matter).
The only software that I am happy to pay for is: Mathematica, and a handful of video games.
A big problem with patents is that they are designed to deprive other people of the right to practice an idea. Even if all software was automatically patented (somehow), you almost certainly would not be able to afford to defend your patents. And even if patent-defense-costs became socialized, you would still have to ensure that you are practicing fewer _external_ patents than _internal_ patents (otherwise, your royalty costs will exceed your royalty profits).
Edison industrialized the creation of patents (e.g. he would hire thousands of bright young graduates, and have them invent things, and then patent them in his own name). I once read a book that said Thomas Edison was the "greatest inventor" because he held thousands of patents. The reality is that he invented a tiny fraction of those patents, and he merely put his name on the work of other people.
My point is, if the auto-software-patent scenario becomes true, then wealthy people/organizations/oligopolies will create a patent-factory, made of either people, LLMs, or (more likely) both.
In a sense, OpenAI is already doing this for mathematical theorems (they use both LLMs _and_ a team of world-class mathematicians, much like Edison did in his day).
When I was growing up, patents were explained to us (children) as a means to protect the brilliant, solitary, but underfunded inventor -- a way to even the playing field. This has not been true for the entirety of my lifetime (36 years now), and has probably been untrue for the last century, at least.
The laws are not there to protect you and your interests, but rather they are there to protect the interests of the oligopolists (any protections you receive are _downstream_ of that).
If you want protections, you need to be sitting on top of a giant money-faucet. If you are already sitting on the money-faucet, then you probably don't strictly _need_ the protections.
Making money off of software has been a disappointing business for a while now (e.g. when I started out in the industry, the dominant business model was: turn a free Unix tool into a SaaS, and charge the innocent computer-user extortionary rents, or feed them ads, or both). The current business model is: sell plagiarism as a service.
The only reason that people talk about "moats" is because rent and food and healthcare are not free. The LLM companies are in the business of draining every moat they can find, and use the water to fill their own moat. Relying on the law to protect your moat for you is a fantasy, because every successful company finds a way to avoid or externalize the consequences of breaking the law.
Furthermore, the laws get changed whenever they become inconvenient. For example, the draft-age-limit was 35. When the Iran War started, I was relieved that I would become undraftable in less than a year. But a few months ago, they raised the limit to 42.
My rhetorical question to you (plural) is: if the establishment can change the rules, whenever they deem them inconvenient, why should we not _break_ the rules, whenever _we_ deem them inconvenient?
I mean, most of the code is open source. With enough enthusiasm and skill, you could probably make a reasonable home-lab out of that code, and some second hand hardware. And yeah, it would not be _hardware-software-co-design_, but it would be better than nothing, plus you will -- for a brief shining moment -- be the only person on planet earth (who is not formally affiliated with Oxide) who has an Oxide home-lab.
You could be a hero. A legend. The internet might even write poems and sing songs about you.
Before I joined Oxide I did a little fan-boying (as one does) and put together home lab components as best I could. You _could_ tie 3+ mini-PCs together and wrangle omicron into some semblance of working that way. But it would not be pretty.
You'll get a single node control plane that's mostly workable, and be able to spin up VMs all day with it. That's what I did. Additionally, if you want to play with microcontrollers you can install Hubris onto STM32H753ZI dev boards! I have one connected to my TrueNAS server over UART and USBTTY for sensors, power management, and console.
Honestly, right now I'm pretty happy with my Nomad and heterogeneous hardware setup of cobbled together compute. But it's honestly not a bad side project idea.
Tried to share and explain that paper to a colleague a few months ago (in relation to discussions about agentic coding and whether you should read the code), and they did not really get why the analogy was relevant outside of compiler-design. I think you overestimate the caliber of the typical working programmer.
The LLM companies, like most SV companies, are just betting on dimness, laziness, and impulsiveness. Not so different from tobacco and alcohol companies.
Anthropic published an article about changes over time in how long it took engineers to approve AI code. Basically the longer an engineer uses AI the faster they start approving it's code changes. I don't know if it is laziness or just how we are wired to behave but that is the nature of AI programming.
Many languages can compile a subset of their code to FPGA HDLs. Back in the 80s Harel's group had statecharts that were compilable to C, C++, and FPGA HDLs. Not sure that LLMs brings anything substantially new to this.
Someone once told me, any illegal thing can become legal if you add extra steps. This is not _legally_ true, but it is _practically_ true. Evading a tariff is illegal, until you start using a proxy-country. Firing an employee, and not giving them severance is illegal, until you find a way to make their job so miserable, that they quit on their own. Really, if you can turn signal into _noise_, it becomes difficult and expensive for the enforcement organs to actually enforce their own rules.
It is unclear to me just what percentage of tech-companies, are in the business of adding extra steps to an illegal process, of turning signal into noise. For example, the vapes made by Juul are a kind of hack around public health laws. The Amazon marketplace shields merchants who sell counterfeit goods. Uber and Lyft bypassed the local laws that applied to taxi services and the medallion system. Airbnb did something similar with the laws governing hotels, and delineating who owns and who rents.
It is a special kind of disappointment, to be someone who loves technology, and to have to work in the technology industry -- because it appears to be run by people who hate everything that is not money.
People were always able to "instantly use it at the drop of a hat" (paraphrased). What people are objecting to, is instant use without any acknowledgement or attribution (the minimum courtesy). They also object to being mistreated by people who have never actually had to type characters of code into a text-editor, or figure out how to use a build-system and version-control-system. And finally, they object to having their _free_ and _generous_ labor turn millionaires into billionaires (and billionaires into trillionaires), while they themselves still have to pay that one mortgage they have, and medical bills, and tuition, and so on.
They object to the systematized devaluing of their work. They object to becoming a class of invisible laborers (who only become visible when there is need to blame someone).
Funny how, when Aaron Swartz did the exact same thing (in a much narrower and more focused way), he was driven to suicide by the US government, but when Sam and Dario do it, people argue about whether (or not) "IP is real".
Note that society is more about justice than it is about philosophy or logic. Whether you believe that IP makes logical sense or not, is not terribly relevant through the lens of justice. To allow the Altmans and Amodeis of the world to escape the kinds of consequences that Swartz could not (despite having purer intentions than either -- despite being a genuine utilitarian, instead of an aspiring oligarch _pretending_ to be one), would be the height of injustice.
It would be a grotesque and cruel insult to all the people who remember Swartz, and share his values and optimism about the internet and computers.
Why would I want it to happen to more people? This is, at least to me, an insane point of view.
"Oh my god, the police just shot a black man for no reason. To make this fair they should also shoot more white people for no reason". Do you see how absolutely unhinged that sounds?
There are two injustices here. The first injustice is the sheer existence of this notion of intellectual property. The second injustice stems from the selective application of the associated laws.
Intellectual property should not exist, but since it does, one can and should expect it to be applied consistently in all cases. Just look at what they did to Kim Dotcom, he basically got destroyed. SWAT rappelled down helicopters and descended upon this guy for the egregious crime of copying bits. That's exactly what should happen to Anthropic, OpenAI, Google and Meta. Anything less than that is an insult to previous enforcement victims.
Inconsistency robs authorities of all credibility. Selective enforcement exposes them for the arbitrary tyrants they are and delegitimizes their decisions.
"For my friends, everything. For everyone else, the law."
And
"Conservatism consists of exactly one proposition, to wit: There must be in-groups whom the law protects but does not bind, alongside out-groups whom the law binds but does not protect."
I usually shit post on this website because it’s full of amoral idiots who just want to make a lot of money and don’t care about others, but I want to suggest to you that arguing using extreme analogies is almost never a persuasive rhetorical device. The other person almost always just sees the way it doesn’t accurately apply to the situation.
I didn't want to bring up Aaron Swartz myself first, but now that you did and proved the point I did not want to post first, I nevertheless will:
It's a cruel and sad irony that people invoke Aaron Swartz to argue directly opposite worldviews depending on prevailing fashion, making him into some kind of perpetuum mobile in his grave. Literally the same arguments, using his memory to argue position that's opposite to what was argued two years ago, back before AI fully took off.
I personally doubt Aaron would be against AI companies doing what they did on the grounds of intellectual property. There's plenty of things to hate about how AI is transforming the world, but this is not it.
The funny thing about having a divine source for rights is also recognizing that humans are fallible and thus inevitably going to be unable to live up to that standard. This argument is the basis for people who want government to have limited powers- the less power it has, the less it can abuse it.
There's a flip side to this as well- President Lincoln famously suspended habeus corpus unilaterally in violation of the Constitution, outright ignoring a Supreme Court ruling in the process. It became moot when Congress retroactively approved the suspension and allowed it to continue for the remainder of the civil war. Lincoln remains celebrated, despite what could rightfully be argued as blatantly unconstitutional power grabs.
The use of the term divine at the time was more of an aftereffect of most people having some kind of belief in god and using that as a casus belli to redistribute power. The actual causal reasons seem more technological and more of England spreading themselves too thin. Lincoln went on to further prove there is no divine power enforcing these rights, it's the distribution of power and information that defines the rights you have. The Constitution is simply a piece of paper, not an agent.
We see this happening again in our modern world. Technology has allowed us to concentrate information like never before. If you believe knowledge (hence processing of information) is power then we've created new power structures that must change society.
Now, we can say things like "well, you can't concentrate information" but the other party can simply disagree and say it's my divine right to. You're at an impasse unless you plan on taking up a path to violence (any and every legal action is implied violence).
> Lincoln went on to further prove there is no divine power enforcing these rights,
This is a straw man that nobody is arguing.
> Now, we can say things like "well, you can't concentrate information"
Again, nobody is arguing that "concentrating information" is bad. They're arguing that the expression of ideas in a specific format is a type of property, and that what AI companies are doing is immoral theft. Further, states and the federal government have the means and impetus to prosecute theft according to the powers given them by the Constitution. The only thing that is stopping them from doing so is that the claim that theft has occurred is contested, and the method in question has not been successfully tried in court in the broad.
This site actually reminds of the TUIs that one uses to install an OS from the text-console. It's not so bad. The prose itself is irritating. The site itself also has some bugs (text overlapping with UI borders for no reason). The lime-green color is a little awkward to my eye, but maybe that's just me (I say this as someone who usually likes lime-green -- maybe the problem is that this site needs _more_ lime-green).
The various advances in LLM technology tend to rhyme with the advances in computer programming in general. For example, the stunts that involved getting LLMs to create compilers and browsers are really just extremely expensive[0] versions of genetic programming (none of it would have worked without using the test-suite as a fitness-function). The recent news of migrations from one test-framework to another (featuring Asana, I believe), was something that we could always do trivially in a language that was based on S-Expressions (Lisp, Scheme, etc).
In fact, both Cyc and the "AI" Labs have the _same basic thesis_: Intelligence is, primarily, a data entry problem. They just disagree about what kinds of heuristics should be run over that data (logic-programs, neural-nets).
Whenever I read about someone using LLMs to write code, it _very closely_ resembles how Lenat was using Eurisko/Cyc to solve problems: they let the system run continuously, and they "nudge" it in "interesting" directions, "when it gets stuck", or "runs out of steam". (Quotes indicate their phrasing, not mine)
Even Lee Spector noticed something analogous with his genetic programming system. When he tried to get it to discover optimal data structures (or maybe it was sorting algorithms, I forget), the system would quickly "run out of steam", without a solution. But when they added new verbs/opcodes to the system, that were a better fit for that domain (e.g. index-based memory loads + stores), it converged on a solution very quickly (even for GP, domain specific languages keep delivering unreasonable wins). You will note that this rhymes with the "micro-theories" of Cyc, which in turn rhyme with the SLMs of the AI labs.
In my personal experience, most of the "silver bullets" do not work (obviously), but some of them do nudge you towards being a better programmer (by refining your intuition about the problem specifically, and computers more generally).
EDIT: just remembered something. LLMs tend to produce larger and larger programs over time, and most people (IIRC) interpret this as a kind of entropy. This happens to rhyme with a similarly observed behavior in GP. Most genetic programs that do not have a fitness function that rewards smaller size, tend to grow in an unbounded way. The reason for this, is that most of the code/genes are useless, and random mutations do not lobotomize the program under evolution. I suspect that the coding LLMs tend to grow their code for similar reasons.
[0]: I suspect that, this was mostly a triumph of enormous amounts of hardware, more than the actual LLM technology. I further suspect that a traditional GP approach, on the same quantity of hardware, could have gotten there faster (if not better as well).
I would not necessarily call it genetic programming. But you can discover the same pattern e.g. for human knowledge. We have a domain language for math and when we go deeper we will have domain language for algebra, discrete math etc.. and we could go even further to breaking it to even for more specific areas simply to compact the information to deliver. The goal is more and precise information with less words, it might be for communication or to be able to fit the knowledge into the processing capacity.
So for me it is not like the advances in programing languages, but more like to compacting information/representation with domain language. It's similar but not quite genetic programming.
I am not calling it GP. I am pointing out that AI-coding systems tend to resemble GP systems in terms of both broad architecture, and in terms of how the code/genome is generated. Also, I already mentioned domain specific languages, in the context of GP, and how (effectively) creating one (i.e. selecting only relevant genes/verbs) that was a better match for the problem domain, made the GP find a solution infinitely faster[0]. Clearly these two things are not contradictory, and are clearly related, to the point that they can be combined. I am not sure what about my comment gave you the impression that I thought one was contradictory with the other. Hope this follow-up clears things up.
[0]: Because, in effect, we are decreasing the size of the search-space. Every programming-language project is basically a set of bets, that the design choices will decrease the size of the search space for the users of that language (most Unix commands fit this pattern, as do most well designed APIs). Mathematics is similar, in that the notation is specialized and sparse (even the named constants and variables have symbolic names, instead of meaningful names). Most system dynamics models could have the names of entities replaced with id-numbers, and they would continue to function. The whole point of (for example) a library is to give a tiny parameterized notation/language, that the user can use to express a solution to their problem, in terms of the problem domain itself. This decreasing of the search-space, is an act of compression. I have to say, I am a little confused by your reply, because it has the tone of a disagreement, but it does not really disagree with anything that I have written. Also, I have given various examples to support my analogies, but you have offered zero examples, and I suspect that there would be less confusion (on my part) if you did.
LLMs just make it possible to get a minimum-viable-clone very quickly (whether it is as good as a traditional open-source re-implementation, is a different matter).
The only software that I am happy to pay for is: Mathematica, and a handful of video games.
A big problem with patents is that they are designed to deprive other people of the right to practice an idea. Even if all software was automatically patented (somehow), you almost certainly would not be able to afford to defend your patents. And even if patent-defense-costs became socialized, you would still have to ensure that you are practicing fewer _external_ patents than _internal_ patents (otherwise, your royalty costs will exceed your royalty profits).
Edison industrialized the creation of patents (e.g. he would hire thousands of bright young graduates, and have them invent things, and then patent them in his own name). I once read a book that said Thomas Edison was the "greatest inventor" because he held thousands of patents. The reality is that he invented a tiny fraction of those patents, and he merely put his name on the work of other people.
My point is, if the auto-software-patent scenario becomes true, then wealthy people/organizations/oligopolies will create a patent-factory, made of either people, LLMs, or (more likely) both.
In a sense, OpenAI is already doing this for mathematical theorems (they use both LLMs _and_ a team of world-class mathematicians, much like Edison did in his day).
When I was growing up, patents were explained to us (children) as a means to protect the brilliant, solitary, but underfunded inventor -- a way to even the playing field. This has not been true for the entirety of my lifetime (36 years now), and has probably been untrue for the last century, at least.
The laws are not there to protect you and your interests, but rather they are there to protect the interests of the oligopolists (any protections you receive are _downstream_ of that).
If you want protections, you need to be sitting on top of a giant money-faucet. If you are already sitting on the money-faucet, then you probably don't strictly _need_ the protections.
Making money off of software has been a disappointing business for a while now (e.g. when I started out in the industry, the dominant business model was: turn a free Unix tool into a SaaS, and charge the innocent computer-user extortionary rents, or feed them ads, or both). The current business model is: sell plagiarism as a service.
The only reason that people talk about "moats" is because rent and food and healthcare are not free. The LLM companies are in the business of draining every moat they can find, and use the water to fill their own moat. Relying on the law to protect your moat for you is a fantasy, because every successful company finds a way to avoid or externalize the consequences of breaking the law.
Furthermore, the laws get changed whenever they become inconvenient. For example, the draft-age-limit was 35. When the Iran War started, I was relieved that I would become undraftable in less than a year. But a few months ago, they raised the limit to 42.
My rhetorical question to you (plural) is: if the establishment can change the rules, whenever they deem them inconvenient, why should we not _break_ the rules, whenever _we_ deem them inconvenient?