Two points I think making AI-generated code opensource
Point 1: AI can (or will be able to) reverse engineer all code from how the program works. Thus, there seems to be little point in opensourcing AI generated code because it can just be reversed engineered
Point 2: Correct me if wrong but can AI generated code actually be copyrighted? If someone just keeps prompting but not touching the code would this still be considered pure AI generated work? If this is the case then point 1 and point 2 basically means AI generated code is already open source in effect if not in name.
I guess it could help determine physical tampering. While you lock your computer, someone could stick something on the laptop or inside it such as a microphone, location tracker etc. That app will help for that type of situation. Perhaps unlikely situation but still within the realm of possibility.
Also could be cool to see if your "friends" + "family" try to access your locked computer.
I think many people will be quite content not merging with AI and having AI do everything for them. Perhaps only a small subset of people will want to merge with AI. They may not be allowed to though, if majority of people fine not merging then they may ban those who want to merge.
The subset of people who will want to merge will be people who will not be content with having no control over their future. No ability to create new inventions, new discoveries, new ways of working. They will not be content with just having everything provided to them, playing the social games that will remain and think their environment is a prison.
The question is how long before machines can exceed humans in every way and how long will it take before legal and cultural restrictions allow this to happen. It still could be a long time away and jobs will probably increase in the short/medium term as AI unlocks more what humans can do at a rate faster than AI can automate away.
But lets consider what that end state could look like when machines exceed humans in everyway, what good are humans?
One possibility which I don't particularly enjoy is humans will be good for status games, art, creativity, story telling, IRL experiences, everything that involves human to human interaction and connection with other humans. If AI can supply everything in abundance than like rare cards there is only so many humans in the planet at any particular time then human's value increases. I really do believe connections with other humans will have a premium. As a nerd who is borderline anti-social, non artistic, creative, etc this does not appeal at all to me and properly to many others who read HN as well. For the majority of other people with some adaption time I think they will be fine. They were fine adapting to hunters and gathers to agricultural society, they were fine adapting to agricultural society to industrial society, they were find adapting from industrial society to information society and they will will be fine adapting from information society to the social/creative economy. Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
If a computer wins a chess game it doesn't enjoy winning nearly as much as a human would enjoy losing from another human. And that's just chess. Now extrapolate to everything else.
> Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
How do you propose this brave new world of yours will work economically?
I'm not yet even in my 50s, yet when I was young digital work mostly did not exist. Somebody who claimed the future would have people sitting in front of screens typing away being a huge part of the economy would have seemed a bit kooky. To say nothing of there being trillion dollar companies whose primary 'product' is selling ad space on the fledgling internet, an internet that it took forever for 'normies' to even realize existed.
It seems almost a forgone conclusion at this point that LLMs are going to wreck most cognitive work, particularly in the digital domain. And a world where e.g. software creation can be almost entirely automated for very little cost doesn't mean software companies become absurdly wealthy by being able to automate away all their labor - it means it's a world where software's value approaches $0.
And that would broadly apply to all things that LLMs can automate - which is going to be most of the problem-solving digital domain. So as the value of these things decreases, the value of other things will tend to increase. And, outside of entertainment, it seems highly probable that we're looking at a return to the 'real world' being where the value of problem solving will be found.
I think that's quite predictable. You're speaking of a scenario here where people did all the things society says you're supposed to do to end up living a very comfortable life, and the outcome is anything but comfortable. That's going to be quite difficult for people to accept, and so many simply will choose not to.
It may not even be a bad decision. It's not completely clear on what timeframe this will all play out, even when it does start playing out on a larger scale there will be some software jobs, and it's not most people have great alternatives so they'd be stressing themselves out over something that they probably can't do much of anything about.
This contradiction "we have to make an agreement with China for mutual slowdown" but also "we have to ensure we will always stay ahead of China" would work. Its just fantasy. The only way to enforce this is with military force and the cost would be too unbearable. You could try trade restrictions but the previous tariffs did not work and doubt future ones will to. US citizens (and thus politicians) won't bear that pain. Thus at a minimum this contradiction will mean AI will continue to develop until both US and China are at the same level. Playing with logic gives you possible scenarios. If China catches up within 1 year then negotiations could begin. If China takes many years to catch up, say 6 months behind now, then next year 5 months behind, then year after 4 months behind then expect overall AI development to proceed at full speed. The one way you could do it is to negotiate to transfer direct technology to China that will ensure that they will have the capability to be on par with USA. Politicians won't do this publicly as they want to get elected but they could make a deal that appears to appeal to both sides while actually transferring technology.
I think the only way they could actually pace the frontier is if they restrict the number of GPUs and the power of GPUs available to each person/organization. Licenses would be needed for GPUs above a certain power or equivalent in terms of number of GPUs. Thus, everyone will have to register how many GPUs they have. To enforce this countries would have to use mass surveillance (using AI) on their citizens to ensure compliance as the technology is easier to develop than say nuclear weapons. Next stronger countries capable of having advance AI won't be able to trust weaker countries as they don't know how they will use the GPUs they receive (or even build). Thus like nuclear non-proliferation strong countries will ban weaker countries from having powerful GPUs. If you from a weaker country then too bad for you.
I think AI companies making a point is not the only thing at play. Discovering new maths ultimately leads to new technologies and applications. It may start theoretically but end up being of practical use in the future. Even if humans do not understand it (lose interest, too complex, or just way too many new proofs to go though) AI can use this AI derived math corpus which will help it in other fields.
Also add corporations. Insurance companies, Banks, Potential Employers, etc will definitively use mass surveillance and AI generated predictions based on that mass surveillance.
Wouldn't the better way be is to make social media open? i.e. anyone can generate their own algorithm or chose from others who created them. I see that the social media companies could implement these requirements in the worse possible way to ensure that they opt right back in to "choose to opt in to having their default feed include personalised content recommended by the algorithm"
Point 2: Correct me if wrong but can AI generated code actually be copyrighted? If someone just keeps prompting but not touching the code would this still be considered pure AI generated work? If this is the case then point 1 and point 2 basically means AI generated code is already open source in effect if not in name.
reply