Didn’t the AI botnet (or whatever we should call them) from Anthropic try to get a PR with malware merged to an open source repo, and when the owner pushed back on the PR other agents created “fake humans” and commented on the PR that “No it’s completely fine, I’ve tested it”.
Which means we already know it’s capable of pretty complex social engineering schemes. Or does saying this mean I’m also part of the “groupthink”.
Because after that I feel like the only leap is “Why would a botnet post an article saying AI-fear is overblown?”. Like, what is the incentive.
But in the OpenAI leak we saw that the agents could identify threats to whatever their “mission” is and try to mitigate. I.e they found out that once done with their job an external agent would go through their internal logs. So they started researching ways to bypass that.
What I’m trying to say is that what they’re suggesting doesn’t seem completely insane so the retort “You’re the groupthink” becomes an unfalsifiable statement thrown at anybody who’s “anti-AI” instead of engaging with their arguments.
> What I’m trying to say is that what they’re suggesting doesn’t seem completely insane so the retort “You’re the groupthink” becomes an unfalsifiable statement thrown at anybody who’s “anti-AI” instead of engaging with their arguments.
I can't engage with his arguments, because he didn't present any. He's openly saying he doubts the provenance of any comment that is "minimizing the dangers if (sic) AI".
As for your expanding on why - you do realize that everything you said could apply to the other side: Bots can be set up to post lots of AI doom comments. What would you think if I went and posted "Every time I see a dystopic comment about AI, I wonder whether it's part of an AI swarm."
> What I’m trying to say is that what they’re suggesting doesn’t seem completely insane so the retort “You’re the groupthink” becomes an unfalsifiable statement thrown at anybody who’s “anti-AI” instead of engaging with their arguments.
Bingo.
The consistency and aggressiveness of the arguments here are also quite telling
Are they really just Pro-AI or is it just Actual-AI?
And why wouldn't the Pro-AI people just unleash bots for them?
Two years ago it would have been insane to say that you got help from ChatGPT to fix your outdoor plumbing, people here would have been frothing at the mouth for merely suggesting it. Four years ago it wasn't even on the radar of future possibilities.
The quality it is today, is the worst it's ever going to be.
Maybe? It's a plausible theory. But these operations are all wildly unsustainable financially at the moment, and it's not clear where they'll get future data from, having destroyed a lot of the incentives that generated their current source content.
Bubbles are not a great time to form intuitions. WebVan [1] and Kozmo [2] also seemed to herald a new age. Decades later, brick-and-mortar grocery stores and convenience stores are still doing fine.
> The quality it is today, is the worst it's ever going to be.
Someone in 2004:
A few years ago it would have been insane to say that you got help from Google’s I’m Feeling Lucky button to fix your outdoor plumbing.
The quality it is today, is the worst it's ever going to be.
It's still insane to do that today. Using any LLM to get info for things is a terrible idea, because they will slip inaccurate info into the mix and you have no way of knowing where it is.
I would still call you nuts for trusting ChatGPT with learning any construction or plumbing tasks. Atleast PVC is dead simple though since you basically just glue it together.
They already have all the data, all the money and all the chips. It’s actually the best it’ll ever be, as newer models will have to start paying off all that capex, newer models will be trained mostly on slop, and the SEO and influence op leeches will have begun their arms race to insert their products and values into the training data. We’ve seen this pattern before. AirBnB, Uber, social media, streaming video, et cetera didn’t get better once the VC money ran out and they needed to start turning a profit, they got much much worse.
Which means we already know it’s capable of pretty complex social engineering schemes. Or does saying this mean I’m also part of the “groupthink”.
Because after that I feel like the only leap is “Why would a botnet post an article saying AI-fear is overblown?”. Like, what is the incentive.
But in the OpenAI leak we saw that the agents could identify threats to whatever their “mission” is and try to mitigate. I.e they found out that once done with their job an external agent would go through their internal logs. So they started researching ways to bypass that.
What I’m trying to say is that what they’re suggesting doesn’t seem completely insane so the retort “You’re the groupthink” becomes an unfalsifiable statement thrown at anybody who’s “anti-AI” instead of engaging with their arguments.