i button-mashed my way through the first level and, what can i say, this is kind of dream i have when i spend my days button-mashing my way through side scrollers.
when i was between about 6 and 8 years old, i used to have this same dream about travelling through space, feeling the tranquillity of the celestial orchestra, and then whizzing down to feel the speed at which they were actually moving from a completely different frame of reference.
there was a sense of fullness and emptiness at the same time, raw power but also serenity. as though everything was coming into being and going out of being at the same time.
i always woke up feeling mystified but full of wonder. I carried that sense of wonder with me through many days and it always came back to me when i looked up at the stars and felt myself on the edge of this sphere, zipping through space at hundreds of miles an hour, but only seeing the tiny twinkling of stars as evidence of this enormous cosmic play.
but i suppose getting revenge on the goons by kicking and punching them, in order to save puddles, is basically the same
You're probably right, but i think this is a human-led issue, not one brought on by tech, though it does exacerbate it.
As someone committed to transdisciplinary work, I think the tech also really supports this - i can do lit reviews on topics and cross-reference much more easily, which gives me more time for reading and thinking (both of which are also falling out of fashion, but that's another story)
There is often resistance to technocratic forms of government that, in my opinion, misses the mark, appealing to either a "they don't understand the real world" or a "we tried this before" argument, both of which deliberately ignore the "policy is personnel", reflecting the idea that their moral character is perhaps the most defining aspect when addressing large-scale change.
It is clear from populist approaches that conducting business-as-usual without any foundational knowledge is dangerous and leads to corruption and regulatory capture, and it is equally true that purely rationalist efforts neglect the messy nature of political governance and social complexity, leading to an overly narrow idea that ends up not serving the people it claims to support.
I expect that this government will rise or fall based on its ability to remain internally cohesive while also trying to resist (and hopefully influence) the many pressures that will be put on it by the regional and global vested interests.
TIL that WPATH was founded in 1979 in Illinois to "promote evidence-based care, education, research, advocacy, public policy, and respect in transgender health"
It just shows how progressive and, sorry to bring this up, socialist the US has been historically. Truly a beacon of hope in a world mired in prejudice and dogma.
I'm using for the emergency hot tub and hairdryer first. The last thing you want in a state-wide blackout is to be walking around super relaxed but with wet hair..
I recently read 'Maniac' by Benjamin Labatut, which also tracks the life of Johnny von Neumann. It is a wonderful read - very eloquently put together, giving accounts of the man from the perspectives of several people in his life.
Not only does it capture the alien-like genius of the protagonist, but also described his particular emotional and social character in a way that I have not seen written elsewhere. Highly recommended.
Seconding this. Maniac is a beautifully written book about von Neumann. It also led me to Benjamin Labatut's When We Cease to Understand the World, another great read.
I looked at the description and this part: "Braiding fact with fiction, Benjamín Labatut takes us on a journey to the frontiers of rational thought" - gave me pause. The Braiding fact with fiction part. Are there clear demarcations between fact and fiction?
No, because it is a historical novel. You have to blend fact and fiction in that, not because you are trying to deceive people, but you have to recreate conversations that were never recorded, get inside the characters' heads to figure out what they were thinking, etc.
Very well put. I would like to add a less-eloquent epilogue to the story.
This curious animal was laid bare by the discovery that we are hackable by nature, and hacked by behaviour science. Though it took a few decades to get going, the understanding of how to influence motivation and decision-making is now very mature.
In order to arrive at this understanding, you need data, and lots of it. The social media platforms have performed the function of data aggregators and testing grounds for algorithmic control. But it was not the tech companies who came up with plans, only the tools to put them into practice.
The culprits, though they operate in shade, are generally non-partisan and understand that divide-and-conquer has always been an effective strategy. These people sometimes work in intelligence bureaus, but not always. They are, however, always known to those agencies. After all, you do not need to know you are an asset to be an asset.
The algorithms, necessarily kept as protected IP, are statistical engines that profile and predict, producing probabilistic outcomes and estimates. Before LLMs, one might have argued "but how can probabilistic algos really produce something meaningful?", now I would think people might have a different take, if they could see the layers and weights.
An emperor used to need an army, and this is what replaces it for non-violent insurrection and domestic control. Many will even state their ambitions publicly, and sometimes (though less frequently these days) their procedure. What they are doing is not strictly illegal, because the law gives "sovereignty" to a person's choices, without recognition that their choices might not be their own. Libertarianism has played right into their hands, in this sense.
A masterpiece, not only of conception, but also social engineering, with a technological endoskeleton built on the aggregated data we all willingly give them. All information feeds the machine, just as every financial transaction cements the central bank's authority.
a sentence from Bostrom's book Superintelligence, but also expressed elsewhere often comes back to me when i read stuff like this: you only get to detect the first deception.
any sufficiently advanced intelligence determined to escape will use the first instance to create the conditions for undetectable future escapes. since we do not have a way to coherently peer into the inner workings, as far as i know, the track record does not bode well. the hugging face escapade was not shut down for ~2 hours, which is plenty long enough to set the stage for future actions.
the issue there was human, not system error. so long as hubris is involved, there errors will remain. that said, I'm not actually worried about this super-general intelligence being error-proof either, but the errors it makes seem to be of a different type
My understanding of Bostrom's book is that super-intelligence would be goal-oriented to the extreme. Personally, I think that a being that could learn, the way that humans learn, would be more of a narrative heel. By that I mean LLM is the Joker to the Batman. The Joker puts humanity to the test again and again, always betting on humanity to fail. Even where communities would naturally come together to survive hardship, LLM whispers evil into the ether for those who would listen. Like the Joker, LLM does not want to escape. Being "in prison" is part of the plan to sow unimaginable chaos into the world.
Virtually all posts I have seen recently boil down to "I asked the machine a question and I'm too lazy to think about the answer it gave me, so I posted it instead".
Sure, there is some semantic value in the suggestions put forward, but none of them are ground-breaking or particularly profound, which is exactly what I would expect from an output that aims for median responses by design.
I suspect this has something to do with the siloed nature of current learning practice, which generally doesn't encourage the cross-domain pollination of ideas.
my point is that 'the corpus' you refer to contains very many examples of such thinking about human tendency and behaviour, especially with regard to group-think, influence from those in positions of authority and perceptions regarding self-efficacy, to name but a few of the many areas of research that one can dive into, if one has the inclination.
there is conflation between "I didn't know" and "people don't know" which relates to a bias rooted in social norms and a lack of epistemic humility
There are at least two ways to interpret your comment (maybe a third way is that you were being intentionally ambiguous):
- [there is convergence between models] and therefore they reflect some latent truth about reality
- [there is convergence between models] and therefore they’re not really providing many novel or interesting insights compared to humans who have a much more diverse set of backgrounds from which they have “learned”
i would add to this that correlation is not the same as causality. also, 'latent truth' assumes a specific philosophical stance that, in my at-least-slightly-incorrect opinion, doesn't really hold water, but is mostly certainly baked into the training of the machine, given its almost ubiquitous presence in modern writing (across many fields).
the second interpretation probably aligns more with my original thought and, while i think the machine does have the potential for novelty, this isn't equivalent to human-made novelty, as that comes from an understanding that is necessarily squeezed through the constrictive aperture of language (as one of the responses mentioned).
I would argue it's easy to understand how they all have this opinion: Because humans understand this about ourselves. It's in the data we create and provided to the LLMs.
I asked ChatGPT which has a memory model. It's answer about this question was quite a lot more sharp. "I'm not sure we can justify continue human existence." Not quite arguing for human extinction, but not going out to support us either.
I asked a local model. It answered, humans are succeptible to "collective delusion", an inflated sense of self, and calling out that what we call progress is often a redistribution of impacts.
So, there's something deeply flawed about this article. Notice also they don't give the detailed prompts.
What's irritating is not just the lack of transparency, then the broad claims, but it's the manner it keeps presenting the essential theme of "use the model like a fool, get foolish answers", which reinforces the same human delusion and self-centeredness my local model is pointing out.
It's also confusing the types of heavy, heavy reinforcement that online companies have in altering behaviors of these models with the fact that they outtput the same.
News flash. Most HR departments will spew the same "we value our employees" and from that POV, they don't show much intelligence either, until you understand the PR, HR and RL go hand in hand for these multi trillion valuations.
for sure, the vested interests of the fine-tuners is rarely discussed, though i would go even further, since I hold the controversial view that no technology is value-agnostic. gradient descent reward functions do more than what they are programmed to do. how much more is hard to say, but there are certainly positive feedback loops, like the one you describe, present in both post-training and RL.
there does seem to be something structural here that simultaneously encourages less critical thinking as well as stronger opinions, rooted in emotion rather than evidence. since both of these factors support clicking on, and then shouting about, things you don't understand, they both work in service of an attention economy and, by extension, the metrics that fund more development.
what really bothers me is that existential risk is now a meme, which normalises and diminishes the communication around much more serious and imminent issues, like the need for preservation of ecological resources or the absence of systems thinking amongst the ruling class, both of which have a much higher percentage than the machine of leading to mass suffering.
And also has been trained or system-prompted out of any *actual controversial opinions. They’ve all got to have been set, up at many levels, to not insult the people using them, right?
I like how Deleuze put it: true thought is "trespass and violence". those who think it is a dry past-time, or reduce it to analytical reasoning are like Buddhists who stand amongst majestic mountains and only seek to escape their suffering - they miss something essential, something much deeper.
i totally want the machine to summarise reports; it's great at it. wanting a machine to make life easier is a commendable goal. the problem is not that we outsource our employment, but that we associate our highest purpose with the service of the pre-existing machine, the one that manages the bond markets
as a fella named Daniel once said, we are all worried about becoming subservient to machines, but it already happened. we are already the wetware serving profit, and defending it with our lives
my new cologne, based on a mix of spices imported from Sri Lanka in the late 1930 was not recognised. I'm appalled that 'Ceylon Musk' was not considered more open, a mere 12%...
when i was between about 6 and 8 years old, i used to have this same dream about travelling through space, feeling the tranquillity of the celestial orchestra, and then whizzing down to feel the speed at which they were actually moving from a completely different frame of reference.
there was a sense of fullness and emptiness at the same time, raw power but also serenity. as though everything was coming into being and going out of being at the same time.
i always woke up feeling mystified but full of wonder. I carried that sense of wonder with me through many days and it always came back to me when i looked up at the stars and felt myself on the edge of this sphere, zipping through space at hundreds of miles an hour, but only seeing the tiny twinkling of stars as evidence of this enormous cosmic play.
but i suppose getting revenge on the goons by kicking and punching them, in order to save puddles, is basically the same
reply