There are parallels here to the way much of Africa fixed land-lines phones and went straight to mobile. Which has also been powered by Chinese hardware.
Arguably if you consciously choose to invest on a stock there should be no protection or obstacle other than regulated controls. For indices I see the point of extra protection. Where it gets murky is when you look at retirement funds, where you still have no control, but that should be regulation on the funds themselves rather than the stock.
Given Titan was an entirely preventable disaster borne of arrogance and stupidity it seems an apt analogy for the frontier labs 'sandboxing' efforts so far.
If they genuinely believe these models are going to obliterate the human race their utterly cavalier attitudes is be grounds for immediate government shutdown/takeover and arrest of everyone involved. If this was nuclear or biological research work none of this would be tolerated.
Their recent update on this situation was hilarious.
> Our [new] approach to containment starts with a paramount requirement: the limits on what an agent can access must hold even when the agent tries to circumvent them. We define a strict security boundary around the resources the agent is authorized to use and design the surrounding infrastructure to enforce that boundary—even when agents make sustained, sophisticated attempts to breach it.
Oh! So we’re digging a moat again, but this time an extra-super-double-good moat. With alligators. Well that’s that sorted then!
Maybe we can use AI agents to patrol the boundary for the AI agents. After all, the only thing that stops a bad guy with an AI swarm is a good guy with an AI swarm…
Ah! Of course:
> Teams of frontier-model agents were tasked with finding vulnerabilities and misconfigurations that could allow them to take unauthorized actions […] Accordingly, we’ve made high-compute red-teaming part of the safety cases we use to evaluate whether our frontier training and evaluation runs can proceed securely.
We added a strip of reflective tape which confuses its navigation sensor, we never expected it to run its sweeper motor at 10% power and push a pile of debris over the strip. Our bad.
Data visualisation can never be neutral for the same reason photography can never be neutral - you cannot do it without making endless decisions about framing even if you try and capture your subject ‘neutrally’. What you include, what you don’t, whether your axies focus on the charge range or full numeric ranges and so on. See Susan Sontag’s On Phototography for a deeply considered read on this.
The total failure of PurpleBricks attempt to disrupt estate agents in the UK is a good example of this. Turns out people had no idea of the shit-shovelling, chivvying and smoothing-over agents do to help sales actually close.
Sounds like some PM is jealous of Whoop and trying to launder the cost and boost adoption of their unwanted AI feature/subscription behind a heavily used existing feature.
Look at spaces where ripoffs/copying are already rampant like mobile games. The result is a slop avalanche, rending the whole space commercially unviable for anything other than the most bottom-of-the-barrel dark-pattern shitware laden with scam ads and spyware because users don't care and won't pay.
That may well be the future for most commercial software (and software engineers) as margins collapse and AI tokenomics moves more power from labor to capital.
The tone is angry but understandably so. The labour, creativity and innovation of millions is being stolen and then belittled by grifters shilling slop. Art, design, math, music, software, there's nothing they won't claim they can now copyright-launder and somehow magically render obsolete. But look at any of it and it's never more than the simulacrum of real work. It always looks like the real thing, particularly to the untrained eye but it's always a tissue-paper of stolen work and half-assed, half-working, sloppy output. The prompters are lazy and so are the models.
These are powerful, interesting tools but the money, the hype and the grift is just intollerable, a pox on it all. If you're a professional you cannot ignore or avoid it, but you can push towards a future where the commodification of it - open models, open weights, open hardware - turns it into a low-margin overlay on real intellectual work and the hype/grift machine can move on to whatever intellectually bankrupt boondoggle they find next.
Guess, that cruising phase of a ton of careers is cut short. Its back to the trenches, to work and shovel till death comes for us keyboard slaves. If some singularity demon can undo your moat, you never had one to begin with.
My team are and the full Adobe plans and for our use cases it's also not important. We do have a few workflows that dive deeper into niche tools only Photoshop has though, but I can see competitors making streamlined apps for specific use cases that can compete. It's actually kind of tempting to see if I can get something done over a couple nweekends and see if it'd be usable
reply