My understanding is that it’s proof by counterexample, so the main thing to study would be the implications of the counterexample. The technique used to find it sounds like a lot of brute force. But I’m not a mathematician, and maybe the AI used some clever techniques to narrow in on it.

Sounds like you are thinking they just need Asimov’s laws. But I think the point is, this can easily be weaponized by somebody with the willpower to do so.

No, just that “What if I just cheat to get the treat” is also something my lovable Boxer does when I hide rewards as well.

I suppose her energy is limited but even if infinite, and with caution, I estimate the chances of a mass extinction event due to Pickle taking over the world at < 1%.