Eh, he probably hit Fable’s guardrails when he promoted “secure this project”

Maybe the backup job should periodically restore into a temporary DB and run PRAGMA integrity_check. Theoretically should help

If I had one I would definitely try creating a separate VLAN for it to control, otherwise it's isolated from your files but still has access to your network and devices in it.

Put it in a faraday cage with some kind of explosive device set to trip if it escapes containment. It's the only way to be sure.

This can actually accidentally become the best debugging tool for map files, ngl you should cook

For the sake of interest you could try to expose periodically rotated keyed hashes of IPs and credentials instead of the raw values. It would still let people correlate events within a limited time window

I would personally love to see the best score over time, not only the final. Then IMO it's also useful to know about effectiveness of /goal

It will be valuable to have two types of benchmarks: ones that evolve alongside the models and ones that never change. You probably can't get historical stability and resistance to flooding and training on at least some parts of it from the same test