Setting aside annoyance at the downtime, I'm really curious about the reasons for the failures, because I have to imagine there are some novel failure modes when serving these giant models that I haven't experienced with the kind of work I've done.

Anyone out there working in this space who can elucidate us on interesting failure scenarios unique to the space?