>Not giving them impossible tasks seems like a decent starting point

Presumably it's hard to test/train models designed to be extremely persistent on achievable tasks.

Designing a task that's achievable but very very very hard for an AI model is probably extremely difficult.