I'd like to get the reasoning trace by stage in order to verify the AI work. I'd like the AI to explain me why it thinks I'm lacking knowledge on some specific topic or sub-topic.

To finally trust the AI I'd like for it to find (if the content has already some human created exercises) or generate some question/exercise that confirms their diagnosis.

You can't simplify learning that way, learning is expanding your mental horizon, by learning something you grow and can take bigger things.

But you can also learn how to use LLM The point about higher level of abstraction yadda yadda

The LLMs are a way to get quick feedback and getting it promotes quicker learning (if the feedback is good). Learning is difficult, sometimes I get blocked on something and before llms that could prevent me from learning some material, nowadays I have another tool to help me unblock and learn faster.

I think that could be called a shortcut, not in learning per se, but in the process of getting to learn.

SQL seems to be a great fit because of how easy is to verify the output.

Are you building something in this space? Or are you giving the resources directly to a llm chat interface along with some prompt?

No, I am requesting resources for my learning. E.g., I want to learn a new skill - compare several alternatives by pricing and effectiveness. If I already have some candidates, I can request llm to search for reviews

Do you trust everything you read or how do you verify that the LLM is not hallucinating and giving you erroneus content?

How do you verify that books and websites and videos are not giving you erroneous content?

You trust some and distrust others at face value based on prior experience and what you want to believe. Sometimes you check after the fact and sometimes you don’t.

It’s the same exact thing with LLMs.