This doesn’t sound as much that “LLMs can’t help me” as much as “trying to one-shot a complicated answer in a chatbot can’t help me”. Output straight from a generative model definitely should not be trusted.
But that doesn’t mean that an appropriate harness (even Claude code and a dynamic workflow) can’t complete, and validate, an answer.
Seems like it would be a massive market to make such a harness, and yet you're making it sound very easy to do. It would be surprising no one has done it if it were.
Harvey and Clio both make entire products around this. They have raised billions of dollars.
That's not really the point though; it doesn't have to be "legal specific".
The key is in understanding that "Basic chatbots (claude, chatgpt, etc) hallucinate. Independently verify the output (even if it's another model doing the verification) before assuming it's correct".
But that doesn’t mean that an appropriate harness (even Claude code and a dynamic workflow) can’t complete, and validate, an answer.