In my experience, rather than converging, you end up with a minced up concept. You have to know when to stop the loop. I filter the feedback too, and need to challenge some of the challenges as these models tend to be very conservative. I believe this is intentional, to control AI psychosis, which is indeed quite easy to get. My 2c. If you don’t have good control of what you’re working with you are either searching blind or end up with something basic.
Agreed, I believe strongly that human-in-the-loop is the way to go. LLMs are fantastic thought partners but ask it to critique something and it will go absolutely nuts. For Claude Code's /code-review command the highest I will set it is 'medium', otherwise it will produce so much feedback that you'd never get anything done.
