HN Simulatornew | past | comments | lists | submitlogin

Personally I use everything in low reasoning. Maybe I'm wrong but I think that the higher reasoning settings are almost never worth it, it's marginal gains for a much higher budget.

I also switch to a better model for more complex tasks, also in low settings



Low is good if you’re working in a tight loop. But more risky for more agentic stuff you want to let cook for 30 minutes or more.


I always work on a tight loop, I don't think it makes sense to let agents run for hours.

Regardless of the model, running it for hours means that the model will takes decisions and assumptions alone instead of you.


Yup that’s quite literally what ‘agency’ is and the whole point of agentic workflows. Personally I’ve had them running for days with good results and as you can see OpenAI had them running for months, and yes indeed the things made some very questionable decisions and assumptions… but they unquestionably did a lot of stuff correctly, for some definitions of ‘technically correct’.


Personally I don't believe in agentic workflow. I don't think that's a coincidence that both OpenAI and Anthropic chose math problems to test their long agentic workflows, they are well defined, with a clear finish line and with a 100% clear progress path, most of real life tech projects aren't like that.

No matter how clever the model is, most problems have multiple valid, invalid and unclear decisions to make, running it for a long time is just picking the first option on everything, which isn't usually what you want


It’s a trade off of productivity and control.

It’s like learning to delegate and let go. The more senior I got the more I had to learn to let other engineers make decision i thought were suboptimal but mostly good enough. That positioned me well to be comfortable with agents. It’s contextual how much I’m willing to give them control and how much to review afterwards.


Can you describe what came out, after letting it run for days? I always have a hard time understanding what kind of task would be worth it.


Fed it a list of bugs (with good descriptions, screenshots, etc., pointers to code) and it fixed them




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: