If you’re using the latest models( Opus/Fable/Astra/ maybe Sol) and the default harness, along with a little guidance against the worst tendencies like over-writing tests, you really shouldn’t be getting the wrong things built. Like a coworker, you can’t throw it blind into a monster codebase without some guidance, but otherwise the latest models genuinely just work TM.
Testing, testing, and more testing. In the project I'm working on right now, about 2/3 of the code is in one way or another related to testing. As a human coder, I'd never spend that much time on building test harnesses, automating regressions, writing unit tests, etc, but it's cheap when you can have a robot do it.
At my work we still have a QA dept that runs the manual test suites before each release. We have also automated almost all of those manual tests and they gate every merge to mainline.
Things are still found but normally it is a new test case or an edge condition we don’t have an automated test for. The ever growing e2e suite has reduced the amount of regressions pretty drastically.
EDIT: I forgot to note that automated e2e tests were always the answer to improving quality. AI has just made it cheap to have several layers of test coverage.
"EmbeddingGemma 2 is made by Google DeepMind and released under Apache 2.0. This is an independent project, not affiliated with or endorsed by Google."
Running an LLM to delete files seems like overkill to me. Couldn't a cron job do the same thing? Or is the clutter just put into random places, which, if true, seems like bad software, which then leads me to consider the output of LLMs in general, which then leads me to wonder why are we doing this?
You keep your source tree on a separate file system with version control, one hopes.
So you only snapshot the rest. (And since your source tree is under version control, finding stray garbage there is straightforward unless you checked it in)
reply