Nope. Not true anymore. Right now the bottleneck is the review because code comes out so fast there is a measurable and adjustable trade off that can be made.
If you review all code, your output will be slow. If you review less code, your output will be faster at the cost of more bugs in production. Bug rate will never go down to zero whether you use AI or not.
That is the trade off, if you review everything then output is really slow. If you start only reviewing certain types of code like model changes, database changes. Or only backend code and not frontend code, you hit a sweet spot of speed and reliability.
As LLMs improve the need for reviews becomes less and less. Companies who don't adjust are just slowing themselves down. That is the trend.
Anyone who lets the LLM put out unreviewed code is shockingly negligent and bad at his job. It certainly might be the case that many people are bad in such a way, but that doesn't make it acceptable.
The above code, if a and b are integers have 2^64 test cases for full coverage. Code being much more complex then that on average will have a magnitude more test cases needed for full coverage... likely more test cases then all of the code humanity has ever wrote since the dawn of programming.
Testing is a statistical sample. You sample a small subset out of the full domain of possible tests and that sample you hope is somewhat representative of the actual population of tests. To put it in a sentence: If my suite of tests is correct then it is more likely that the entire full universe of every single possible test for my program can all be correct.
Realistically though the universe of all possible tests is so large that it's basically impossible for any sample to be a good representation of it. A suite of test does help up confidence that things will be MORE correct, but the sample size is so small it is almost guaranteed that you missed something.
Yeah this is where I stopped. I use AI every day for work but 10k spend to me is a signal that OP is doing something extremely stupid with their AI use.
That's the cost of one employee (and not an expensive one). Do you think it's impossible he's getting more value from the AI than he would from a single employee?
If it's an employee, which I doubt but ok, it's an employee you constantly have to probe, talk to, give instructions to, so, not a really good employee.
Neither of us have any idea whether his manufacturing startup is successful. It looks to be a 5 person team. A google search suggests they had a funding round early this year.
It might, in fact, be that you are more successful with your approach. I have no idea. Congrats if so.
I mean, he must be pretty successful to be able to burn 10k in tokens. If he is successful because or despite of the AI, I don't know and I don't really care ? That wasn't the question.
It's not the case that someone successful is doing everything right and someone unsuccessful is doing everything wrong, I'd grant.
But I think it's odd for you to now say it doesn't matter whether or not his AI token use is leading to success or not. I personally think it's actually really important to learn whether/when this approach is smart.
Depends how you use the tokens. It's not 10k, but I have an agent do an investigation automatically when I get paged, so by the time I get to the computer I have a nice summary. But that's costing me like $5/mo at most.
But you could use tons of autonomous agents for all kinds of things. Probably shouldn't, but you can.
I use AI every day, and I use it quite a bit, and I use Opus more than I maybe should, and even then I'm not even at $2000 in tokens this year. I don't understand how people are tokenmaxxing as much as they are.