> Annual carbon emissions aren't even trending downward, much less getting to net negative!
They were trending downward in the US. AI usage in the US did change that single-handedly. I understand carbon emissions are a global problem but since they are subject to political remedies, the solution to the global problem is solving the same problem within each political jurisdiction.
Oxide doesn't have the same type of capex opportunities that Amazon had. Amazon had a massive physical footprint to build. Oxide contracts with other companies to produce the actual boards. Most of the inventory of components they have are held in their contractor facilities. So they don't have extra warehouses to build. They could change course and adopt more in-house production. However, I think doing that during the sale of their first model would be unwise.
For these tests, why not tune the temperature and such to reduce the randomness and convert them to almost-always-succeeds vs almost-always-fails? Is it not the iteration count that drives up the cost?
Isn't the goal of the author to get reproducible behavior out of the agent though? I would thinking turning the temperature down would serve that production goal too.
1. If you turn the temperature down too far, the output is just bad and no amount of running prompts optimization will let you hill climb your way to good performance.
2. It’s not about determinism vs non-determinism. It’s about chaos. A perfectly deterministic model is still chaotic. Meaning that very small changes to the input result in very large changes to the output.
Turning temperature down doesn’t actually get you predictable or reproducible behavior across different inputs.
Thank you, I forgot about the chaotic aspect, too - that’s the other part that makes this brutal. The bot performs perfectly on your tests, but your customer abhors the Oxford comma, so you, your marketing team and your test suite can go to hell.
right, this is the whole problem - the stochastic behavior is both the goal and the problem. If you want your tests to match production, you need to get a reasonable sample size, which costs real money.
They were trending downward in the US. AI usage in the US did change that single-handedly. I understand carbon emissions are a global problem but since they are subject to political remedies, the solution to the global problem is solving the same problem within each political jurisdiction.