Yup, I think the same applies to traffic of arms regulations.. Private firms sell to countries they are 'allowed' to, passing it between organisations in a chain until they get to the original customer they couldn't sell to directly.. Cuts are taken along the way, and people making money look the other way..
If call centres are anything to go by, it will be penalized to work on a single thing at once. The longer your workplace can resist measurements related to agents, the more sane the workplace will remain IMO, otherwise, it will turn into what happened to call centres around the 2000s. Measure everything down to the second, and introduce expectations that you will need to spend time justifying if you miss them.
IMO then it is missing the forest for the trees regarding open weight models. Qwen 3.8 Flash Next or 27B, for example, are accessible enough to run at home/office at very usable speeds. Provided memory companies don't collude to keep margins at 80-90% they are at the moment, it seems to me this will become a lot more accessible for many use cases while models at this size still have room to improve.
I have real world data here.
On a 5060 Ti (16GB) with 64GB RAM, I’m getting ~65 tok/s on decoding and ~450 tok/s prefil for Qwen 3.8 Flash Next. 256K context.
This is totally suitable (speed wise) for coding.
This is not some top of the line hardware (might be now, but it should be run of the mill for people that built their system <1.5 years ago).
No, I'm using strata. This is a MoE model, so it keeps the last used model in VRAM, and the rest in RAM. If it needs, it swaps the less used model in VRAM for the model in RAM for the next token.
Software is improving quickly so take these numbers as a snapshot performance at best. Strata has really shown how much performance is left on the table. I have a dual A4000 16gb (Ampere) on an old X99 dual Xeon E5-2680 v4 with 128gb of memory and Qwen 3.8 Flash Next at the IQ3-S size (~96Gb) runs at 65-75 t/s which is extremely useable.
It's not impressive? Thats about "as slow" as M5 Ultra Mac Studio. That's just speed here is prettu much limited by bus width. You get 1.8 TB/s with 5090 or RTX PRO 6000.
The US is getting fleeced! 8 years ago it cost me about $10k AUD to install 6kW. Yes, it came with a $2.8k subsidy but still we are talking about a third.. 8 years ago.. And I paid extra for a Fronius inverter.
Australia pays their tradies higher wages than solar installers in the US, and still has far cheaper costs.
Here's a long podcast episode talking about why it's so much more expensive in the US versus Australia, with a solar expert from Australia that had just added a bunch of C&I solar here in the US:
As an Aussie you should know the American way, pay executives or management absurd amounts and the people who actually get their hands dirty get paid as little as possible.
The far lower costs in Australia are not due to executive pay, it's due to basic efficiency. Americans are doing things in horrendously wasteful ways, because the system is set to act that way, and changing our system of government is too difficult due to political infighting. One of many examples in the article:
> These things are highly optimized that companies will try to do the scheduling so they’re doing two or three jobs on the same street or in the same suburb on the same day, so they don’t have to drive across town to do the second job. If there’s a delay of a couple of days, it’s because they’re trying to make sure that they’re going to do your neighbors at the same time they’re going to do yours. The thing that costs you money in contracting is what they call truck rolls. I believe in the US there’s something like five or six truck rolls per solar installation. In Australia, it’s as few as one or two.
See also the US healthcare system. Or residential building.
> Americans are doing things in horrendously wasteful ways, because the system is set to act that way, and changing our system of government is too difficult due to political infighting. One of many examples in the article:
What system exactly. Offices ?
> See also the US healthcare system.
The US healthcare is full of suits getting commissions and powerpoints.
It is well known in Australia that you can make a lot of money working as a tradie. Better than software developers do here that's for sure. You are lucky if you can get a tradie to step foot inside your house for less than $200 USD, then the hourly costs start running away pretty quick.
$200 is about the going rate to get somebody to show up in the US as well (DC-metro, specifically). Maybe not for a generic handyman (though that's increasingly true as well), but somebody with a license and training (electrician, plumber).
Taking abandonware titles, and essentially doing a port/remaster that isn't byte for byte accurate but is far easier to mod I think is where the interesting work and value is here. The legal side is going to get messy though.
reply