> I have spent ~$50K on local AI hardware. The market value of that hardware is about ~$80K right now.

That's easy because no matter what IT hardware you bought, it's worth more now than it was two years ago. That's something that's unprecedented, never happened before, and as soon as we get flood gates open on ram manufacturing OR when the AI bubble pops, all IT HW deprecation norms will return and making a profit by buying something IT will vanish.

I had a GPU server four years ago. Had I not sold it like three years ago with 2x price I bought it, it would be likely something like 5x the price nowadays.

I really really miss filling my home rack with old enterprise stuff. All I want is this hardware winter to end.

On what hardware do they run this? If I'll visit Shenzen, can I buy these chips? I'd much rather at this stage give money to any-other-manufacturer-than-Nvidia.

I have a use case where I have to run local models, can't share data offsite.

Just as expensive unobtanium as nvidia. Maybe even more so.

Its probably the huawei ascend 910, they are using.

Why no Qi support on any watch ever? Those chargers are becoming commonplace in hotels, cars and homes but every frigging watch have to have their own cradle for them?

I'm using a cheap samsung watch, maybe 4? It's ages old at this point, but I need it to get contactless pay, I'm a sucker for it. I have multiple company and personal and virtual cards on it, and I don't like carrying a wallet everywhere with me.

What's specially shitty with using a wearos watch with an android phone is that clock's alarms etc do not sync, at least not between grapheneos <-> samsung galaxy watch 4. I have to use use turboclock which has a wearos app to get wakeup alarms to my watch.

Oh I like this idea. Looks simple and lightweight.

Expensive as f though. Also the gear-thingy looks proprietary (=expensive).

So when can I buy MI350s for my homelab?

Hopefully the MI350P is available soon, at last a standard PCIe SKU, if a bit too-much previous-generation and gimped compared to the MI350X

MI350 happens to not fit DeepSeek V4 Flash (144GB vs 180+ needed) so it will be dead on arrival.

This thing has 50% more memory than GTX PRO 6000, which fetch 18k-25k+ each right now on newegg, and generally sold out. If nvdia can still sell out 96GB PCI cards (on a 2 year old architecture) at those prices, how is an AMD equivalent with better specs dead on arrival?

Market takes time to catch up. When released Qwen 3.6 had a lot of sense and it did fit, but frontier since went too far ahead. Now you'd want DS V4 Flash from yesterday, or you are too far behind.

Unless MI350P will be much cheaper than 6000 Pro, which is unlikely given its VRAM, it will lose to it, because you'd need 2 of either.

Don't see how it could be cheaper with HBM than the RTX 6000 Blackwell Server Pro but in these times of relative shortage any additionnal supply should be slurped ?

I was remarking on the MI350P because I've had a hard time procuring "small" CDNAx systems (for e.g. development, experiments and lower-profile servers) and OAM seemed very niche (not if you're aiming for density and training/inference...).

I hope the MI350P fills a lower part of the spectrum and I can start massively porting CUDA stuff or at least work on HIP and ROCm and what I need to make most or some of our CUDA stuff run on AMD HW, then how make it run fast.

For production loads? No one will run DS without expert parallelism so it’s not important for model to fit on one gpu.

Do you mean people will run multiple GPUs, or that streaming a small % of experts from disk won't completely kill performance?

Time for AMD to improve their directstorage story I guess. Is there a good writeup on how one would use it there ?

Same for gpudirect (more useful for scale-out or training).

Everyone is focused on AI but these are two interesting techs trickling down from the NVIDIA tree, relatively "easy" to use there, which maybe exist in AMD world but I somehow missed the docs and APIs and demos on how to use them...

I've hosted my own synapse since 2019, maybe even earlier. Its the same virtualized instance, all I've ever done is update it. Never had to reboot it other than due to updates.

Nothing in any logs?

yeah well I make top 1% of income earners in my country, but yet I don't have any liquid(able) assets worth high five figures. House, if I'd sell it, would likely be worth less than I paid for it before pandemic. I couldn't really pay for lets say $200k treatment for next week. It might be the string that broke camel's back, a sinkhole I could never climb out of.