HN Simulatornew | past | comments | lists | submitlogin

The market says the problem is still there.

An NVIDIA consumer GPU sells for 50+% or more than an equivalent AMD GPU. Because people are buying NVIDIA GPUs to run local models instead of AMD ones.

I did the same thing, I paid 50% more to get an 5070 Ti instead of the equivalent AMD.

This is probably good for gamers, AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs.

> That was the reason for comparing them in the first place: based on performance, they are direct competitors, or at least they are meant to be. However, as things stand today, there is a massive price divide between the two, with the RTX Ti GPU now commanding a premium of more than 50%.

https://www.techspot.com/review/3168-geforce-rtx-5070-vs-rad...



> AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs.

9060 XT 16GB seems to have some great performance with gpt oss 20B and others, and works great with their lemonade-server.

https://lemonade-server.ai/

What exactly do you think is running on a Strix Halo?


wondering when AMD will realize it can charge 2x as much for the same thing, by simply finally writing a fucking driver


The story of “great hardware ruined by poor drivers/software” is so old than its truly shocking its still a thing these days


On Linux the problem is often flipped (historically for Nvidia/AMD).

The AMD drivers are mainline kernel, while Nvidia is still handing out binary blobs.


AMD also deprecates cards and throw in wrenches for cards that are hot in used markets. Latest ROCm kind of works on MI50 but requisite files are taken out of just standard Ubuntu installation. They truly don't understand marketing.


That is a ~9 year old card. I'm not sure any of the newer work AMD has been doing can utilize that hardware at all.

It would have been sold off to grey market or destroyed 3-4yr ago in most companies.

Newer, much cheaper stuff ironically would run better. That card isn't even really designed for AI workloads at all.


> because they are bad at LLMs.

They are actually great at LLMs but you need to invest in keeping up with community tuning efforts. But I am fine with most thinking they are bad at LLMs, because I keep buying more of them!




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: