Comment by dangus

Comment by dangus 13 hours ago

5 replies

ROCm is making great progress but I’ve had enough hiccups (desktop with RX9070XT) that I’d still recommend those looking for AI capability to continue using an Nvidia or Apple solution for the time being.

Still, I think it’ll be quite equivalent soon.

I think one of the best AI systems in terms of price/performance is still just to build a desktop with dual RTX 3090’s (of course you’ll need an board that supports dual cards) and toss it in a closet.

Tuna-Fish 12 hours ago

It depends on what you are doing. A lot of people who want to do local inference want to do it using much larger models than what can be fit onto a RTX3090, and Strix Halo is such a hit because it gives you reasonable (not great, but good enough to not be outright painful) performance with 128GB of memory.

  • geerlingguy 12 hours ago

    Also, Vulkan is great, and much more stable. Plus tends to work great for new, and even very old, graphics cards.

dismalaf 10 hours ago

At this point Vulkan will just take over. AMD and Intel are fumbling ROCm and SYCL, whereas Vulkan already ships nearly everywhere.

almostgotcaught 10 hours ago

> ROCm is making great progress

is the progress in the room with us?

  • wmf a few seconds ago

    Yes? For example, ROCm on MI355X is working fine a month after release; it didn't take a year.