Comment by bluGill
A good group can catch up significantly in 2 years. They will still be behind, but if they are cheaper (or just you can buy them) that would still go a long way.
A good group can catch up significantly in 2 years. They will still be behind, but if they are cheaper (or just you can buy them) that would still go a long way.
Yeah. Easier said than done, I know, but they need to not just catch up to nVidia but leapfrog them somehow.
I would have said that releasing cards with 32GB+ of onboard RAM, or better yet 128GB, would have gotten things moving. They'd be able to run/train models that nVidia's consumer cards couldn't.
But I think nVidia closed that gap with their "Project Digits" (or whatever the final name is) PCs.
This: provide cards with extra larger VRAM pools than the competition - to provide a real edge in LLM inferencing - and the users will come.
This happened with bitcoin.
"good group" is carrying a lot of weight here. You can't buy that. You can buy good small groups, but AMD needs a good large group, and that can't be bought.
Honestly if they got some high tier talent in, did a deep audit of existing talent and cut where there were any doubt then worked on their drivers in the open and shipped cards with 48GB+ VRAM then Nvidia would be in a difficult situation in 2 years.
Gotta open the drivers fully though because if you make the hardware totally outspec'd where it matters (VRAM) and the drivers are open then talent within the biggest orgs will go out of their way to help make your tech work in their farms, it's the only way to not be forever playing catchup.