Comment by sanjayjc

Comment by sanjayjc 4 hours ago

2 replies

View on Hacker News

Genuine question: given LLMs' inexorable commoditization of software, how soon before NVDA's CUDA moat is breached too? Is CUDA somehow fundamentally different from other kinds of software or firmware?

tomrod 2 hours ago

Current Gen LLMs are not breaching the moat yet.

Reply View 1 reply
  • fzzzy an hour ago

    Yeah they are. llama.cpp has had good performance on cpu, amd, and apple metal for at least a year now.

    Reply View 0 replies