Comment by Tepix Comment by Tepix a day ago 2 replies Copy Link View on Hacker News You could buy five Strix Halo systems at $2000 each, network them and run it.Rough estimage: 12.5:2.2 so you should get around 5.5 tokens/s.
Copy Link j-bos a day ago Collapse Comment - Is the software/drivers for networking LLMs on Strix Halo there yet? I was under the impression a few weeks ago that it's veeeery early stages and terribly slow. Reply View | 1 reply Copy Link Tepix a day ago Parent Collapse Comment - Llama.cpp with its rpc-server Reply View | 0 replies
Copy Link Tepix a day ago Parent Collapse Comment - Llama.cpp with its rpc-server Reply View | 0 replies
Is the software/drivers for networking LLMs on Strix Halo there yet? I was under the impression a few weeks ago that it's veeeery early stages and terribly slow.