rahimnathwani 2 days ago

Thank you for this! My desktop GPU has only 8GB VRAM, but my MacBook has plenty of unified RAM.

Reply View 0 replies
emmelaich 2 days ago

Thanks, works well but slowly on a Mac Air M3 with 24gb. Will have to try it again after freeing up more ram as it was doing a bit of swapping with Chrome running too.

(later). It did nicely for the default example text but just made weird sounds for a "hello all" prompt. And took longer?!

Reply View 0 replies
toebee 2 days ago

Thank you for the contribution! We'll be merging PRs and cleaning code up very soon :)

Reply View 0 replies
noiv 2 days ago

Can confirm, runs straight forward on 15.4.1@M4, THX.

Reply View 0 replies