Comment by redrove Comment by redrove 7 hours ago 0 replies Copy Link View on Hacker News I have a 3090 and a 4090 and it all fits in in VRAM with Q4_0 and quantized KV, 96k ctx. 1400 pp, 80 tps.