Comment by huac Comment by huac a day ago 0 replies Copy Link View on Hacker News One guess is that the live demo is quantized to run fast on cheaper GPUs, and that degraded the performance a lot.