Comment by GregarianChild

This paper

https://arxiv.org/abs/2407.02944

ventures some guesses how Nvidia does this, and runs experiments to confirm them.