Comment by latchkey
Both AMD and Nvidia are dumping more and more memory into their GPUs.
MI300x is 192GB HMB3, MI325x is 256 HMB3e, MI355x should be 288 HBM3e (and support FP4/6).
Both AMD and Nvidia are dumping more and more memory into their GPUs.
MI300x is 192GB HMB3, MI325x is 256 HMB3e, MI355x should be 288 HBM3e (and support FP4/6).
I'm personally really excited about this solution: https://docs.scale-lang.com/
The professional side of things, yes. For consumer grade GPUs, despite the trends in gaming markets otherwise needing such, the values have stagnated a bit.