Comment by saagarjha

Comment by saagarjha 6 days ago

12 replies

Sure, but you can make money in the field and retire faster than it becomes irrelevant. FWIW none of the ideas here are novel or nontransferable–it's just the specific design that is proprietary. Understanding how to do an AllReduce has been of theoretical interest for decades and will probably remain worth doing far into the future.

j45 5 days ago

Tech is always like this.

You move from one thing to the next.

With your transferable skills, experience and thinking that is beyond one programming language.

Even Apple is simply exporting to CUDA now.

  • almostgotcaught 5 days ago

    > Even Apple is simply exporting to CUDA now.

    This is like when journalists write clickbait article titles by omitting all qualifiers (eg "states banning fluoride" when it's only some states).

    One framework added a CUDA backend. You think all of Apple uses only one framework? Further what makes you think this even gets internal use?

tormeh 5 days ago

Only in Silicon Valley. But if you can, definitely do.