Comment by joaquincabezas

Comment by joaquincabezas 2 days ago

9 replies

View on Hacker News

I took a course in my Master's (URV.cat) where we had to do exactly this, implementing backpropagation (fwd and backward passes) from a paper explaining it, using just basic math operations in a language of our choice.

I told everyone this was the best single exercise of the whole year for me. It aligns with the kind of activity that I benefit immensely but won't do by myself, so this push was just perfect.

If you are teaching, please consider this kind of assignments.

P.S. Just checked now and it's still in the syllabus :)

blitzar 2 days ago

The difference in understanding (for me and how my brain works) between reading the paper in what appears to be a future or past alien language & doing a minimal paper / code example is massive.

Reply View 1 reply
LPisGood 2 days ago

I did this in highschool from some online textbook in plain Java. I recall implementing matrix multiplication myself being the hardest part.

I made a UI that showed how the weights and biases changed throughout the training iterations.

Reply View 3 replies
  • aDyslecticCrow 2 days ago

    I had a whole course just about how computers do maths. Matrix multiplication, linear fit, finding eigenvectors, multiplication and division, square root, solving linear systems, numerically calculating differential equations, spline interpolation, FEM analysis.

    "Computers are good at maths" is normally a pretty obvious statement... but many things we take for granted from analytical mathematics, is quite difficult to actually implement in a computer. So there is a mountain of clever algorithms hiding behind some of the seemingly most obvious library operations.

    One of the best courses I've ever had.

    Reply View 2 replies
    • e-master 2 days ago

      Would you mind sharing which course it was? Is it available online by any chance?

      Reply View 1 reply
      • aDyslecticCrow a day ago

        Unfortunately it was a course at my university, and in Swedish. But it wouldn't surprise me if there are similar courses online.

        Reply View 0 replies
mkl 2 days ago

Is that paper publicly available?

Reply View 2 replies