Comment by direwolf20
Comment by direwolf20 2 days ago
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
Comment by direwolf20 2 days ago
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
There is this with a 2012 date:
https://www.youtube.com/playlist?list=PLoRl3Ht4JOcdU872GhiYW...
That's the wake sleep algorithm for undirected graphical models.
Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.