Comment by zelphirkalt
Comment by zelphirkalt 2 days ago
This only seems to be the case with the current crop of models. "Online learning" is a term for having models deployed and keeping them learning and it has been around for more basic models for a long time.
Not sure how much you've gotten into CL but online learning while similar is not the same.
Online learning is more akin to RL in that it's a structured and boxed enviroment. Step outside of that box or the box changes too much and you collapse.
CL is much more similar to meta learning. The concepts are more about learning NEW content while keeping previous the same.
CL is a completely open problem with all model types. EWC is amoung the better attempts (and a favorite of mine) at solving it with big limitations.