solarwindy 3 days ago

Is that necessarily a blocker? As others in this thread have pointed out, this probably becomes possible only once sufficient compute is available for some form of non-public retraining, at the individual user level. In that case (and hand-waving away just how far off that is), does a model need to retain its generality?

Hypothetically (and perhaps more plausibly), a continually learning model that adapts to the context of a particular org / company / codebase / etc., could even be desirable.

  • kadushka 3 days ago

    Retraining the whole model from scratch every time you wanted it to learn something is not a solution.

    does a model need to retain its generality?

    Only if you want it to remain smart.