Comment by bob1029
Where are the model parameters stored and how are they represented?
Where are the model parameters stored and how are they represented?
I agree if you approach it naively you will accomplish nothing.
With some optimization, you can evolve programs with search spaces of 10^10000 states (i.e., 10 unique instructions, 10000 instructions long) and beyond.
Visiting every possible combination is not the goal here.
In disk or memory as multidimensional arrays ("tensors" in ML speak).