Comment by b0a04gl

what abt the optimiser itself. you tune the rep format using reward signals, but once that format drifts, you've got no visibility into whether it's still aligned with the task or just gaming the eval. without a second layer to monitor the optimiser's behaviour over time, there;s no way to tell if you're improving reasoning or just getting better at scoring. anyone have idea?