Comment by tuetuopay

I would also expect a grammar phase to be part of the training, with an RL pass where the output is fed to a grammar check engine.