Comment by danielmarkbruce

Absolutely you can. Rip off the last layer, add a regression layer in it's place, fine tune.