Comment by jpm_sd
RGMII isn't really designed to go board-to-board, fairly high data rates, and ideally all of the signals should be delay matched. That gets a bit trickier when there are two boards involved. Also I would expect EMI/EMC issues.
I know people do that sort of thing for evaluation kits, but it doesn't seem like a good idea for production.