Comment by ithkuil
You're a covered expatriate also if:
" You fail to certify on Form 8854 that you have complied with all federal tax obligations for the 5 tax years preceding the date of your expatriation. "
I agree you should pay up your taxes but this will not only recover the due taxes but it will take more.