Comment by tasn
Email is used a single factor (either because of magic links or forgot password flows), so the impact is much larger than getting your snail mail sent to someone else.
Also, whoever takes your old residence is probably not malicious (they just want the house because they want a house), but whoever takes your email address is much more likely to be malicious (as the acquisition cost is low and it scales).