Deleted accounts not kickingback

I deleted a very old user and account from our exchange. There was a email sent to the old account within our network and from outside as well. The email from inside the network received a Undeliverable notification immediately. The email from outside the network never received any notification that the account is no longer available. What is causing this?
Thanks.