The advise @steve.maddigan is solid for how to remove the ghost.
Next time you have to re-include a device try doing a "Replace" as I have outlined in this post. So far I have used it on various devices and it works great if you follow the correct steps.
