Is the device you are trying to remove connected as another device and still powered on? If it is, you need to remove power from it before trying to remove. If that isn't it, there is a post on ghost removal here:
