This symptom is due to the specifications of Windows XP. Windows XP does not allow user to uninstall a device which is in use until the computer is restarted.
To avoid this symptom, always restart the computer after removing a device.
For more information, please refer to the following solution in Microsoft's technical support website.
Article ID: Q283361
Last Reviewed: June 27, 2001
Title: Device Manager Still Lists a Device After You Try to Remove It