VB.NET中串口的System.UnauthorizedAccessException

I am using VB.NET 2008 Express Edition to access Serial Port which is a USB to Serial port. Since this is removable, the app user can disconnect it at any time in app. I am getting an unhandled exception when I remove the USB Serial Port.I am using VB.NET 2008 Express Edition to acces