I was debugging an app that was not handling a particular exception; and I found that after the Exception Assistant dialog appeared and I hit F5 to continue, that it would repeatedly recall the offending line of code which would again throw the exception.
I searched the net and found this forum thread on MSDN that shed some light on how to allow the program to continue after the exception is thrown.
Tools >> Options >> Debugging >> General
(General options show if you only go to Debugging)
Uncheck the "Unwind the call stack on unhandled exceptions" to prevent the debugger from reverting to the offending line as the next statement to call.