Removed an assert which was causing significant slowdowns in debug builds.

This assert was very conservative to begin with (the error condition is well
covered by tests elsewhere in the code) so we won't miss much by removing it.

llvm-svn: 86088