Adding an assertion back.

This assert was removed in 98339f14,
but during post-commit review, it was pointed out that the assert was
valid.