Rely on the recursive check for pointer types rather than adding an

explicit check before recursing. A simplification requested by Duncan
during review.

llvm-svn: 163896