[SCEV] Remove unnecessary cast code (NFC)

The types should always match here. Possibly this is a leftover
from pre-opaque-pointers times.