[InstCombine] Remove not of SPF min/max fold (NFCI)

This should no longer be necessary now that we canonicalize to
intrinsics. Might not be strictly NFC due to worklist order.