[Attributor][FIX] Remove assumption that doesn't have to hold

There is no guarantee we strip all GEPOperators and the conservative
handling doesn't even require us to.