GPU targets can gather on non-default address spaces (e.g. global), so this removes the check for the default memory space.
