without having to get the whole token.  This speeds up -E on 
447.dealII by 1.8%

llvm-svn: 40420

llvm-svn: 40419

it did not handle <xyz> headers coming from macro expansions.
This requires special treatment, as the include name is lexed
as multiple tokens, which require reassembly before processing.

llvm-svn: 40418

no functionality changes.

llvm-svn: 40414

that required cleaning.  If the token required cleaning,
don't include the cleaned tokens in the returned length.

llvm-svn: 40410

token was not -> and if the token before it was -, the - and > would avoid pasting.

llvm-svn: 40409

C++ mode, even gnu C++ mode.

llvm-svn: 40408

a llvm::StringMap.  This dramatically reduces the startup time of the preprocessor,
speeding up -Eonly on xalankbmk by 2.2%.

llvm-svn: 40396

memorybuffer instead of a pointer to the memorybuffer itself.  This
reduces coupling and eliminates a pointer dereference on a hot path.
This speeds up -Eonly on 483.xalancbmk by 2.1%

llvm-svn: 40394

compiler inline it.  This speeds up -Eonly on 483.xalancbmk by about 1%

llvm-svn: 40393

preprocessing 483.xalancbmk by about 10%, reducing the number
of file lookup queries from 2139411 to 199466 (over 10x)

llvm-svn: 40390

llvm-svn: 40388

llvm-svn: 40386

llvm-svn: 40385

   // foo
   // bar
   // baz

we'd get two levels of call (bcpl & whitespace) for each line, leading to some
seriously deep stacks in some cases.

llvm-svn: 40384

fileid's and macroid's across files.  Clearing between files keeps the tables
smaller and slightly speeds up compilation.

llvm-svn: 40383

llvm-svn: 40381

redefinition of a macro could cause invalid memory to be deleted.
Found preprocessing 253.perlbmk.

llvm-svn: 40380

int i = /*/ */ 1;

Thanks to Neil for pointing this out.

llvm-svn: 40379

llvm-svn: 40375

keeps the MacroInfo table more compact.

llvm-svn: 40281

llvm-svn: 40264

llvm-svn: 40189

llvm-svn: 40176

llvm-svn: 40173

llvm-svn: 40169

llvm-svn: 40163

llvm-svn: 40162

invalid arguments.

llvm-svn: 40161

llvm-svn: 40139

llvm-svn: 40138

a bit nicer for people who pass lots of extra arguments to calls by 
selecting them all instead of just the first one:

arg-duplicate.c:13:13: error: too many arguments to function
  f3 (1, 1, 2, 3, 4);   // expected-error {{too many arguments to function}}
            ^~~~~~~

This implements test/Sema/arg-duplicate.c, thanks to Neil for pointing
out this crash.

llvm-svn: 40136

llvm-svn: 40135

1) fix a crash on test/Sema/default.c by making
   sure that the switch scope is non-null.
2) if there is an error sema'ing a default or case stmt,
   make sure to return the substmt up, so that the error
   recovery code has more acurate info to continue with.

llvm-svn: 40134

llvm-svn: 40113

llvm-svn: 40111

llvm-svn: 40110

SourceManager::getInstantiationLoc.  With this change, every token
expanded from a macro doesn't get its own MacroID.  :)

This reduces # macro IDs in carbon.h from 16805 to 9197

llvm-svn: 40108

llvm-svn: 40106

Since that point is now long gone, we should rename LexerToken to
Token, as it is the only kind of token we have.

llvm-svn: 40105