stack depth sampled by shark from ~34 to ~17 frames when preprocessing <iostream>.

llvm-svn: 38726

llvm-svn: 38725

Use this support to implement function-like macro argument preexpansion.

This implements test/Preprocessor/macro_fn_preexpand.c

llvm-svn: 38724

llvm-svn: 38723

llvm-svn: 38722

llvm-svn: 38721

test/Preprocessor/macro_fn_disable_expand.c

llvm-svn: 38720

llvm-svn: 38719

llvm-svn: 38718

llvm-svn: 38717

not the formal arguments, to a macro.

llvm-svn: 38716

llvm-svn: 38715

llvm-svn: 38714

llvm-svn: 38713

llvm-svn: 38712

llvm-svn: 38711

llvm-svn: 38710

llvm-svn: 38709

llvm-svn: 38708

stringizing, etc.

llvm-svn: 38707

llvm-svn: 38706

llvm-svn: 38705

llvm-svn: 38704

tok::unknown tokens.  This fixes test/Lexer/unknown-char.c

llvm-svn: 38703

it more rightly belongs.

llvm-svn: 38702

is an intra-lexer property, not a inter-lexer property, so it makes sense
for it to be define here.  It also makes no sense for macros, and allows us
to define it more carefully in the header.

While I'm at it, improve comments and structuring in Lexer.h

llvm-svn: 38701

llvm-svn: 38700

completely reversible.  This implements tests 3/4 of
test/Preprocessor/macro_fn_lparen_scan.c

llvm-svn: 38699

llvm-svn: 38698

llvm-svn: 38697

llvm-svn: 38696

test/Preprocessor/macro_fn_lparen_scan.c, but is not yet complete.

llvm-svn: 38695

test/Preprocessor/macro_fn_lparen_scan.c, but is not yet complete.

Add some FIXME's about missing diagnostics on empty macro args.  Improve some
comments.

llvm-svn: 38694

llvm-svn: 38693

llvm-svn: 38692

before lexing a token.  This speeds the common case where tokens are
separated by small amount of whitespace.  This makes a slight but
reproducible positive effect lexing a preprocessed carbon.h.

llvm-svn: 38691

that needs it is enabled.

llvm-svn: 38690

query the hash table, when we look up an identifier that isn't at the head
of it's bucket's list, move it there.  This reduces the number of list
traversals in the common case where identifiers are used in bursts.

llvm-svn: 38689

llvm-svn: 38688

#define ENOMEMORYFORYOU ENOMEMORYFORYOU

llvm-svn: 38687