llvm-svn: 38705

llvm-svn: 38704

tok::unknown tokens.  This fixes test/Lexer/unknown-char.c

llvm-svn: 38703

it more rightly belongs.

llvm-svn: 38702

is an intra-lexer property, not a inter-lexer property, so it makes sense
for it to be define here.  It also makes no sense for macros, and allows us
to define it more carefully in the header.

While I'm at it, improve comments and structuring in Lexer.h

llvm-svn: 38701

llvm-svn: 38700

completely reversible.  This implements tests 3/4 of
test/Preprocessor/macro_fn_lparen_scan.c

llvm-svn: 38699

llvm-svn: 38698

llvm-svn: 38697

llvm-svn: 38696

test/Preprocessor/macro_fn_lparen_scan.c, but is not yet complete.

llvm-svn: 38695

test/Preprocessor/macro_fn_lparen_scan.c, but is not yet complete.

Add some FIXME's about missing diagnostics on empty macro args.  Improve some
comments.

llvm-svn: 38694

llvm-svn: 38693

llvm-svn: 38692

before lexing a token.  This speeds the common case where tokens are
separated by small amount of whitespace.  This makes a slight but
reproducible positive effect lexing a preprocessed carbon.h.

llvm-svn: 38691

that needs it is enabled.

llvm-svn: 38690

query the hash table, when we look up an identifier that isn't at the head
of it's bucket's list, move it there.  This reduces the number of list
traversals in the common case where identifiers are used in bursts.

llvm-svn: 38689

llvm-svn: 38688

#define ENOMEMORYFORYOU ENOMEMORYFORYOU

llvm-svn: 38687

like:  #define IS_BLAH() 1

llvm-svn: 38686

macro invocation.

llvm-svn: 38685

llvm-svn: 38684

llvm-svn: 38683

enhance macro equality testing to verify argument lists match.

llvm-svn: 38682

llvm-svn: 38681

llvm-svn: 38680

fully implement it.

Fix warning on #define __LINE__ to warn about redefinition, not #undef.

llvm-svn: 38679

llvm-svn: 38678

llvm-svn: 38677

ignored, warned about, or error'd.  Use this to implement the -Wunused_macros
command line option.

llvm-svn: 38676

llvm-svn: 38675

identifier info incorrectly set.

llvm-svn: 38674

llvm-svn: 38673

llvm-svn: 38672

the common case.

llvm-svn: 38671

llvm-svn: 38670

-E -P mode by 10% (i.e. takes away almost all i/o time).

llvm-svn: 38669

llvm-svn: 38668

llvm-svn: 38667

llvm-svn: 38666