llvm-svn: 38722

llvm-svn: 38672

llvm-svn: 38664

llvm-svn: 38604

llvm-svn: 38599

llvm-svn: 38596

llvm-svn: 38594

Due to generated tokens expanded by macros, there can be multiple MacroExpansion fileid's, loop over them until we get to something real.

llvm-svn: 38590

llvm-svn: 38579

when reporting a diagnostic.

llvm-svn: 38577

llvm-svn: 38560

instantiations.

llvm-svn: 38558

came from a macro expansion, this allows us to keep track of both where the
character data came from and where the logical position of the token is (at
the expansion site).  This implements Preprocessor/indent_macro.c, and
reduces the number of cpp iostream -E diffs vs GCC from 2589 to 2297.

llvm-svn: 38557

no functionality change yet

llvm-svn: 38556

Now, instead of keeping a pointer to the start of the token in memory, we keep the
start of the token as a SourceLocation node.  This means that each LexerToken knows
the full include stack it was created with, and means that the LexerToken isn't
reliant on a "CurLexer" member to be around (lexer tokens would previously go out of
scope when their lexers were deallocated).

This simplifies several things, and forces good cleanup elsewhere.  Now the
Preprocessor is the one that knows how to dump tokens/macros and is the one that
knows how to get the spelling of a token (it has all the context).

llvm-svn: 38551

llvm-svn: 38539