llvm-svn: 38568

llvm-svn: 38567

#pragma once, and it is not completely implemented.

llvm-svn: 38566

llvm-svn: 38565

llvm-svn: 38564

around.

llvm-svn: 38563

information to print the 3/4 flags correctly on #line directives emitted
in -E mode.

llvm-svn: 38562

still pretty hacky because it doesn't compute the 3/4 markers correctly.

llvm-svn: 38561

llvm-svn: 38560

right number of newlines between tokens when needed.  This reduces the
delta of the gcc -E output from 12198 differences to 6764.  It still needs
to emit filenames on #line directives, track filename switches, and track
entry/exit of include files.

llvm-svn: 38559

instantiations.

llvm-svn: 38558

came from a macro expansion, this allows us to keep track of both where the
character data came from and where the logical position of the token is (at
the expansion site).  This implements Preprocessor/indent_macro.c, and
reduces the number of cpp iostream -E diffs vs GCC from 2589 to 2297.

llvm-svn: 38557

no functionality change yet

llvm-svn: 38556

llvm-svn: 38555

llvm-svn: 38554

llvm-svn: 38553

llvm-svn: 38552

Now, instead of keeping a pointer to the start of the token in memory, we keep the
start of the token as a SourceLocation node.  This means that each LexerToken knows
the full include stack it was created with, and means that the LexerToken isn't
reliant on a "CurLexer" member to be around (lexer tokens would previously go out of
scope when their lexers were deallocated).

This simplifies several things, and forces good cleanup elsewhere.  Now the
Preprocessor is the one that knows how to dump tokens/macros and is the one that
knows how to get the spelling of a token (it has all the context).

llvm-svn: 38551

llvm-svn: 38550

relying on TheLexer.

llvm-svn: 38549

Start/End pointer.

llvm-svn: 38548

llvm-svn: 38547

llvm-svn: 38546

llvm-svn: 38545

llvm-svn: 38544

llvm-svn: 38543

llvm-svn: 38542

llvm-svn: 38541

llvm-svn: 38540

llvm-svn: 38539

llvm-svn: 38538

llvm-svn: 38537

llvm-svn: 38535

llvm-svn: 38534

llvm-svn: 38533

llvm-svn: 38532

llvm-svn: 38531

llvm-svn: 38525

llvm-svn: 38521

llvm-svn: 38520