summaryrefslogtreecommitdiffstats
path: root/clang/lib/Lex/Lexer.cpp
Commit message (Collapse)AuthorAgeFilesLines
...
* add a new Lexer::SkipEscapedNewLines method.Chris Lattner2009-04-181-0/+23
| | | | llvm-svn: 69483
* factor escape newline measuring out into its own helper function.Chris Lattner2009-04-181-40/+45
| | | | llvm-svn: 69482
* remove unneeded scopes.Chris Lattner2009-04-181-45/+41
| | | | llvm-svn: 69481
* Fix two problems from PR3916, and one problem I noticed while hackingChris Lattner2009-04-171-5/+5
| | | | | | on the code. llvm-svn: 69404
* Change Lexer::MeasureTokenLength to take a LangOptions reference.Chris Lattner2009-04-141-6/+2
| | | | | | | | | | | | | | | | | | This allows it to accurately measure tokens, so that we get: t.cpp:8:13: error: unknown type name 'X' static foo::X P; ~~~~~^ instead of the woefully inferior: t.cpp:8:13: error: unknown type name 'X' static foo::X P; ~~~~ ^ Most of this is just plumbing to push the reference around. llvm-svn: 69099
* fix rdar://6757323, where an escaped newline in a // commentChris Lattner2009-04-051-0/+8
| | | | | | was causing the char after the newline to get eaten. llvm-svn: 68430
* A code modification hint for files that don't end in a newline.Mike Stump2009-04-021-1/+3
| | | | | | | Eventually, would be nice to be able to run these modifications even when we don't want the warning or errors for the actual diagnostic. llvm-svn: 68272
* silence some errors that should not apply to .S files on code like:Chris Lattner2009-03-181-4/+4
| | | | | | | | '' ' ' llvm-svn: 67237
* properly form a full token for # before calling HandleDirective.Chris Lattner2009-03-181-6/+7
| | | | llvm-svn: 67235
* simplify some logic by making ScratchBuffer handle the application of trailingChris Lattner2009-03-081-0/+1
| | | | | | | \0's to created tokens instead of making all clients do it. No functionality change. llvm-svn: 66373
* fix PR3609, emit:Chris Lattner2009-02-191-1/+1
| | | | | | | | | | | | | | t.c:1:10: error: missing terminating '>' character #include <stdio.h ^ instead of: t.c:1:10: error: missing terminating " character #include <stdio.h ^ llvm-svn: 65052
* track "just a little more" location information for macro instantiations.Chris Lattner2009-02-151-5/+15
| | | | | | | | | | | | Now instead of just tracking the expansion history, also track the full range of the macro that got replaced. For object-like macros, this doesn't change anything. For _Pragma and function-like macros, this means we track the locations of the ')'. This is required for PR3579 because apparently GCC uses the line of the ')' of a function-like macro as the location to expand __LINE__ to. llvm-svn: 64601
* move library-specific diagnostic headers into library private dirs. ReduceChris Lattner2009-01-291-1/+1
| | | | | | redundant #includes. Patch by Anders Johnsen! llvm-svn: 63271
* Split the single monolithic DiagnosticKinds.def file into oneChris Lattner2009-01-271-1/+1
| | | | | | | | | .def file for each library. This means that adding a diagnostic to sema doesn't require all the other libraries to be rebuilt. Patch by Anders Johnsen! llvm-svn: 63111
* Fix a bug I introduced in my changes, which caused MeasureTokenLengthChris Lattner2009-01-261-1/+2
| | | | | | | to crash when given an instantiation location. Thanks to Fariborz for the testcase. llvm-svn: 63057
* allow _Pragmas formed from #defines to keep their full instantiationChris Lattner2009-01-261-2/+1
| | | | | | history llvm-svn: 63035
* This change refactors some of the low-level lexer interfaces a bit.Chris Lattner2009-01-261-3/+10
| | | | | | | | | | | | | Token now has a class of kinds for "literals", which include numeric constants, strings, etc. These tokens can optionally have a pointer to the start of the token in the lexer buffer. This makes it faster to get spelling and do other gymnastics, because we don't have to go through source locations. This change is performance neutral, but will make other changes more feasible down the road. llvm-svn: 63028
* Check in the long promised SourceLocation rewrite. This lays theChris Lattner2009-01-261-12/+13
| | | | | | | | | | ground work for implementing #line, and fixes the "out of macro ID's" problem. There is nothing particularly tricky about the code, other than the very performance sensitive SourceManager::getFileID() method. llvm-svn: 62978
* This is a follow-up to r62675:Chris Lattner2009-01-231-0/+4
| | | | | | | | | | Refactor how the preprocessor changes a token from being an tok::identifier to a keyword (e.g. tok::kw_for). Instead of doing this in HandleIdentifier, hoist this common case out into the caller, so that every keyword doesn't have to go through HandleIdentifier. This drops time in HandleIdentifier from 1.25ms to .62ms, and speeds up clang -Eonly with PTH by about 1%. llvm-svn: 62855
* a trivial micro optimization to save a load.Chris Lattner2009-01-211-2/+2
| | | | llvm-svn: 62676
* Add a bit to IdentifierInfo that acts as a simple predicate whichChris Lattner2009-01-211-1/+3
| | | | | | | | | tells us whether Preprocessor::HandleIdentifier needs to be called. Because this method is only rarely needed, this saves a call and a bunch of random checks. This drops the time in HandleIdentifier from 3.52ms to .98ms on cocoa.h on my machine. llvm-svn: 62675
* Rename SourceManager::getCanonicalFileID -> getFileID. There isChris Lattner2009-01-191-1/+1
| | | | | | no longer such thing as a non-canonical FileID. llvm-svn: 62499
* Make SourceLocation::getFileLoc private to reduce the API exposure of Chris Lattner2009-01-191-7/+9
| | | | | | | SourceLocation. This requires making some cleanups to token pasting and _Pragma expansion. llvm-svn: 62490
* Rename SourceLocation::getFileID to getChunkID, because it returnsChris Lattner2009-01-171-2/+2
| | | | | | | | the chunk ID not the file ID. This exposes problems in TextDiagnosticPrinter where it should have been using the canonical file ID but wasn't. Fix these along the way. llvm-svn: 62427
* simplify some lookups.Chris Lattner2009-01-171-4/+4
| | | | llvm-svn: 62426
* Change the Lexer ctor used to lex _Pragma directives into a static factoryChris Lattner2009-01-171-21/+44
| | | | | | | | | | | method. This lets us clean up the interface and make it more obvious that this method is *really really* _Pragma specific. Note that _Pragma handling uglifies the Lexer in the critical path. It would be very interesting to consider making _Pragma remapping be a new special lexer class of its own. llvm-svn: 62425
* Change the Lexer ctor used in the non _Pragma case to take a FileID insteadChris Lattner2009-01-171-11/+6
| | | | | | of a SourceLocation. This should speed it up and definitely simplifies it. llvm-svn: 62422
* More simplifications to the lexer ctors.Chris Lattner2009-01-171-10/+24
| | | | llvm-svn: 62419
* make the verbose raw-lexer ctor fully explicit instead of havingChris Lattner2009-01-171-9/+3
| | | | | | embedded magic. llvm-svn: 62417
* add a simplified lexer ctor that sets up the lexer to raw-lex anChris Lattner2009-01-171-1/+14
| | | | | | entire file. llvm-svn: 62414
* refactor some common initialization code out of the two lexer ctors.Chris Lattner2009-01-171-52/+45
| | | | llvm-svn: 62411
* this massive patch introduces a simple new abstraction: it makesChris Lattner2009-01-171-10/+14
| | | | | | | | | | | | | | | "FileID" a concept that is now enforced by the compiler's type checker instead of yet-another-random-unsigned floating around. This is an important distinction from the "FileID" currently tracked by SourceLocation. *That* FileID may refer to the start of a file or to a chunk within it. The new FileID *only* refers to the file (and its #include stack and eventually #line data), it cannot refer to a chunk. FileID is a completely opaque datatype to all clients, only SourceManager is allowed to poke and prod it. llvm-svn: 62407
* Instead of iterating over FileID's, have PTH generation iterate over theChris Lattner2009-01-171-2/+1
| | | | | | | content cache directly. Content cache has a 1-1 mapping with fileentries, whereas multiple FileIDs can be the same FileEntry. llvm-svn: 62401
* Fix PR2477 - clang misparses "//*" in C89 modeChris Lattner2009-01-161-9/+24
| | | | llvm-svn: 62368
* more SourceLocation lexicon change: instead of referring to theChris Lattner2009-01-161-4/+4
| | | | | | "logical" location, refer to the "instantiation" location. llvm-svn: 62316
* Change some terminology in SourceLocation: instead of referring to Chris Lattner2009-01-161-6/+6
| | | | | | | the "physical" location of tokens, refer to the "spelling" location. This is more concrete and useful, tokens aren't really physical objects! llvm-svn: 62309
* rdar://6060752 - don't warn about trigraphs in bcpl-style commentsChris Lattner2008-12-121-1/+6
| | | | llvm-svn: 60942
* fix thought-oChris Lattner2008-12-121-1/+1
| | | | llvm-svn: 60937
* Objective-C keywords are not always identifiers. Some are also C++ keywordsDouglas Gregor2008-12-011-2/+3
| | | | llvm-svn: 60373
* Comment fix.Daniel Dunbar2008-11-251-1/+1
| | | | llvm-svn: 59997
* Fix a weird inconsistency with hex floats. Previously the lexer Chris Lattner2008-11-221-2/+2
| | | | | | | | | would not eat the "-1" in "0x0p-1", but LiteralSupport would accept it when extensions are on. This caused strangeness and failures when hexfloats were properly treated as an extension (not error) in LiteralSupport. llvm-svn: 59865
* actually, this version isn't really needed.Chris Lattner2008-11-221-6/+2
| | | | llvm-svn: 59859
* remove a sneaky version of Diag hiding in PreprocessorLexer.Chris Lattner2008-11-221-3/+6
| | | | llvm-svn: 59858
* Change the Lexer::Diag method to not magically silence warnings,Chris Lattner2008-11-221-27/+46
| | | | | | | force the caller to check instead. This eliminates the need (and the risk!) of weird null DiagnosticBuilder's floating around. llvm-svn: 59856
* Split the DiagnosticInfo class into two disjoint classes:Chris Lattner2008-11-221-2/+2
| | | | | | | | | | one for building up the diagnostic that is in flight (DiagnosticBuilder) and one for pulling structured information out of the diagnostic when formatting and presenting it. There is no functionality change with this patch. llvm-svn: 59849
* - Move static function IsNonPragmaNonMacroLexer into Preprocessor.h.Ted Kremenek2008-11-191-2/+5
| | | | | | | | | | | | | - Add variants of IsNonPragmaNonMacroLexer to accept an IncludeMacroStack entry (simplifies some uses). - Use IsNonPragmaNonMacroLexer in Preprocessor::LookupFile. - Add 'FileID' to PreprocessorLexer, and have Preprocessor query this fileid when looking up the FileEntry for a file Performance testing of -Eonly on Cocoa.h shows no performance regression because of this patch. llvm-svn: 59666
* Convert the lexer and start converting the PP over to using canonical Diag ↵Chris Lattner2008-11-181-11/+10
| | | | | | methods. llvm-svn: 59511
* Move some diagnostic handling to PreprocessorLexer.Ted Kremenek2008-11-121-10/+5
| | | | llvm-svn: 59191
* Remove Lexer::LexIncludeFilename.Ted Kremenek2008-11-121-21/+0
| | | | llvm-svn: 59186
* Change FormTokenWithChars to take the token kind to form, since all clientsChris Lattner2008-10-121-126/+107
| | | | | | | were setting a kind and then forming it. This is just a minor API cleanup, no functionality change. llvm-svn: 57404
OpenPOWER on IntegriCloud