summaryrefslogtreecommitdiffstats
path: root/llvm/utils/lit
Commit message (Collapse)AuthorAgeFilesLines
...
* Add a test-case for lit xunit outputChris Matthews2014-12-031-0/+10
| | | | llvm-svn: 223307
* Don't allow test-suite names with . in them in xml outputChris Matthews2014-12-032-6/+8
| | | | llvm-svn: 223305
* Give lit a --xunit-xml-output option for saving results in xunit formatChris Matthews2014-12-022-7/+55
| | | | | | | | --xunit-xml-output saves test results to disk in JUnit's xml format. This will allow Jenkins to report the details of a lit run. Based on a patch by David Chisnall. llvm-svn: 223163
* Handle ASAN_OPTIONS and UBSAN_OPTIONS in TestingConfig.pyRafael Espindola2014-11-031-1/+1
| | | | | | | | Currently they are passed to tests of llvm itself, but not, for example, lld. With this patch the options are visible in every test. llvm-svn: 221198
* refactor duplicated code. NFC.Rafael Espindola2014-11-031-5/+5
| | | | llvm-svn: 221191
* [lit] Forward LD_PRELOAD to tests.Rafael Espindola2014-11-031-0/+1
| | | | | | | With this patch I can use asan to test the gold plugin without having to build gold itself with asan. llvm-svn: 221183
* [lit] Fix Python-3 compatibility, patch by Dan Liew.Daniel Dunbar2014-10-221-2/+2
| | | | llvm-svn: 220357
* [lit] Bump version number.Daniel Dunbar2014-10-221-1/+1
| | | | llvm-svn: 220355
* Fix ShTest parsing error when a keyword line doesn't end with a newline.Daniel Dunbar2014-10-221-0/+4
| | | | llvm-svn: 220354
* Teach Lit to catch OSError exceptions when creating a process during theDan Liew2014-10-201-7/+10
| | | | | | | | | execution of a shell command. This can happen for example if the ``RUN:`` line calls a python script which can work correctly under Linux/OSX but will not work under Windows. A more useful error message is now shown rather than an unhelpful backtrace. llvm-svn: 220227
* Initial version of Go bindings.Peter Collingbourne2014-10-161-1/+1
| | | | | | | | | | | | This code is based on the existing LLVM Go bindings project hosted at: https://github.com/go-llvm/llvm Note that all contributors to the gollvm project have agreed to relicense their changes under the LLVM license and submit them to the LLVM project. Differential Revision: http://reviews.llvm.org/D5684 llvm-svn: 219976
* [lit] Parse all strings as UTF-8 rather than ASCII.Jordan Rose2014-09-124-15/+30
| | | | | | | | | | As far as I can tell UTF-8 has been supported since the beginning of Python's codec support, and it's the de facto standard for text these days, at least for primarily-English text. This allows us to put Unicode into lit RUN lines. rdar://problem/18311663 llvm-svn: 217688
* [LIT] Move display of unsupported and xfail tests to summary. Eric Fiselier2014-08-161-4/+7
| | | | | | | | | | | | | | | | | | | | Summary: This patch changes the way xfail and unsupported tests are displayed. This output is only displayed when the --show-unsupported/--show-xfail flags are passed to lit. Currently xfail/unsupported tests are printed during the run of the test-suite. I think its better to display this information during the summary instead. This patch removes the printing of these tests from when they are run to the summary. Reviewers: ddunbar, EricWF Reviewed By: EricWF Subscribers: llvm-commits Differential Revision: http://reviews.llvm.org/D4842 llvm-svn: 215809
* [lit] Add --show-xfail flag to LIT.Eric Fiselier2014-08-021-0/+4
| | | | | | | | | | | | | | | | | | Summary: This patch add a --show-xfail flag. If this flag is specified then each xfail test will be printed to output. When it is not given xfail tests are ignored. Ignoring xfail tests is the current behavior. This flag is meant to mirror the --show-unsupported flag that was recently added. Reviewers: ddunbar, EricWF Reviewed By: EricWF Subscribers: llvm-commits Differential Revision: http://reviews.llvm.org/D4750 llvm-svn: 214609
* [lit] Add --show-unsupported flag to LITEric Fiselier2014-07-172-4/+7
| | | | llvm-svn: 213227
* lit: simplify population of the actual_inputs arrayHans Wennborg2014-06-171-3/+3
| | | | | | | Add all inputs to the array, except those starting with @, which are treated as response files and expanded. llvm-svn: 211119
* Revert "lit: warn when passed invalid pathname" (r210597)Hans Wennborg2014-06-161-5/+3
| | | | | | | | | It was pointed out that this breaks the "virtual test discovery" mechanism, which allows for narming tests in the test exec root. Reverting until I can figure out how to fix this. llvm-svn: 211048
* lit: warn when passed invalid pathnameHans Wennborg2014-06-101-3/+5
| | | | | | | | | | | | | | | It would previously say things like warning: input 'test/Frontend/foo.c' contained no tests and have the user pull their hair trying to figure out what's wrong with that file. This patch changes the message to the much clearer: warning: no such file or directory: 'test/Frontend/foo.c' Differential Revision: http://reviews.llvm.org/D4097 llvm-svn: 210597
* Add detection of OS X relocatable SDK to compiler-rt as a lit.util functionAlexander Potapenko2014-06-101-0/+17
| | | | | | | | | | | | Clang's lit cfg already detects the currently selected SDK via "xcrun --show-sdk-path". The same thing should be done for compiler-rt tests, to make them work on recent OS X versions. Instead of duplicating the detection code, this patch extracts the detection function into a lit.util method. Patch by Kuba Brecka (kuba.brecka@gmail.com), reviewed at http://reviews.llvm.org/D4072 llvm-svn: 210534
* Fix test syntax to work with non-bash /bin/sh.Joerg Sonnenberger2014-04-122-3/+3
| | | | llvm-svn: 206119
* [lit] Fix non-function style print statement.Daniel Dunbar2014-03-111-1/+1
| | | | llvm-svn: 203573
* [lit] Bump dev version number.Daniel Dunbar2014-03-101-1/+1
| | | | llvm-svn: 203498
* [lit] Add a README.txt.Daniel Dunbar2014-03-103-0/+11
| | | | | | - Also, update MANIFEST.in and utils/check-sdist. llvm-svn: 203497
* [lit] Add --version option.Daniel Dunbar2014-03-101-0/+7
| | | | llvm-svn: 203496
* lit: Provide source locations in cfg files with older Python versionsAlp Toker2014-01-111-7/+8
| | | | | | | | | This commit prospectively brings the benefits of r198766 to older supported Python versions (2.5+). Tested with Python 2.6, 2.7, 3.1 and 3.3 (!) llvm-svn: 199009
* lit: execfile() isn't present in Python 3.3Alp Toker2014-01-111-9/+8
| | | | | | | | | | | | On the other hand, exec(compile()) doesn't work in older Python versions in the 2.x series. This commit introduces exec(compile()) with a fallback to plain exec(). That'll hopefully hit the sweet spot in terms of version support. Followup to r198766 which added enhanced source locations for lit cfg parsing. llvm-svn: 199006
* lit: Provide file location in cfg error messagesAlp Toker2014-01-081-9/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | Python doesn't do a good job at diagnosing string exec() so use execfile() where available. This should be a timesaver when trying to get to the bottom of build bot failures. Before: File "llvm/utils/lit/lit/TestingConfig.py", line 93, in load_from_path exec("exec data in cfg_globals") File "<string>", line 1, in <module> File "<string>", line 194, in <module> NameError: name 'typo' is not defined After: File "llvm/utils/lit/lit/TestingConfig.py", line 95, in load_from_path execfile(path, cfg_globals) File "clang/test/lit.cfg", line 194, in <module> typo ^~~~ NameError: name 'typo' is not defined llvm-svn: 198766
* Python compatibility fix for r198150Alp Toker2013-12-291-8/+5
| | | | | | | | Remove the stat call error reporting for now. It wasn't essential so silent fallback should be fine here. llvm-svn: 198155
* Prospective Python 3 fix for r198150Alp Toker2013-12-291-1/+1
| | | | llvm-svn: 198152
* lit: Incremental test schedulingAlp Toker2013-12-293-2/+36
| | | | | | | | | | | | | | | | Add option -i to prioritize test runs by source file modification time and previous failure state. This optimal scheduling reduces typical test-and-fix iteration times to a matter of seconds by rapidly answering the questions: 1) Did my recent change fix tests that were previously failing? 2) Do the tests I just wrote / modified still work? The current implementation requires write permissions to the source tree because it uses mtimes to track failures. llvm-svn: 198150
* Tweak lit/TestingConfig.py Py3-compatible. has_key is dead.NAKAMURA Takumi2013-12-171-1/+1
| | | | llvm-svn: 197462
* lit: multiprocessing platform fix attemptAlp Toker2013-10-281-1/+2
| | | | | | | | | | The error raised by Python varies by platform(!), so let's just catch any exception and fall back. Thanks to Sylvestre Ledru for noticing this on a Debian / Python 2.7 system running code coverage. llvm-svn: 193516
* Clarify the comment about BSD versions in r193465Alp Toker2013-10-271-1/+2
| | | | llvm-svn: 193508
* self.path may be empty or otherwise miss the normal system directories,Joerg Sonnenberger2013-10-261-5/+1
| | | | | | | so try PATH next. Assume it is sane enough to cover the usual system bash locations too, but the old list is not good enough for NetBSD. llvm-svn: 193471
* lit: Issue a note when multiprocessing fails to loadAlp Toker2013-10-261-0/+1
| | | | | | | | | | If multiprocessing was requested, detected as available and subsequently failed to initialize it's worth letting the user know about it before falling back to threads. This condition can arise in certain OpenBSD / FreeBSD Python versions. llvm-svn: 193465
* Fix a referenced before assignment in r193463Alp Toker2013-10-261-0/+1
| | | | | | Some versions of Python on the builders seem strict about this. llvm-svn: 193464
* lit: handle late multiprocessing errors gracefullyAlp Toker2013-10-262-8/+11
| | | | | | | | This should be a better fix for lit multiprocessing failures, replacing the OpenBSD and FreeBSD workarounds in r193413 and r193457. Reference: http://bugs.python.org/issue3770 llvm-svn: 193463
* Attempt to fix the FreeBSD build, disable multiprocessingAlp Toker2013-10-261-1/+2
| | | | | | | | | | Speculative quick fix based on clang-X86_64-freebsd output: File "/usr/local/lib/python2.6/multiprocessing/synchronize.py", line 33, in <module> " function, see issue 3770.") ImportError: This platform lacks a functioning sem_open implementation, therefore, the required synchronization primitives needed will not function, see issue 3770. llvm-svn: 193457
* Try to fix the openbsd bot.Rafael Espindola2013-10-251-1/+1
| | | | llvm-svn: 193413
* Actually switch the default to use multiprocessingRafael Espindola2013-10-231-1/+1
| | | | llvm-svn: 193282
* [lit] Stop hacking the GIL check interval.Daniel Dunbar2013-10-231-6/+0
| | | | | | | - This was never a big win, and is irrelevant now that we commonly use multiprocessing based parallelism. llvm-svn: 193280
* [lit] Use multiprocessing based parallelism by default, on Unix.Daniel Dunbar2013-10-231-3/+7
| | | | llvm-svn: 193279
* Lit: LIT_PRESERVES_TMP should be aware of TMPDIR, too.NAKAMURA Takumi2013-10-171-2/+3
| | | | | | TMPDIR is preferred in Unix. llvm-svn: 192891
* Lit: Introduce an environment variable, $LIT_PRESERVES_TMP, to preserve TMP ↵NAKAMURA Takumi2013-10-171-0/+9
| | | | | | | | (and TEMP). This is intended to check how many temporary files would be generated in automated builders. llvm-svn: 192887
* [lit] Add an --output option, for writing results in a machine readable form.Daniel Dunbar2013-09-145-3/+96
| | | | llvm-svn: 190738
* [lit] Add support for attach arbitrary metrics to test results.Daniel Dunbar2013-09-115-2/+119
| | | | | | | | | - This is a work-in-progress and all details are subject to change, but I am trying to build up support for allowing lit to be used as a driver for performance tests (or other tests which might want to record information beyond simple PASS/FAIL). llvm-svn: 190535
* [lit] Allow config files to pass arbitrary values to child configs.Daniel Dunbar2013-09-034-12/+8
| | | | | | | - This aligns with how existing test suites end up wanting to use the local config files, conceptually it makes sense to consider them to be inherited. llvm-svn: 189885
* [lit] [tests] Add missing test input file.Daniel Dunbar2013-08-291-0/+6
| | | | llvm-svn: 189561
* [lit] Fix internal shell's argv[0] handling.Daniel Dunbar2013-08-292-3/+5
| | | | | | | - At least on OS X, it is important for correct behavior of /bin/[ that argv[0] is passed as written, and not as the full executable path. llvm-svn: 189559
* [lit] Add support for multiprocessing, under --use-processes for now.Daniel Dunbar2013-08-293-39/+115
| | | | llvm-svn: 189556
OpenPOWER on IntegriCloud