summaryrefslogtreecommitdiffstats
path: root/clang/utils/test/TestRunner.py
Commit message (Collapse)AuthorAgeFilesLines
* Remove old test runner, this has moved to LLVM/utils/lit and all known clientsDaniel Dunbar2009-09-221-334/+0
| | | | | | | have been updated. - Please let me know of any problems. llvm-svn: 82524
* Add --vg-arg option to clang test runner.Daniel Dunbar2009-09-041-3/+4
| | | | | | | | - Passes additional argument through to valgrind. Also, don't run valgrind with --leak-check=no by default. llvm-svn: 80981
* lit: Don't treat '\' as an escape in unquoted strings, on Win32. This turns outDaniel Dunbar2009-08-031-1/+2
| | | | | | to not be a very good idea. llvm-svn: 77957
* lit: Catch (internal) exceptions when using --no-sh.Daniel Dunbar2009-08-011-12/+10
| | | | llvm-svn: 77830
* lit: Add internal script execution.Daniel Dunbar2009-08-011-6/+132
| | | | | | | | | | | | | | | | | | | | - Off by default, you can test it with the --no-sh argument. - For me it works for all but 3 tests, but there a number of FIXMEs and QOI issues: o Redirection isn't completely accurate -- in practice it can't portably be, but I would like to error out if someone writes something which isn't going to work. This is the source of the 3 test failures. o Some pipe configurations have the potential to deadlock. o It is significantly slower when multithreaded. I believe this is due to locking happening under the hood, there is probably some kind of solution but I haven't investigated yet. o Log output is ugly. llvm-svn: 77784
* lit: Fix a name lookup problem, which only occurred on a race condition. This isDaniel Dunbar2009-08-011-1/+0
| | | | | | why dynamic binding sucks. llvm-svn: 77773
* lit: Pull a few more variables into the TestingConfig object.Daniel Dunbar2009-08-011-25/+7
| | | | llvm-svn: 77772
* MultiTestRunner: Simplify, cleanup, and rename!Daniel Dunbar2009-07-311-92/+10
| | | | | | | | | | | | | | | | | | | | | - MultiTestRunner will eventually be renamed to 'lit', for LLVM integrated tester/testing. This has the pros of being pronouncable and short. - "Project" level configuration lives in 'lit.cfg', which is also what lit uses to find the root testing directory in some cases. This can be overridden for use in project files which want to precisely specify where things are. - TestRunner.py is not longer able to be invoked directly. - Moved some code to Util.py. - Introduced a configuration object. - Cleaned up --help, removed a few not-very-useful options. - Tried not to break anything that works. :) llvm-svn: 77665
* Make the Python TestRunner work for individual testsDouglas Gregor2009-07-291-1/+5
| | | | llvm-svn: 77456
* MultiTestRunner: Reenable --vg option.Daniel Dunbar2009-07-291-3/+10
| | | | | | | - Simplified from before and using --error-exitcode so failures show up as failures. llvm-svn: 77424
* Tweak MultiTestRunner --path argument.Daniel Dunbar2009-07-271-3/+5
| | | | | | | | - Accept multiple values instead of embedding separator. - Make sure this gets used when searching for 'clang' binary. - Switch makefiles to using --path to stay in sync with cmake. llvm-svn: 77234
* MultiTestRunner: Make sure to point at src dir, for out of tree builds.Daniel Dunbar2009-07-251-31/+31
| | | | | | Factor out routine for executing the script commands. llvm-svn: 77075
* MultiTestRunner: Cleanup test execution & output.Daniel Dunbar2009-07-251-82/+61
| | | | | | | | - Stop writing everything to files. - Make test output more standard. llvm-svn: 77074
* MultiTestRunner: Drop external script and DejaGNU compatibility options for now.Daniel Dunbar2009-07-251-30/+3
| | | | | | - We don't use the former, and the latter doesn't actually work. llvm-svn: 77073
* MultiTestRunner: Disable valgrind support for now, I don't feel like maintainingDaniel Dunbar2009-07-251-25/+2
| | | | | | it currently. llvm-svn: 77072
* MultiTestRunner/Win32: Add SYSTEMROOT to environment, replace '&&' in .batDaniel Dunbar2009-07-251-2/+8
| | | | | | files. llvm-svn: 77071
* Make having no RUN line a failure.Daniel Dunbar2009-07-251-4/+3
| | | | | | | Doug, please look at decltype-crash and instantiate-function-1.mm, I'm not sure if they are actually testing the right thing / anything. llvm-svn: 77070
* MultiTestRunner: Oops, clang wasn't being substituted properly. This is why theDaniel Dunbar2009-07-251-13/+15
| | | | | | | cxx-using-declaration test case started exhibiting different behavior. It still needs to be fixed, however... llvm-svn: 77066
* MultiTestRunner: Always use absolute path names for tests.Daniel Dunbar2009-07-251-2/+2
| | | | | | Also, fix a function name I forgot to update. llvm-svn: 77064
* MultiTestRunner: Validate '&&' at the end of RUN lines.Daniel Dunbar2009-07-251-10/+33
| | | | | | | | - This is just to normalize, these will go away soon hopefully. Added all the missing '&&'s that have crept in. :) llvm-svn: 77062
* MultiTestRunner: Explicitly define child environment, the only variable we needDaniel Dunbar2009-07-251-5/+4
| | | | | | to import is the PATH. llvm-svn: 77061
* MultiTestRunner.py improvements.Daniel Dunbar2009-07-251-4/+11
| | | | | | | - Tweak output directories for temp files, derive the temporary base from the test's parent directory name, and the test name (instead of the whole path). llvm-svn: 77059
* MultiTestRunner.py improvements.Daniel Dunbar2009-07-251-8/+40
| | | | | | | | | | | | | - Not improved: the horribly lousy name. :) - Suppress stderr when capturing output. - Rewrite which() to do the right PATH search instead of being lazy and shelling out to 'which'. - On Windows, run scripts as batch files (via 'cmd /c ...'). llvm-svn: 77058
* Make stdin for test scripts empty, so that tests don't accidentally hang waitingDaniel Dunbar2009-07-131-0/+1
| | | | | | for stdin. llvm-svn: 75506
* restore proper valgrind support.Nuno Lopes2009-07-111-6/+8
| | | | | | disclaim: I know nothing about Python, so apologies in advance if I break something llvm-svn: 75368
* Use /usr/bin/env trick to find python. Patch by Krister Walfridsson.Eli Friedman2009-07-101-1/+1
| | | | llvm-svn: 75271
* Having tests that depend on previously created files is bad idea. Fix them ↵Argyrios Kyrtzidis2009-07-061-2/+0
| | | | | | to be self-sufficient. llvm-svn: 74810
* Make use of the Index library through the index-test tool.Argyrios Kyrtzidis2009-07-051-0/+2
| | | | | | | | | 'index-test' is now able to provide additional info for a Decl, through multiple AST files: -Find declarations -Find definitions -Find references llvm-svn: 74803
* Revert prev commit, we have much bigger problems because 2.3 is missingDaniel Dunbar2009-07-021-1/+1
| | | | | | the subprocess module. llvm-svn: 74738
* Avoid @staticmethod to allow use with Python 2.3.Daniel Dunbar2009-07-021-2/+3
| | | | llvm-svn: 74737
* Testing improvements:Daniel Dunbar2009-06-171-22/+107
| | | | | | | | | | | | | | - Make python test runner force COLUMNS=0 to increase determinism. - Substitute clang-cc as we do for clang. - Improved detection of Ctrl-C. - Honor CLANG and CLANGCC environment variables. - Add proper command line arguments to TestRunner.py (see --help) llvm-svn: 73640
* Support %S in Python TestRunnerDaniel Dunbar2009-04-101-0/+2
| | | | llvm-svn: 68814
* Add my "clang compatible" test runner. Sorry for keeping this to myself... Daniel Dunbar2009-03-061-0/+208
Usage: from clang/test, 'make -f ../utils/test/Makefile.multi' Pros: About 20% faster than the Makefile based version on my 8 core box (way faster on Windows I imagine, if it works). Cons: Needs some cleanup. Ctrl-C works quite poorly on Darwin; more Python's fault than mine. Future: Support config definitions so we can use this for running LLVM tests instead of dejagnu. Parallel testing goodness? Indeed. llvm-svn: 66293
OpenPOWER on IntegriCloud