summaryrefslogtreecommitdiffstats
path: root/lldb/test/dosep.py
Commit message (Collapse)AuthorAgeFilesLines
* Move lldb/test to lldb/packages/Python/lldbsuite/test.Zachary Turner2015-10-281-1435/+0
| | | | | | | | | | | This is the conclusion of an effort to get LLDB's Python code structured into a bona-fide Python package. This has a number of benefits, but most notably the ability to more easily share Python code between different but related pieces of LLDB's Python infrastructure (for example, `scripts` can now share code with `test`). llvm-svn: 251532
* Preparation for turning lldbsuite into a Python package.Zachary Turner2015-10-271-1/+1
| | | | | | | | | | | The idea behind this patch is to expose the meat of LLDB's Python infrastructure (test suite, scripts, etc) as a single package. This makes reusability and code sharing among sub-packages easy. Differential Revision: http://reviews.llvm.org/D14131 llvm-svn: 251460
* Rename `lldb_shared` to `use_lldb_suite`.Zachary Turner2015-10-271-1/+1
| | | | llvm-svn: 251444
* Python3 - Wrap more statements in calls to list()Zachary Turner2015-10-231-1/+1
| | | | llvm-svn: 251129
* Python 3 porting - Wrap returns from map() in list()Zachary Turner2015-10-221-1/+1
| | | | | | | | Under Python 2 this has no effect, since map() returns a list. In Python 3 map() returns an iterable, so wrapping in a list is necessary to keep the same semantics. llvm-svn: 251060
* Use six to portably handle module renames in Python 2 and 3Zachary Turner2015-10-211-7/+10
| | | | llvm-svn: 250915
* Convert print statements to print function calls.Zachary Turner2015-10-191-22/+24
| | | | | | | | | This patch was generating by running `2to3` on the files in the lldb/test directory. This patch should be NFC, but it does introduce the `from __future__ import print_function` line, which will break future uses of the print statement. llvm-svn: 250763
* Switch threading mode for tests on Windows when there are lots of cores.Adrian McCarthy2015-10-121-4/+7
| | | | | | | | This prevents a "too many files" error. Differential Revision: http://reviews.llvm.org/D13555 llvm-svn: 250044
* test runner: switch to pure-Python timeout mechanismTodd Fiala2015-09-291-75/+109
| | | | | | | | | | | | | | | | The timeout mechanism has been implemented in python, so there is no more dependence on external utilities for timing out an inferior dotest.py process. Platform-specific bits are implemented for POSIX-like and Windows platforms. There is a small class named ProcessHelper in process_control.py that needs to be overridden for platforms that fall outside of the POSIX-like and Windows platforms. See http://reviews.llvm.org/D13124 for more details. llvm-svn: 248834
* Remove XTIMEOUT from TestProcessAttach on linuxPavel Labath2015-09-281-1/+0
| | | | llvm-svn: 248711
* Check existence of SIGHUP before using itYing Chen2015-09-231-2/+4
| | | | | | | | | | | | Summary: -SIGHUP doesn't exist on Windows Reviewers: tfiala Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D13114 llvm-svn: 248434
* Cleaned up results formatter options hand-off.Todd Fiala2015-09-231-35/+80
| | | | | | | | | | | | | | | | | | | | | | | * --results-formatter-options renamed to --results-formatter-option, with short version of -O * Multiple --results-formatter-option=OPTION can be specified. The comma-separating mechanism has been removed. * XunitFormatter options modified: -n and -r are now short forms of --ignore-skip-name and --ignore-skip-reason. Those long option names were tweaked lightly. They also can be specified multiple times on the command line. The comma-separating, multiple-pattern- per-option mechanism has been removed. One can now specify: dotest.py --results-file stdout -O-ndsym -O-nlldb-mi for example, to ignore reporting skips for dsym-related or lldb-mi-related tests in the xUnit report. llvm-svn: 248384
* test runner: remove print from prior commit; fixup listner socket backlogTodd Fiala2015-09-221-7/+6
| | | | | | | | When doing test event collation from dotest inferiors to the parallel test runner, I had a hard-coded small value for the socket backlog. Fix it to be 2*num workers so we don't fail socket connections from inferiors. llvm-svn: 248337
* test framework: default to threading-based test runnersTodd Fiala2015-09-221-16/+57
| | | | | | | Windows gets threading-pool, OS X versions < 10.10 get multiprocessing, everyone else gets threading. llvm-svn: 248323
* Test runner process group isolation take 2.Todd Fiala2015-09-221-1/+7
| | | | | | | This one does not create a session, but just creates a new process group in the same session. llvm-svn: 248306
* Roll back r248282.Todd Fiala2015-09-221-2/+1
| | | | | | | | I'm seeing timed out tests not properly timing out on the Linux build bot after this change. Not sure if it is related but seems suspect. llvm-svn: 248284
* test runner: Unix systems now put inferior dotest in its own process group.Todd Fiala2015-09-221-1/+2
| | | | | | | This increases isolation as it relates to signal handling between parent and children. llvm-svn: 248282
* test framework: parallel test runner sends terminate to formatter before ↵Todd Fiala2015-09-221-0/+5
| | | | | | | | | | | | printing to stdout The parallel test runner now sends the terminate event to the formatter (if there is one) after the parallel test runs but before dumping anything to stdout/stderr at the end of the run. This allows the existing stdout/stderr summary reporting to co-exist nicely with a formatter like the test_results.Curses that otherwise clobbers the screen. llvm-svn: 248228
* Fixed up the curses test results formatter to:Greg Clayton2015-09-211-3/+1
| | | | | | | | | - rename "Failures" window to "Completed Tests" - Remove the extra lock that I incorrectly added to the ResultsFormatter as it already had one - Init the curses GUI with the right number of jobs when handling the "intialize" event - tear down the curses GUI when tests complete llvm-svn: 248179
* test framework: ignore sighupsTodd Fiala2015-09-211-0/+5
| | | | | | | | | | | | | On OS X, we're occasionally seeing sighups come in to what looks like the whole test runner process group (all the multiprocessing workers and the main process). It's not due to a lost console. This change has the main parallel test runner process and the child worker processes ignore sighup. Covers: https://llvm.org/bugs/show_bug.cgi?id=24846 llvm-svn: 248141
* Fix Linux bot.Chaoren Lin2015-09-191-1/+2
| | | | llvm-svn: 248075
* Added a curses based way to see the test suite running. Works only where ↵Greg Clayton2015-09-191-17/+22
| | | | | | | | curses is implemented. Try it out with: ./dotest.py --results-formatter=test_results.Curses --results-file=/dev/stdout llvm-svn: 248072
* test events: added optional value type to extra event key/val pairsTodd Fiala2015-09-181-2/+1
| | | | | | | | | | | | | The test events had worker indexes coming across as strings. I want them to be ints. worker_index now comes across as an int in the dicationary. The optional type can be specified with: --event-add-entries key=val[:type][,key2=val2[:type2]...] The type piece may be 'int' at this time. That is all. Otherwise it will be a string. llvm-svn: 248066
* test events: announce worker count in new initialize eventTodd Fiala2015-09-181-13/+9
| | | | | | | See the following for details: http://reviews.llvm.org/D12987 llvm-svn: 248059
* Adds parallel work queue index to test events, stdout/stderr results support.Todd Fiala2015-09-181-32/+71
| | | | | | See http://reviews.llvm.org/D12983 for details. llvm-svn: 248036
* Remove XTIMEOUT from TestAttachDenied on linuxPavel Labath2015-09-171-1/+0
| | | | llvm-svn: 247877
* Add JUnit/XUnit-formatted output to the lldb test run systemTodd Fiala2015-09-151-111/+407
| | | | | | | | Also introduces the test event system into our test runner framework. See the following for details: http://reviews.llvm.org/D12831 llvm-svn: 247722
* Remove XTIMEOUT from TestChangeProcessGroup on linuxPavel Labath2015-09-141-1/+0
| | | | llvm-svn: 247552
* dotest.py ctrl-c support, addition of --test-runner-name option.Todd Fiala2015-09-081-44/+500
| | | | | | | | See http://reviews.llvm.org/D12651 for more details. For the parallel test runner, -v now also implies --output-on-success. llvm-svn: 247084
* Roll dosep.py parallel test runner into dotest.py command lineTodd Fiala2015-09-031-43/+32
| | | | | | | See the following for details: http://reviews.llvm.org/D12587 llvm-svn: 246794
* Fix deadlock while attaching to inferiorsPavel Labath2015-09-031-1/+0
| | | | | | | | | | | | | | | | | | | | Summary: There was a race condition in the AsyncThread, where we would end up sending a vAttach notification to the thread before it got a chance set up its listener (this can be reproduced by adding a sleep() at the very beginning of ProcessGDBRemote::AsyncThread()). This event would then get lost and we LLDB would deadlock. I fix this by setting up the listener early on, in the ProcessGDBRemote constructor. This should improve the stability of all attach tests. For now, I am removing XTIMEOUT from TestAttachResume, and will watch the buildbots for signs of trouble. Reviewers: clayborg, ovyalov Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D12552 llvm-svn: 246756
* XTIMEOUT TestIntegerTypesExpr for Darwin.Chaoren Lin2015-08-201-0/+1
| | | | llvm-svn: 245532
* XTIMEOUT TestChangeProcessGroup for Linux.Chaoren Lin2015-08-191-0/+1
| | | | llvm-svn: 245477
* XTIMEOUT TestEvents and TestThreadStates for Windows to Android.Chaoren Lin2015-08-191-0/+6
| | | | llvm-svn: 245464
* XTIMEOUT TestExitDuringStep for Darwin.Chaoren Lin2015-08-191-0/+1
| | | | llvm-svn: 245460
* Update dosep to print unexpected successes at the end.Zachary Turner2015-08-141-15/+33
| | | | llvm-svn: 245066
* Make dosep.py PEP8 compliant. NFC.Chaoren Lin2015-08-121-38/+71
| | | | | | | | | | Reviewers: zturner, clayborg Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D11846 llvm-svn: 244784
* Refactor dosep to use list comprehension. NFC.Chaoren Lin2015-08-121-43/+31
| | | | | | | | | | Reviewers: zturner Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D11910 llvm-svn: 244783
* Don't print number of failures and percentage if no tests ran.Chaoren Lin2015-08-121-4/+10
| | | | | | | | | | Reviewers: zturner Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D11909 llvm-svn: 244782
* Make dosep output status by overwriting the same line.Chaoren Lin2015-08-121-32/+41
| | | | | | | | | | | | Summary: Update to D11816. Reviewers: zturner Subscribers: zturner, lldb-commits Differential Revision: http://reviews.llvm.org/D11843 llvm-svn: 244781
* Don't crash if the file we want to touch doesn't exist.Greg Clayton2015-08-111-2/+1
| | | | llvm-svn: 244663
* Allow dosep.py to print dotest.py output on success.Zachary Turner2015-08-101-13/+41
| | | | | | | | | | | | | | | | | | | | Previously all test output was reported by each individual instance of dotest.py. After a recent patch, dosep gets dotest outptu via a pipe, and selectively decides which output to print. This breaks certain scripts which rely on having full output of each dotest instance to do various parsing and/or log-scraping. While we make no promises about the format of dotest output, it's easy to restore this to the old behavior for now, although it is behind a flag. To re-enable full output, run dosep.py with the -s option. Differential Revision: http://reviews.llvm.org/D11816 Reviewed By: Chaoren Lin llvm-svn: 244469
* Flush stderr on dosep status update for Windows.Chaoren Lin2015-08-051-0/+1
| | | | llvm-svn: 244069
* Xtimeout TestProcessAttach for Linux.Chaoren Lin2015-07-221-0/+1
| | | | llvm-svn: 242932
* Enable timeout on WindowsYing Chen2015-07-201-7/+6
| | | | | | | | | | | | Summary: - launch dotest with gtimeout if found on Windows Reviewers: chaoren Subscribers: lldb-commits Differential Revision: http://reviews.llvm.org/D11368 llvm-svn: 242699
* Fix dosep.py on windows after r240946Pavel Labath2015-07-061-8/+8
| | | | | | | | | | | | | | | | Summary: On windows, global python variables are not automatically passed to child processes. This commit makes sure the default timeout value is available to child processes by passing it directly. I pass the whole dotest_opts value to the children, so we can use the other members as well if we need to do it in the future. Reviewers: amccarth Subscribers: lldb-commits-list Differential Revision: http://reviews.llvm.org/D10895 llvm-svn: 241459
* dosep.py: Add ability to set default test timout based on targetPavel Labath2015-06-291-2/+16
| | | | | | | | | | | | | | | | | Summary: Current default is 10 minutes, which causes the test suite to run very long in case of test timeouts. On local linux, each test completes in under 90 seconds in the slowest configuration (debug build of lldb, using debug clang to build inferiors). I am changing the default to 4m on local targets, while retaining the 10m timeout for remote ones. Reviewers: sivachandra, vharron Subscribers: tberghammer, lldb-commits Differential Revision: http://reviews.llvm.org/D10527 llvm-svn: 240946
* Adding some more flakey tests to the XFAIL listVince Harron2015-06-221-0/+1
| | | | llvm-svn: 240327
* Mark TestMultithreaded as XTIMEOUT on Linux.Oleksiy Vyalov2015-06-101-0/+1
| | | | llvm-svn: 239450
* Update dosep to display dotest command invoked on failure.Chaoren Lin2015-06-071-5/+6
| | | | llvm-svn: 239258
OpenPOWER on IntegriCloud