buildroot/support/testing/infra/emulator.py, branch 2018.02

support/testing: allow to use a multiplier for timeouts

2017-08-10T08:08:06+00:00

Add a parameter to run-tests to act as a multiplier for all timeouts of emulator. It can be used to avoid sporadic failures on slow host machines as well in elastic runners on the cloud. Cc: Arnout Vandecappelle Cc: Thomas Petazzoni Signed-off-by: Ricardo Martincoski [Arnout: rename multiplier to timeout_multiplier everywhere] Signed-off-by: Arnout Vandecappelle (Essensium/Mind)

testing/infra/emulator: remove qemu warnings about audio

2017-07-31T19:26:06+00:00

The default audio backend for qemu is configured at compile time. It generates annoying warning messages to qemu's stderr when running our tests, like these: pulseaudio: set_sink_input_volume() failed pulseaudio: Reason: Invalid argument pulseaudio: set_sink_input_mute() failed pulseaudio: Reason: Invalid argument Explicitly set the audio backend to "none" at runtime to remove those messages from our logs. There is no command line argument for this, so use an environment variable when starting qemu. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

testing/infra/emulator: allow to specify pexpect timeout

2017-07-22T20:37:06+00:00

Some commands take more than 5 seconds to complete under QEMU, so add provisions to allow individual unit-test to specify different duration to avoid false negative test failures. Signed-off-by: Andrey Smirnov Reviewed-by: Ricardo Martincoski Tested-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: large timeout for login prompt

2017-07-01T14:05:14+00:00

When running multiple instances of emulator in parallel, the login prompt can take some time to appear. Use a large timeout when waiting for the prompt to avoid random failures. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: fix code style in emulator

2017-07-01T14:05:14+00:00

Remove unused import. Use 2 empty lines before a class. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: use pexpect.expect directly

2017-07-01T14:05:14+00:00

When using pexpect there is no need for a helper function. Just use expect() directly everywhere. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: use pexpect.sendline directly

2017-07-01T14:05:14+00:00

When using pexpect there is no need for a helper function. Just use sendline() directly everywhere. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: let pexpect write stdout to log

2017-07-01T14:05:14+00:00

When the parameter logfile is passed to spawn(), pexpect sends both stdin and stdout to the logfile and it creates a double echo effect. One way to avoid the double echo in the logfile would be to disable the echo on the terminal just after login ("stty -echo"), but double echo of user and password would remain. Instead of that, send only the stdout to the logfile using the logfile_read property. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: use qemu stdio in emulator

2017-07-01T14:05:14+00:00

Instead of redirecting qemu serial to telnet, redirect it to stdio. It allows to run testcases in parallel without random failing caused by two emulators trying to use the same telnet port (1234). 'qemu -serial stdio' returns some extra characters, so remove them from the log. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni

support/testing: use pexpect in emulator

2017-07-01T14:05:14+00:00

Replace subprocess + telnetlib with pexpect. Use the telnet installed on the host machine instead of telnetlib, while the serial from qemu is not yet redirected to stdio. Signed-off-by: Ricardo Martincoski Signed-off-by: Thomas Petazzoni