X-Mailer: MIME-tools 5.508 (Entity 5.508) Content-Disposition: inline Content-Transfer-Encoding: binary Message-ID: Content-Type: text/plain; charset="utf-8" To: bind-suggest@isc.org Subject: Allow system tests to run in parallel MIME-Version: 1.0 Date: Tue, 14 Nov 2017 16:07:39 +0000 X-RT-Interface: Web From: stephen@isc.org X-RT-Original-Encoding: utf-8 Content-Length: 769 The system tests can take a significant time to run. Ondrej suggested that they could be modified to run in parallel. This requires a number of changes to the system test scripts. Requirements --- 1. Run all the tests with up to a user-specified number of tests running in parallel. 2. If required, it should be possible to run a single test. It should also be possible to run all the tests sequentially. 3. Basic start/end messages should be output to stdout - messages from different tests may be interspersed. The full log from all of the tests should be placed in systests.output, ordered such that the output from each test forms a block of consecutive lines (as it does at present). 4. It should be possible to run single tests as can be done at present.