X-Mailer: MIME-tools 5.508 (Entity 5.508) References: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline X-RT-Interface: Web In-Reply-To: Message-ID: X-RT-Original-Encoding: utf-8 Content-Transfer-Encoding: binary RT-Send-CC: Content-Length: 933 On Tue Nov 14 16:07:39 2017, stephen wrote: > The system tests can take a significant time to run. Ondrej suggested > that they could be modified to run in parallel. This requires a > number of changes to the system test scripts. => unfortunately this is impossible with networking protocols because the use of resources like address/port pairs requires tests to be run strictly in sequence. BTW in Kea the way unit and system tests of the agent are run by the Makefile conflicts for this reason so it is not possible to run "make distcheck" with a "-j xxx" argument. In conclusion not only it is impossible but we already have a product where some tests bug when run in parallel. Now there are tools to build applications on different machines (another meaning of "parallel") so perhaps we can adapt one to run tests this way. Note that all unit tests and system tests we have only requires to be run individually on one box.