14Aug22rv1_14_1+0299-273e235c603 - detailed test results for COMPLEX

To reconnect the TextTest GUI to these results, run:

texttest.exe -a complex -d C:\Users\delphi\testreports\sumo\git\tests -reconnect C:\Users\delphi\testreports\sumo\msvc16x64texttesttmp\msvc16x64.31Aug013228.16452 -g

To start TextTest for these tests, run:

texttest.exe -a complex -d C:\Users\delphi\testreports\sumo\git\tests

default: 661 tests: 648 succeeded 10 known bugs 3 FAILED

Detailed information for the tests that FAILED:

TEST FAILED on ts-sim-wintest-ba : traci gui gui ( Last six runs Aug2022 )

---------- Differences in errors ----------
0a1,12
> Traceback (most recent call last):
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/gui/gui/runner.py", line 76, in <module>
>     pic = imread("out.png")
>   File "C:\Program Files\Python38\lib\site-packages\matplotlib\pyplot.py", line 2246, in imread
>     return matplotlib.image.imread(fname, format)
>   File "C:\Program Files\Python38\lib\site-packages\matplotlib\image.py", line 1490, in imread
>     with img_open(fname) as image:
>   File "C:\Program Files\Python38\lib\site-packages\PIL\ImageFile.py", line 117, in __init__
>     self._open()
>   File "C:\Program Files\Python38\lib\site-packages\PIL\PngImagePlugin.py", line 639, in _open
>     raise SyntaxError("not a PNG file")
> SyntaxError: not a PNG file
---------- Differences in output ----------
29d28
< screenshot dimensions (500, 500, 4)

TEST FAILED on ts-sim-wintest-ba : tutorial city_mobil simple_cyber ( Last six runs Aug2022 )

---------- Differences in output ----------
2c2
< waiting time (max, mean, dev): False True False
---
> waiting time (max, mean, dev): True True False

TEST FAILED on ts-sim-wintest-ba : tutorial city_mobil taxi_cyber ( Last six runs Aug2022 )

---------- Differences in errors ----------
1,2c1
< Warning: Person 'v-7.5p0' is jammed on edge 'cyber6to7', time=644.00.
< Warning: Person 'v7.6p2' is jammed on edge 'cyber6to7', time=648.00.
---
> Warning: Person 'v-7.6p0' is jammed on edge 'cyber6to7', time=681.00.

Detailed information for the tests that had known bugs:

TEST had known bugs (see #8973) on ts-sim-wintest-ba : sumo ToCDevice dynamic_ToC_stop ( Last six runs Aug2022 )

dynamic ToC triggered despite stop present on vehicle's lane continuation
(This bug was triggered by text found in file 'tocs' matching 'DYNTOR')

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output one_vehicle ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x000001ED575573C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x000001ED57524BC0>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001ED5753B200>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x000001ED580253C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x000001ED5756E040>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001ED5756EE40>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x000001ED5755AA00>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x000001ED57557A00>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x000001ED57569F40>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001ED575576C0>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
1,98c1,48
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport_multihop ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
17,24c17,24
< success 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 230.1) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 0.1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.1, 148.2) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 231.0) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.0, 149.0) [('e2', 9.91), ('e3', 10.0), ('edge', 9.91), ('lane', 9.91)]
< success 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 240.0) [('e2', 9.42), ('e3', 9.9), ('edge', 9.42), ('lane', 9.42)]
< success 10 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (140.0, 150.0) [('e2', 9.96), ('e3', 9.99), ('edge', 9.96), ('lane', 9.96)]
< success 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.22), ('e3', 5.71), ('edge', 9.22), ('lane', 9.22)]
< success 100 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 9.53), ('e2', 5.82), ('e3', 6.93), ('edge', 5.82), ('lane', 5.82)]
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x000001ED501C52C0>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x000001ED505C0CC0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x000001ED4FFF8F80>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x000001ED4F543DC0>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x000001ED4EC1F940>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x000001ED4F4DDB80>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x000001ED4F4EF380>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x000001ED4F4EF140>
41,98c41,48
< success 0.1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 0.1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 10 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (240.0, 250.0) [('e2', 9.9), ('e3', 10.0), ('edge', 9.9), ('lane', 9.9)]
< success 10 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 160.0) [('e2', 9.15), ('e3', 9.84), ('edge', 9.15), ('lane', 9.15)]
< success 100 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.41), ('e3', 5.84), ('edge', 9.41), ('lane', 9.41)]
< success 100 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 10.0), ('e2', 5.94), ('e3', 7.08), ('edge', 5.94), ('lane', 5.94)]
< -- Unordered text as found by filter '^Loading configuration ... done.' --
< Loading configuration ... done.
< Loading configuration ... done.
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport_multihop_newDefaults ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
9,24c9,24
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000195AD522240>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000195AD574240>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000195AD513E40>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000195AD5134C0>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x00000195AD513740>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x00000195AD513E40>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x00000195AD5131C0>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x00000195AD513440>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000195AE1893C0>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000195AE504280>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000195ADFB7040>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000195AD4D9E00>
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_same_vehicles ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x00000162429971C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x000001624292C640>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001624292C040>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x000001624345F1C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x0000016242997D00>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x0000016242997E80>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x000001624292F380>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x0000016242926BC0>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x0000016242971980>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x00000162429A5C00>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_vehicles_diff_length ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x000001B269EFFCC0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x000001B269EB7D00>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001B269EB7A80>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x000001B26A1C44C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x000001B269EC4080>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001B269EFAF80>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x000001B269EB7200>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x000001B269F0D540>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x000001B269F0D080>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000001B269F0D640>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_vehicles_diff_speed ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1,24
> failed 0.1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000001F8EBB0FB40>
> failed 1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000001F8EBB142C0>
> failed 10 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB14EC0>
> failed 100 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x000001F8EBB14140>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000001F8EBB4A4C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000001F8EBB14D00>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB14880>
> failed 100 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000001F8EBB14900>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000001F8EC5FF1C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000001F8EBB58180>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB58840>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000001F8EBB47340>
> failed 0.1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB58600>
> failed 1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB1AE00>
> failed 10 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB1AEC0>
> failed 100 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x000001F8EBB1A0C0>
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB1A0C0>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB1A0C0>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB1AA80>
> failed 100 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000001F8EBAD6FC0>
> failed 0.1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB14B40>
> failed 1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000001F8EBB50300>
> failed 10 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000001F8EBB09CC0>
> failed 100 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000001F8EBB586C0>

TEST had known bugs (see #3263) on ts-sim-wintest-ba : traci vehicle moveToXY keepRoute2 ( Last six runs Aug2022 )

mapping failure
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1
> internal corner (inside, segment2) failed: x=198, x2=198.0,   y=1.9, y2=1.9,   lane=middle_0, lane2=middle_0, pos=102, pos2=98.0   posLat=2.0 posLat2=1.9

TEST had known bugs (see #6192) on ts-sim-wintest-ba : traci vehicle openGap with_low_maxDecel_fast_CACC ( Last six runs Aug2022 )

not even failing as intended
(This bug was triggered by text found in file 'errors' matching 'Error')
---------- Differences in errors ----------
0a1,8
> Traceback (most recent call last):
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/vehicle/openGap/runner.py", line 156, in <module>
>     runSingle(targetTimeHeadway, targetSpaceHeadway, duration, changeRate, maxDecel, refVehID)
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/vehicle/openGap/runner.py", line 66, in runSingle
>     leader = results[tc.VAR_LEADER][0]
> TypeError: 'NoneType' object is not subscriptable
> Error: tcpip::Socket::recvAndCheck @ recv: peer shutdown
> Quitting (on error).
---------- Differences in output ----------
3,102c3,102
< Time 2.0: Gap 'follower'->'leader' = 5.938 (headway=0.367)
< 'follower' speed = 16.161582708
< Time 3.0: Gap 'follower'->'leader' = 8.966 (headway=0.528)
< 'follower' speed = 16.9836198736
< Time 4.0: Gap 'follower'->'leader' = 11.281 (headway=0.641)
< 'follower' speed = 17.5863190784
< Time 5.0: Gap 'follower'->'leader' = 13.069 (headway=0.725)
< 'follower' speed = 18.0379935645
< Time 6.0: Gap 'follower'->'leader' = 14.459 (headway=0.787)
< 'follower' speed = 18.3815472225
< Time 7.0: Gap 'follower'->'leader' = 15.545 (headway=0.834)
< 'follower' speed = 18.6456171431
< Time 8.0: Gap 'follower'->'leader' = 16.397 (headway=0.870)
< 'follower' speed = 18.8501483763
< Time 9.0: Gap 'follower'->'leader' = 17.068 (headway=0.898)
< 'follower' speed = 19.0094667411
< Time 10.0: Gap 'follower'->'leader' = 17.596 (headway=0.920)
< 'follower' speed = 19.1340998278
< Time 11.0: Gap 'follower'->'leader' = 18.013 (headway=0.937)
< 'follower' speed = 19.231918606
< Time 12.0: Gap 'follower'->'leader' = 18.342 (headway=0.950)
< 'follower' speed = 19.3088858604
< Time 13.0: Gap 'follower'->'leader' = 18.603 (headway=0.960)
< 'follower' speed = 19.3695649077
< Time 14.0: Gap 'follower'->'leader' = 18.810 (headway=0.969)
< 'follower' speed = 19.4174756866
< Time 15.0: Gap 'follower'->'leader' = 18.973 (headway=0.975)
< 'follower' speed = 19.4553500651
< Time 16.0: Gap 'follower'->'leader' = 19.103 (headway=0.980)
<truncated after showing first 30 lines>