25Aug22rv1_14_1+0512-d5052b04d0a - detailed test results for COMPLEX

To reconnect the TextTest GUI to these results, run:

texttest.exe -a complex -d C:\Users\delphi\testreports\sumo\git\tests -reconnect C:\Users\delphi\testreports\sumo\msvc16x64texttesttmp\msvc16x64.31Aug013228.16452 -g

To start TextTest for these tests, run:

texttest.exe -a complex -d C:\Users\delphi\testreports\sumo\git\tests

default: 661 tests: 649 succeeded 10 known bugs 2 FAILED

Detailed information for the tests that FAILED:

TEST FAILED on ts-sim-wintest-ba : traci gui gui ( Last six runs Aug2022 )

---------- Differences in errors ----------
0a1,12
> Traceback (most recent call last):
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/gui/gui/runner.py", line 77, in <module>
>     pic = imread("out.png")
>   File "C:\Program Files\Python38\lib\site-packages\matplotlib\pyplot.py", line 2246, in imread
>     return matplotlib.image.imread(fname, format)
>   File "C:\Program Files\Python38\lib\site-packages\matplotlib\image.py", line 1490, in imread
>     with img_open(fname) as image:
>   File "C:\Program Files\Python38\lib\site-packages\PIL\ImageFile.py", line 117, in __init__
>     self._open()
>   File "C:\Program Files\Python38\lib\site-packages\PIL\PngImagePlugin.py", line 639, in _open
>     raise SyntaxError("not a PNG file")
> SyntaxError: not a PNG file
---------- Differences in output ----------
29d28
< screenshot dimensions (500, 500, 4)

TEST FAILED on ts-sim-wintest-ba : tutorial city_mobil taxi_cyber ( Last six runs Aug2022 )

---------- Differences in errors ----------
1,2c1
< Warning: Person 'v-7.5p0' is jammed on edge 'cyber6to7', time=644.00.
< Warning: Person 'v7.6p2' is jammed on edge 'cyber6to7', time=648.00.
---
> Warning: Person 'v-7.6p0' is jammed on edge 'cyber6to7', time=681.00.

Detailed information for the tests that had known bugs:

TEST had known bugs (see #8973) on ts-sim-wintest-ba : sumo ToCDevice dynamic_ToC_stop ( Last six runs Aug2022 )

dynamic ToC triggered despite stop present on vehicle's lane continuation
(This bug was triggered by text found in file 'tocs' matching 'DYNTOR')

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output one_vehicle ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x00000156A5DB54C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x00000156A5D7FC00>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x00000156A5D7FFC0>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x00000156A68823C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x00000156A5DBFA40>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x00000156A5D7F340>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x00000156A5D91180>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x00000156A5D91DC0>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x00000156A5D91B00>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x00000156A5D913C0>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
1,98c1,48
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport_multihop ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
17,24c17,24
< success 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 230.1) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 0.1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.1, 148.2) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 231.0) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.0, 149.0) [('e2', 9.91), ('e3', 10.0), ('edge', 9.91), ('lane', 9.91)]
< success 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 240.0) [('e2', 9.42), ('e3', 9.9), ('edge', 9.42), ('lane', 9.42)]
< success 10 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (140.0, 150.0) [('e2', 9.96), ('e3', 9.99), ('edge', 9.96), ('lane', 9.96)]
< success 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.22), ('e3', 5.71), ('edge', 9.22), ('lane', 9.22)]
< success 100 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 9.53), ('e2', 5.82), ('e3', 6.93), ('edge', 5.82), ('lane', 5.82)]
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x00000189FFC85300>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x0000018986011080>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x00000189FFAA1B80>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x00000189FEFC4EC0>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x00000189FF043400>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x00000189FF043A80>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x00000189FF043900>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x00000189FF043140>
41,98c41,48
< success 0.1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 0.1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 10 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (240.0, 250.0) [('e2', 9.9), ('e3', 10.0), ('edge', 9.9), ('lane', 9.9)]
< success 10 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 160.0) [('e2', 9.15), ('e3', 9.84), ('edge', 9.15), ('lane', 9.15)]
< success 100 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.41), ('e3', 5.84), ('edge', 9.41), ('lane', 9.41)]
< success 100 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 10.0), ('e2', 5.94), ('e3', 7.08), ('edge', 5.94), ('lane', 5.94)]
< -- Unordered text as found by filter '^Loading configuration ... done.' --
< Loading configuration ... done.
< Loading configuration ... done.
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output teleport_multihop_newDefaults ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
9,24c9,24
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000250DC4F5080>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000250DC5443C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000250DC48F0C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000250DC48FB80>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x00000250DC48FE80>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x00000250DC48FB80>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x00000250DC48F440>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x00000250DC48F780>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000250DD159200>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x00000250DD4CE280>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000250DC545840>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x00000250DC4E3100>
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_same_vehicles ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x000002A4389573C0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x000002A4388EB740>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000002A4388EB580>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x000002A439429D40>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x000002A4389277C0>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000002A438979380>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x000002A438979C00>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x000002A438967B40>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x000002A4389671C0>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x000002A438967240>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_vehicles_diff_length ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x0000029874DFCF80>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x0000029874DB70C0>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x0000029874DB7280>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x00000298758C7480>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x0000029874E08B80>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x0000029874E08C00>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x0000029874E08400>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x0000029874DBF880>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x0000029874DBF1C0>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x0000029874DBF380>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-wintest-ba : sumo output two_vehicles_diff_speed ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1,24
> failed 0.1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000002377FB212C0>
> failed 1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000002377FB21FC0>
> failed 10 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FB232C0>
> failed 100 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x000002377FB23040>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000002377FB5A080>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000002377FAE6340>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FAE6D00>
> failed 100 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000002377FAE6BC0>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x000002377FE263C0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x000002377FB23FC0>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FB57500>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000002377FB67B00>
> failed 0.1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB6C2C0>
> failed 1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB5F700>
> failed 10 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FB62780>
> failed 100 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x000002377FB57A80>
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB57FC0>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB57800>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FB57580>
> failed 100 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000002377FB62480>
> failed 0.1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB57FC0>
> failed 1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x000002377FB4DFC0>
> failed 10 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x000002377FB0C580>
> failed 100 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x000002377FB674C0>

TEST had known bugs (see #3263) on ts-sim-wintest-ba : traci vehicle moveToXY keepRoute2 ( Last six runs Aug2022 )

mapping failure
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1
> internal corner (inside, segment2) failed: x=198, x2=198.0,   y=1.9, y2=1.9,   lane=middle_0, lane2=middle_0, pos=102, pos2=98.0   posLat=2.0 posLat2=1.9

TEST had known bugs (see #6192) on ts-sim-wintest-ba : traci vehicle openGap with_low_maxDecel_fast_CACC ( Last six runs Aug2022 )

not even failing as intended
(This bug was triggered by text found in file 'errors' matching 'Error')
---------- Differences in errors ----------
0a1,8
> Traceback (most recent call last):
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/vehicle/openGap/runner.py", line 156, in <module>
>     runSingle(targetTimeHeadway, targetSpaceHeadway, duration, changeRate, maxDecel, refVehID)
>   File "C:\Users\delphi\testreports\sumo\git\tests\..\tests/complex/traci/vehicle/openGap/runner.py", line 66, in runSingle
>     leader = results[tc.VAR_LEADER][0]
> TypeError: 'NoneType' object is not subscriptable
> Error: tcpip::Socket::recvAndCheck @ recv: peer shutdown
> Quitting (on error).
---------- Differences in output ----------
3,102c3,102
< Time 2.0: Gap 'follower'->'leader' = 5.938 (headway=0.367)
< 'follower' speed = 16.161582708
< Time 3.0: Gap 'follower'->'leader' = 8.966 (headway=0.528)
< 'follower' speed = 16.9836198736
< Time 4.0: Gap 'follower'->'leader' = 11.281 (headway=0.641)
< 'follower' speed = 17.5863190784
< Time 5.0: Gap 'follower'->'leader' = 13.069 (headway=0.725)
< 'follower' speed = 18.0379935645
< Time 6.0: Gap 'follower'->'leader' = 14.459 (headway=0.787)
< 'follower' speed = 18.3815472225
< Time 7.0: Gap 'follower'->'leader' = 15.545 (headway=0.834)
< 'follower' speed = 18.6456171431
< Time 8.0: Gap 'follower'->'leader' = 16.397 (headway=0.870)
< 'follower' speed = 18.8501483763
< Time 9.0: Gap 'follower'->'leader' = 17.068 (headway=0.898)
< 'follower' speed = 19.0094667411
< Time 10.0: Gap 'follower'->'leader' = 17.596 (headway=0.920)
< 'follower' speed = 19.1340998278
< Time 11.0: Gap 'follower'->'leader' = 18.013 (headway=0.937)
< 'follower' speed = 19.231918606
< Time 12.0: Gap 'follower'->'leader' = 18.342 (headway=0.950)
< 'follower' speed = 19.3088858604
< Time 13.0: Gap 'follower'->'leader' = 18.603 (headway=0.960)
< 'follower' speed = 19.3695649077
< Time 14.0: Gap 'follower'->'leader' = 18.810 (headway=0.969)
< 'follower' speed = 19.4174756866
< Time 15.0: Gap 'follower'->'leader' = 18.973 (headway=0.975)
< 'follower' speed = 19.4553500651
< Time 16.0: Gap 'follower'->'leader' = 19.103 (headway=0.980)
<truncated after showing first 30 lines>