17Aug22rv1_14_1+0351-d1923169351 - detailed test results for COMPLEX

To reconnect the TextTest GUI to these results, run:

texttest -a complex -d /home/delphi/coverageGcc/sumo/tests -reconnect /home/delphi/coverageGcc/texttesttmp/coverage_gcc4_64.31Aug090759.375449 -g

To start TextTest for these tests, run:

texttest -a complex -d /home/delphi/coverageGcc/sumo/tests

default: 661 tests: 635 succeeded 16 FAILED 10 known bugs

Detailed information for the tests that FAILED:

TEST FAILED on ts-sim-build-ba : sumo meso edge_split ( Last six runs Aug2022 )

---------- Differences in output ----------
10c10
< Statistics (avg):
---
> Statistics (avg of 4000):
29c29
< Statistics (avg):
---
> Statistics (avg of 4000):
48c48
< Statistics (avg):
---
> Statistics (avg of 4000):
67c67
< Statistics (avg):
---
> Statistics (avg of 4000):

TEST FAILED on ts-sim-build-ba : sumo vehroute-roundtrip grid2_random ( Last six runs Aug2022 )

---------- Differences in output ----------
11c11
< Statistics (avg):
---
> Statistics (avg of 2000):
31c31
< Statistics (avg):
---
> Statistics (avg of 2000):
39,40c39,40
< <     <vehicleTripStatistics routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="7.83" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="15661.00"/>
< >     <vehicleTripStatistics routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="0.00"/>
---
> <     <vehicleTripStatistics count="2000" routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="7.83" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="15661.00"/>
> >     <vehicleTripStatistics count="2000" routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="0.00"/>
---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="7.83" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="15661.00"/>
---
>     <vehicleTripStatistics count="2000" routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="7.83" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="15661.00"/>
---------- Differences in statistics2 ----------
9c9
<     <vehicleTripStatistics routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="0.00"/>
---
>     <vehicleTripStatistics count="2000" routeLength="485.39" speed="3.83" duration="187.59" waitingTime="110.69" timeLoss="149.58" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="375184.00" totalDepartDelay="0.00"/>

TEST FAILED on ts-sim-build-ba : sumo vehroute-roundtrip grid_flows ( Last six runs Aug2022 )

---------- Differences in output ----------
10c10
< Statistics (avg):
---
> Statistics (avg of 832):
29c29
< Statistics (avg):
---
> Statistics (avg of 832):
37,38c37,38
< <     <vehicleTripStatistics routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="8.53" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="7097.00"/>
< >     <vehicleTripStatistics routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="0.00"/>
---
> <     <vehicleTripStatistics count="832" routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="8.53" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="7097.00"/>
> >     <vehicleTripStatistics count="832" routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="0.00"/>
---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="8.53" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="7097.00"/>
---
>     <vehicleTripStatistics count="832" routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="8.53" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="7097.00"/>
---------- Differences in statistics2 ----------
9c9
<     <vehicleTripStatistics routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="0.00"/>
---
>     <vehicleTripStatistics count="832" routeLength="1179.67" speed="4.17" duration="306.01" waitingTime="144.70" timeLoss="218.02" departDelay="0.00" departDelayWaiting="-1.00" totalTravelTime="254598.00" totalDepartDelay="0.00"/>

TEST FAILED on ts-sim-build-ba : traci bugs ticket4432 ( Last six runs Aug2022 )

---------- Differences in output ----------
11c11
< Statistics (avg):
---
> Statistics (avg of 100):
29c29
< Statistics (avg):
---
> Statistics (avg of 100):

TEST FAILED on ts-sim-build-ba : traci vehicle moveToXY intersection ( Last six runs Aug2022 )

---------- Differences in output ----------
10c10
< Statistics (avg):
---
> Statistics (avg of 11):

TEST FAILED on ts-sim-build-ba : traffic_lights loop_flow actuated ( Last six runs Aug2022 )

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="6.38" duration="341.15" waitingTime="181.49" timeLoss="193.70" departDelay="160.50" departDelayWaiting="-1.00" totalTravelTime="497401.00" totalDepartDelay="234006.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="6.38" duration="341.15" waitingTime="181.49" timeLoss="193.70" departDelay="160.50" departDelayWaiting="-1.00" totalTravelTime="497401.00" totalDepartDelay="234006.00"/>

2 TESTS FAILED on ts-sim-build-ba :

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="5.88" duration="372.99" waitingTime="203.23" timeLoss="225.54" departDelay="188.65" departDelayWaiting="-1.00" totalTravelTime="543821.00" totalDepartDelay="275056.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="5.88" duration="372.99" waitingTime="203.23" timeLoss="225.54" departDelay="188.65" departDelayWaiting="-1.00" totalTravelTime="543821.00" totalDepartDelay="275056.00"/>

traffic_lights loop_flow sotl_marching ( Last six runs Aug2022 )
traffic_lights loop_flow static ( Last six runs Aug2022 )

TEST FAILED on ts-sim-build-ba : traffic_lights loop_flow sotl_phase ( Last six runs Aug2022 )

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="3.93" duration="596.32" waitingTime="386.67" timeLoss="448.92" departDelay="403.70" departDelayWaiting="-1.00" totalTravelTime="869438.00" totalDepartDelay="588597.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="3.93" duration="596.32" waitingTime="386.67" timeLoss="448.92" departDelay="403.70" departDelayWaiting="-1.00" totalTravelTime="869438.00" totalDepartDelay="588597.00"/>

2 TESTS FAILED on ts-sim-build-ba :

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="6.39" duration="341.17" waitingTime="181.60" timeLoss="193.72" departDelay="161.01" departDelayWaiting="-1.00" totalTravelTime="497424.00" totalDepartDelay="234760.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="6.39" duration="341.17" waitingTime="181.60" timeLoss="193.72" departDelay="161.01" departDelayWaiting="-1.00" totalTravelTime="497424.00" totalDepartDelay="234760.00"/>

traffic_lights loop_flow sotl_platoon ( Last six runs Aug2022 )
traffic_lights loop_flow swarm ( Last six runs Aug2022 )

TEST FAILED on ts-sim-build-ba : traffic_lights loop_flow sotl_request ( Last six runs Aug2022 )

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="2.21" duration="1173.59" waitingTime="857.87" timeLoss="1026.39" departDelay="976.80" departDelayWaiting="-1.00" totalTravelTime="1711091.00" totalDepartDelay="1424181.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="2.21" duration="1173.59" waitingTime="857.87" timeLoss="1026.39" departDelay="976.80" departDelayWaiting="-1.00" totalTravelTime="1711091.00" totalDepartDelay="1424181.00"/>

TEST FAILED on ts-sim-build-ba : traffic_lights loop_flow sotl_wave ( Last six runs Aug2022 )

---------- Differences in statistics ----------
9c9
<     <vehicleTripStatistics routeLength="2041.90" speed="6.28" duration="345.05" waitingTime="184.56" timeLoss="197.59" departDelay="167.76" departDelayWaiting="-1.00" totalTravelTime="503081.00" totalDepartDelay="244599.00"/>
---
>     <vehicleTripStatistics count="1458" routeLength="2041.90" speed="6.28" duration="345.05" waitingTime="184.56" timeLoss="197.59" departDelay="167.76" departDelayWaiting="-1.00" totalTravelTime="503081.00" totalDepartDelay="244599.00"/>

TEST FAILED on ts-sim-build-ba : tutorial city_mobil taxi_cyber ( Last six runs Aug2022 )

---------- Differences in errors ----------
1,2c1
< Warning: Person 'v-7.5p0' is jammed on edge 'cyber6to7', time=644.00.
< Warning: Person 'v7.6p2' is jammed on edge 'cyber6to7', time=648.00.
---
> Warning: Person 'v-7.6p0' is jammed on edge 'cyber6to7', time=681.00.

TEST FAILED on ts-sim-build-ba : tutorial manhattan ( Last six runs Aug2022 )

---------- Differences in output ----------
14c14
< Statistics (avg):
---
> Statistics (avg of 0):

TEST FAILED on ts-sim-build-ba : tutorial public_transport ( Last six runs Aug2022 )

---------- Differences in output ----------
14c14
< Statistics (avg):
---
> Statistics (avg of 25):

Detailed information for the tests that had known bugs:

TEST had known bugs (see #8973) on ts-sim-build-ba : sumo ToCDevice dynamic_ToC_stop ( Last six runs Aug2022 )

dynamic ToC triggered despite stop present on vehicle's lane continuation
(This bug was triggered by text found in file 'tocs' matching 'DYNTOR')

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output one_vehicle ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x7fcd5c13d1c0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x7fcd5c187740>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fcd5c112dc0>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (71.4, 71.5) <zip object at 0x7fcd5be042c0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (72.0, 73.0) <zip object at 0x7fcd5c148b80>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fcd5c13b100>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x7fcd5c182780>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x7fcd5c178d00>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (73.0, 74.0) <zip object at 0x7fcd5c178640>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fcd5c0dce80>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output teleport ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
1,98c1,48
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0']
< success ['--step-length', '.1', '--end', '100'] ['2/1to1/1_0', '1/1to0/1_0']
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.6, 108.7) [9.9, 10.0, 9.9, 9.9]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (108.0, 109.0) [9.87, 10.0, 9.87, 9.87]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 110.0) [9.85, 9.96, 9.85, 9.85]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< failed ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) [-1.0, 2.26, 3.2, 2.27, 2.27]
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0', '1/1to0/1_0']
< success ['--step-length', '1', '--end', '51'] ['2/1to1/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output teleport_multihop ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
17,24c17,24
< success 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 230.1) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 0.1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.1, 148.2) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 231.0) [('e2', 9.99), ('e3', 10.0), ('edge', 9.99), ('lane', 9.99)]
< success 1 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (148.0, 149.0) [('e2', 9.91), ('e3', 10.0), ('edge', 9.91), ('lane', 9.91)]
< success 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (230.0, 240.0) [('e2', 9.42), ('e3', 9.9), ('edge', 9.42), ('lane', 9.42)]
< success 10 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (140.0, 150.0) [('e2', 9.96), ('e3', 9.99), ('edge', 9.96), ('lane', 9.96)]
< success 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.22), ('e3', 5.71), ('edge', 9.22), ('lane', 9.22)]
< success 100 ['--step-length', '.1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 9.53), ('e2', 5.82), ('e3', 6.93), ('edge', 5.82), ('lane', 5.82)]
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x7f3b18da94c0>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (148.9, 149.0) <zip object at 0x7f3b18aa12c0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x7f3b18f8d700>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (149.0, 150.0) <zip object at 0x7f3b192e3280>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x7f3b192bfa80>
> failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (140.0, 150.0) <zip object at 0x7f3b192bfc00>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x7f3b192bf340>
> failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (100.0, 200.0) <zip object at 0x7f3b1934fe40>
41,98c41,48
< success 0.1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 0.1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 1 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (245.0, 246.0) [('e2', 8.92), ('e3', 10.0), ('edge', 8.92), ('lane', 8.92)]
< success 1 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 151.0) [('e2', 9.82), ('e3', 10.0), ('edge', 9.82), ('lane', 9.82)]
< success 10 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (240.0, 250.0) [('e2', 9.9), ('e3', 10.0), ('edge', 9.9), ('lane', 9.9)]
< success 10 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (150.0, 160.0) [('e2', 9.15), ('e3', 9.84), ('edge', 9.15), ('lane', 9.15)]
< success 100 ['--step-length', '1', '--end', '1000'] 2/1to1/1_0 (200.0, 300.0) [('e1', 10.0), ('e2', 9.41), ('e3', 5.84), ('edge', 9.41), ('lane', 9.41)]
< success 100 ['--step-length', '1', '--end', '1000'] 1/1to0/1_0 (100.0, 200.0) [('e1', 10.0), ('e2', 5.94), ('e3', 7.08), ('edge', 5.94), ('lane', 5.94)]
< -- Unordered text as found by filter '^Loading configuration ... done.' --
< Loading configuration ... done.
< Loading configuration ... done.
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output teleport_multihop_newDefaults ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
9,24c9,24
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.2, 76.3) [('e2', 10.49), ('e3', 10.35), ('edge', 10.49), ('lane', 10.49)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (76.0, 77.0) [('e2', 10.39), ('e3', 10.35), ('edge', 10.39), ('lane', 10.39)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 10 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 80.0) [('e2', 10.42), ('e3', 10.25), ('edge', 10.42), ('lane', 10.42)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
< failed 100 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (0.0, 100.0) [('e1', 10.27), ('e2', 10.24), ('e3', 9.59), ('edge', 10.24), ('lane', 10.24)]
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x7fd777dc62c0>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x7fd777d933c0>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x7fd777db2b40>
> failed 1 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x7fd777db2640>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x7fd777db20c0>
> failed 10 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (70.0, 80.0) <zip object at 0x7fd777db2a40>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x7fd777db2800>
> failed 100 ['--step-length', '.1', '--end', '100'] 2/1to1/1_0 (0.0, 100.0) <zip object at 0x7fd777db0100>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x7fd7778b82c0>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.9, 71.0) <zip object at 0x7fd7775a20c0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x7fd777a7bf40>
> failed 1 ['--step-length', '.1', '--end', '1000'] 2/1to1/1_0 (70.0, 71.0) <zip object at 0x7fd777db0e40>
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output two_same_vehicles ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x7fc1ec0763c0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x7fc1ec086e00>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fc1ec086e80>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (75.4, 75.5) <zip object at 0x7fc1ebd2b440>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.0, 77.0) <zip object at 0x7fc1ec00da00>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fc1ec006740>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x7fc1ec006540>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x7fc1ec071e80>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x7fc1ec0b3380>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7fc1ec0b3a00>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output two_vehicles_diff_length ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
5,7c5,7
< success 0.1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x7f0aebe5e2c0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x7f0aebef0e00>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7f0aebe40cc0>
9,12c9,12
< success 0.1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
< success 100 ['--step-length', '.1', '--end', '1000'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (76.4, 76.5) <zip object at 0x7f0aebb2f4c0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (77.0, 78.0) <zip object at 0x7f0aebe612c0>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7f0aebe61980>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (100.0, 200.0) <zip object at 0x7f0aebdf67c0>
17,19c17,19
< success 0.1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '100'] ['3/1to2/1_0']
---
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x7f0aebe9b900>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (78.0, 79.0) <zip object at 0x7f0aebe9b680>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (80.0, 90.0) <zip object at 0x7f0aebe9ba00>
21,50c21,24
< success 0.1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 1 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
< success 10 ['--step-length', '1', '--end', '1000'] ['3/1to2/1_0']
<truncated after showing first 30 lines>

TEST had known bugs (see #254) on ts-sim-build-ba : sumo output two_vehicles_diff_speed ( Last six runs Aug2022 )

different outputs from detectors which should detect the same
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1,24
> failed 0.1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x7f526e96e2c0>
> failed 1 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x7f526e978240>
> failed 10 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e978040>
> failed 100 ['--step-length', '.1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x7f526e978080>
> failed 0.1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x7f526e9313c0>
> failed 1 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x7f526e9789c0>
> failed 10 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e9787c0>
> failed 100 ['--step-length', '.1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x7f526e978d40>
> failed 0.1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.4, 38.5) <zip object at 0x7f526e5fa3c0>
> failed 1 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (38.0, 39.0) <zip object at 0x7f526e969a00>
> failed 10 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e914300>
> failed 100 ['--step-length', '.1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x7f526e933100>
> failed 0.1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e8c1b40>
> failed 1 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e8ceb00>
> failed 10 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e8c1d40>
> failed 100 ['--step-length', '1', '--end', '51'] 3/1to2/1_0 (0.0, 51.0) <zip object at 0x7f526e8c1c40>
> failed 0.1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e8c1040>
> failed 1 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e8c19c0>
> failed 10 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e92ca00>
> failed 100 ['--step-length', '1', '--end', '100'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x7f526e8c19c0>
> failed 0.1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e9bcf40>
> failed 1 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (39.0, 40.0) <zip object at 0x7f526e969440>
> failed 10 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (30.0, 40.0) <zip object at 0x7f526e9bce00>
> failed 100 ['--step-length', '1', '--end', '1000'] 3/1to2/1_0 (0.0, 100.0) <zip object at 0x7f526e969d80>

TEST had known bugs (see #3263) on ts-sim-build-ba : traci vehicle moveToXY keepRoute2 ( Last six runs Aug2022 )

mapping failure
(This bug was triggered by text found in file 'output' matching 'failed')
---------- Differences in output ----------
0a1
> internal corner (inside, segment2) failed: x=198, x2=198.0,   y=1.9, y2=1.9,   lane=middle_0, lane2=middle_0, pos=102, pos2=98.0   posLat=2.0 posLat2=1.9

TEST had known bugs (see #6192) on ts-sim-build-ba : traci vehicle openGap with_low_maxDecel_fast_CACC ( Last six runs Aug2022 )

not even failing as intended
(This bug was triggered by text found in file 'errors' matching 'Error')
---------- Differences in errors ----------
0a1,8
> Traceback (most recent call last):
>   File "/home/delphi/coverageGcc/sumo/tests/../tests/complex/traci/vehicle/openGap/runner.py", line 156, in <module>
>     runSingle(targetTimeHeadway, targetSpaceHeadway, duration, changeRate, maxDecel, refVehID)
>   File "/home/delphi/coverageGcc/sumo/tests/../tests/complex/traci/vehicle/openGap/runner.py", line 66, in runSingle
>     leader = results[tc.VAR_LEADER][0]
> TypeError: 'NoneType' object is not subscriptable
> Error: tcpip::Socket::recvAndCheck @ recv: peer shutdown
> Quitting (on error).
---------- Differences in output ----------
3,102c3,102
< Time 2.0: Gap 'follower'->'leader' = 5.938 (headway=0.367)
< 'follower' speed = 16.161582708
< Time 3.0: Gap 'follower'->'leader' = 8.966 (headway=0.528)
< 'follower' speed = 16.9836198736
< Time 4.0: Gap 'follower'->'leader' = 11.281 (headway=0.641)
< 'follower' speed = 17.5863190784
< Time 5.0: Gap 'follower'->'leader' = 13.069 (headway=0.725)
< 'follower' speed = 18.0379935645
< Time 6.0: Gap 'follower'->'leader' = 14.459 (headway=0.787)
< 'follower' speed = 18.3815472225
< Time 7.0: Gap 'follower'->'leader' = 15.545 (headway=0.834)
< 'follower' speed = 18.6456171431
< Time 8.0: Gap 'follower'->'leader' = 16.397 (headway=0.870)
< 'follower' speed = 18.8501483763
< Time 9.0: Gap 'follower'->'leader' = 17.068 (headway=0.898)
< 'follower' speed = 19.0094667411
< Time 10.0: Gap 'follower'->'leader' = 17.596 (headway=0.920)
< 'follower' speed = 19.1340998278
< Time 11.0: Gap 'follower'->'leader' = 18.013 (headway=0.937)
< 'follower' speed = 19.231918606
< Time 12.0: Gap 'follower'->'leader' = 18.342 (headway=0.950)
< 'follower' speed = 19.3088858604
< Time 13.0: Gap 'follower'->'leader' = 18.603 (headway=0.960)
< 'follower' speed = 19.3695649077
< Time 14.0: Gap 'follower'->'leader' = 18.810 (headway=0.969)
< 'follower' speed = 19.4174756866
< Time 15.0: Gap 'follower'->'leader' = 18.973 (headway=0.975)
< 'follower' speed = 19.4553500651
< Time 16.0: Gap 'follower'->'leader' = 19.103 (headway=0.980)
<truncated after showing first 30 lines>