22Nov2013 - detailed test results for SUMO
(To start TextTest for these tests, run 'texttest -a sumo -d /home/delphi/sumo/tests')
Total: 2294 tests: 2275 succeeded 16 known bugs 2 FAILED 1 faster
default: 1154 tests: 1145 succeeded 8 known bugs 1 faster
Detailed information for the tests that had known bugs:
the departure rule maxSpeedGap is not implemented yet
(This bug was triggered by text found in file 'rawdump' matching '<vehicle id="3"')
---------- Differences in rawdump ----------
1c1
< <?xml version="1.0"?>
---
> <?xml version="1.0" encoding="UTF-8"?>
4c4
< <sumo-netstate>
---
> <netstate xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://sumo-sim.org/xsd/netstate_file.xsd">
9c9,10
< <vehicle id="2" pos="378.75" speed="27.80"/>
---
> <vehicle id="3" pos="12252332.75" speed="10496.23"/>
> <vehicle id="2" pos="5750.62" speed="214.70"/>
15c16
< </sumo-netstate>
---
> </netstate>
changing lanes is sometimes unsafe
(This bug was triggered by text found in file 'errors' matching 'Warning: Teleporting vehicle')
---------- Differences in errors ----------
0a1,2
> Warning: Teleporting vehicle 'collider'; collision with 'victim', lane='end_2', gap=-22.30, time=4.00 stage=1.
> Warning: Vehicle 'collider' teleports beyond end of route ('end'), time 4.00.
2 TESTS had known bugs (see #1055) on ts-simulation8 :
stops in cyclic routes don't work as expected
(This bug was triggered by text found in file 'errors' matching 'Teleport')
---------- Differences in errors ----------
0a1,4
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=420.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 420.00.
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=788.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 788.00.
---------- Differences in rawdump ----------
17c17
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.82"/>
25c25
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
33c33
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
41c41
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
49c49
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
57c57
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
65c65
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
73c73
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
<truncated after showing first 30 lines>
extended rerouter cyclic_route stops_in_route (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
extended rerouter cyclic_route stops_in_veh (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back 2junctions_2nd_blocked (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="across"')
---------- Differences in tripinfos ----------
9d8
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back no_space_behind_junction_blocker_braking (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id')
---------- Differences in tripinfos ----------
5d4
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back blocker_with_enough_free_space (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="ego"')
---------- Differences in tripinfos ----------
5,6c5
< <tripinfo id="ego" depart="0.00" departLane="beg_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="6.00" arrivalLane="middle_0" arrivalPos="4.00" arrivalSpeed="2.56" duration="6.00" routeLength="17.45" waitSteps="0" rerouteNo="0" devices="tripinfo_ego" vType="DEFAULT_VEHTYPE" vaporized=""/>
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="15.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="10.73" duration="15.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
---
> <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
fractional end time bug
(This bug was triggered by text found in file 'summary' matching 'inserted="1"')
---------- Differences in summary ----------
55c55
< <step time="50.00" loaded="1" inserted="0" running="0" waiting="0" ended="0" meanWaitingTime="-1.00" meanTravelTime="-1.00"/>
---
> <step time="50.00" loaded="1" inserted="1" running="1" waiting="0" ended="0" meanWaitingTime="0.00" meanTravelTime="-1.00"/>
Detailed information for the tests that ran faster:
---------- Differences in performance(faster) ----------
1c1
< Total Performance : 768121.0 ms on bavf160d
---
> Total Performance : 415671.0 ms on ts-simulation8
gui: 1140 tests: 1130 succeeded 8 known bugs 2 FAILED
Detailed information for the tests that FAILED:
---------- Differences in output ----------
6c6
< Simulation ended at time: 31.00
---
> Simulation ended at time: 30.00
---------- Differences in vehroutes ----------
5c5
< <vehicle id="v0" depart="0.00" arrival="26.00">
---
> <vehicle id="v0" depart="0.00" arrival="25.00">
9c9
< <vehicle id="v1" depart="4.00" arrival="30.00">
---
> <vehicle id="v1" depart="3.00" arrival="29.00">
---------- Differences in output ----------
6c6
< Simulation ended at time: 31.00
---
> Simulation ended at time: 30.00
---------- Differences in state2 ----------
6c6
< <delay number="2" end="0" depart="4.00" time="0.00"/>
---
> <delay number="2" end="0" depart="3.00" time="0.00"/>
10,11c10,11
< <vehicle id="v0" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="0 1" pos="71.77" speed="13.89"/>
< <vehicle id="v1" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="4000 1" pos="18.70" speed="8.80"/>
---
> <vehicle id="v0" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="0 1" pos="85.66" speed="13.89"/>
> <vehicle id="v1" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="3000 1" pos="30.10" speed="11.40"/>
---------- Differences in vehroutes ----------
5c5
< <vehicle id="v0" depart="0.00" arrival="26.00">
---
> <vehicle id="v0" depart="0.00" arrival="25.00">
9c9
< <vehicle id="v1" depart="4.00" arrival="30.00">
---
> <vehicle id="v1" depart="3.00" arrival="29.00">
Detailed information for the tests that had known bugs:
the departure rule maxSpeedGap is not implemented yet
(This bug was triggered by text found in file 'rawdump' matching '<vehicle id="3"')
---------- Differences in rawdump ----------
1c1
< <?xml version="1.0"?>
---
> <?xml version="1.0" encoding="UTF-8"?>
4c4
< <sumo-netstate>
---
> <netstate xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://sumo-sim.org/xsd/netstate_file.xsd">
9c9,10
< <vehicle id="2" pos="378.75" speed="27.80"/>
---
> <vehicle id="3" pos="12252332.75" speed="10496.23"/>
> <vehicle id="2" pos="5750.62" speed="214.70"/>
15c16
< </sumo-netstate>
---
> </netstate>
changing lanes is sometimes unsafe
(This bug was triggered by text found in file 'errors' matching 'Warning: Teleporting vehicle')
---------- Differences in errors ----------
0a1,2
> Warning: Teleporting vehicle 'collider'; collision with 'victim', lane='end_2', gap=-22.30, time=4.00 stage=1.
> Warning: Vehicle 'collider' teleports beyond end of route ('end'), time 4.00.
2 TESTS had known bugs (see #1055) on ts-simulation8 :
stops in cyclic routes don't work as expected
(This bug was triggered by text found in file 'errors' matching 'Teleport')
---------- Differences in errors ----------
0a1,4
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=420.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 420.00.
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=788.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 788.00.
---------- Differences in rawdump ----------
17c17
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.82"/>
25c25
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
33c33
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
41c41
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
49c49
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
57c57
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
65c65
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
> <vehicle id="veh0" pos="5.92" speed="0.00"/>
73c73
< <vehicle id="veh0" pos="5.10" speed="0.00"/>
<truncated after showing first 30 lines>
extended rerouter cyclic_route stops_in_route (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
extended rerouter cyclic_route stops_in_veh (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back 2junctions_2nd_blocked (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="across"')
---------- Differences in tripinfos ----------
9d8
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back no_space_behind_junction_blocker_braking (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id')
---------- Differences in tripinfos ----------
5d4
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back blocker_with_enough_free_space (
Last six runs
Jan2014
Dec2013
Nov2013
Oct2013
Sep2013
Aug2013
)
crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="ego"')
---------- Differences in tripinfos ----------
5,6c5
< <tripinfo id="ego" depart="0.00" departLane="beg_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="6.00" arrivalLane="middle_0" arrivalPos="4.00" arrivalSpeed="2.56" duration="6.00" routeLength="17.45" waitSteps="0" rerouteNo="0" devices="tripinfo_ego" vType="DEFAULT_VEHTYPE" vaporized=""/>
< <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="15.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="10.73" duration="15.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
---
> <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
fractional end time bug
(This bug was triggered by text found in file 'summary' matching 'inserted="1"')
---------- Differences in summary ----------
55c55
< <step time="50.00" loaded="1" inserted="0" running="0" waiting="0" ended="0" meanWaitingTime="-1.00" meanTravelTime="-1.00"/>
---
> <step time="50.00" loaded="1" inserted="1" running="1" waiting="0" ended="0" meanWaitingTime="0.00" meanTravelTime="-1.00"/>