27Nov2013 - detailed test results for SUMO

(To start TextTest for these tests, run 'texttest -a sumo -d /home/delphi/sumo/tests')

Total: 2294 tests: 2275 succeeded 16 known bugs 2 FAILED 1 faster


default: 1154 tests: 1145 succeeded 8 known bugs 1 faster

Detailed information for the tests that had known bugs:

TEST had known bugs (see #462) on ts-simulation8 : spec departure pos_maxSpeedGap_3veh_vmax ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

the departure rule maxSpeedGap is not implemented yet
(This bug was triggered by text found in file 'rawdump' matching '<vehicle id="3"')
---------- Differences in rawdump ----------
1c1
< <?xml version="1.0"?>
---
> <?xml version="1.0" encoding="UTF-8"?>
4c4
< <sumo-netstate>
---
> <netstate xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://sumo-sim.org/xsd/netstate_file.xsd">
9c9,10
<                 <vehicle id="2" pos="378.75" speed="27.80"/>
---
>                 <vehicle id="3" pos="12252332.75" speed="10496.23"/>
>                 <vehicle id="2" pos="5750.62" speed="214.70"/>
15c16
< </sumo-netstate>
---
> </netstate>

TEST had known bugs (see #967) on ts-simulation8 : bugs ticket967 ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

changing lanes is sometimes unsafe
(This bug was triggered by text found in file 'errors' matching 'Warning: Teleporting vehicle')
---------- Differences in errors ----------
0a1,2
> Warning: Teleporting vehicle 'collider'; collision with 'victim', lane='end_2', gap=-22.30, time=4.00 stage=1.
> Warning: Vehicle 'collider' teleports beyond end of route ('end'), time 4.00.

2 TESTS had known bugs (see #1055) on ts-simulation8 :

stops in cyclic routes don't work as expected
(This bug was triggered by text found in file 'errors' matching 'Teleport')
---------- Differences in errors ----------
0a1,4
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=420.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 420.00.
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=788.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 788.00.
---------- Differences in rawdump ----------
17c17
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.82"/>
25c25
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
33c33
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
41c41
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
49c49
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
57c57
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
65c65
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
73c73
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
<truncated after showing first 30 lines>
extended rerouter cyclic_route stops_in_route ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )
extended rerouter cyclic_route stops_in_veh ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back 2junctions_2nd_blocked ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="across"')
---------- Differences in tripinfos ----------
9d8
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back no_space_behind_junction_blocker_braking ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id')
---------- Differences in tripinfos ----------
5d4
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back blocker_with_enough_free_space ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="ego"')
---------- Differences in tripinfos ----------
5,6c5
<     <tripinfo id="ego" depart="0.00" departLane="beg_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="6.00" arrivalLane="middle_0" arrivalPos="4.00" arrivalSpeed="2.56" duration="6.00" routeLength="17.45" waitSteps="0" rerouteNo="0" devices="tripinfo_ego" vType="DEFAULT_VEHTYPE" vaporized=""/>
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="15.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="10.73" duration="15.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
---
>     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #689) on ts-simulation8 : basic routes simtime_fractional b0_e50_01 ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

fractional end time bug
(This bug was triggered by text found in file 'summary' matching 'inserted="1"')
---------- Differences in summary ----------
55c55
<     <step time="50.00" loaded="1" inserted="0" running="0" waiting="0" ended="0" meanWaitingTime="-1.00" meanTravelTime="-1.00"/>
---
>     <step time="50.00" loaded="1" inserted="1" running="1" waiting="0" ended="0" meanWaitingTime="0.00" meanTravelTime="-1.00"/>

Detailed information for the tests that ran faster:

TEST ran faster on ts-simulation8 : extended stops stress ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

---------- Differences in performance(faster) ----------
1c1
< Total Performance  :      768121.0 ms on bavf160d
---
> Total Performance  :      420687.0 ms on ts-simulation8

gui: 1140 tests: 1130 succeeded 8 known bugs 2 FAILED

Detailed information for the tests that FAILED:

TEST FAILED on ts-simulation8 : extended state load_late_insertion ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

---------- Differences in output ----------
6c6
< Simulation ended at time: 31.00
---
> Simulation ended at time: 30.00
---------- Differences in vehroutes ----------
5c5
<     <vehicle id="v0" depart="0.00" arrival="26.00">
---
>     <vehicle id="v0" depart="0.00" arrival="25.00">
9c9
<     <vehicle id="v1" depart="4.00" arrival="30.00">
---
>     <vehicle id="v1" depart="3.00" arrival="29.00">

TEST FAILED on ts-simulation8 : extended state load_and_save ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

---------- Differences in output ----------
6c6
< Simulation ended at time: 31.00
---
> Simulation ended at time: 30.00
---------- Differences in state2 ----------
6c6
<     <delay number="2" end="0" depart="4.00" time="0.00"/>
---
>     <delay number="2" end="0" depart="3.00" time="0.00"/>
10,11c10,11
<     <vehicle id="v0" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="0 1" pos="71.77" speed="13.89"/>
<     <vehicle id="v1" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="4000 1" pos="18.70" speed="8.80"/>
---
>     <vehicle id="v0" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="0 1" pos="85.66" speed="13.89"/>
>     <vehicle id="v1" depart="0" route="r0" type="DEFAULT_VEHTYPE" state="3000 1" pos="30.10" speed="11.40"/>
---------- Differences in vehroutes ----------
5c5
<     <vehicle id="v0" depart="0.00" arrival="26.00">
---
>     <vehicle id="v0" depart="0.00" arrival="25.00">
9c9
<     <vehicle id="v1" depart="4.00" arrival="30.00">
---
>     <vehicle id="v1" depart="3.00" arrival="29.00">

Detailed information for the tests that had known bugs:

TEST had known bugs (see #462) on ts-simulation8 : spec departure pos_maxSpeedGap_3veh_vmax ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

the departure rule maxSpeedGap is not implemented yet
(This bug was triggered by text found in file 'rawdump' matching '<vehicle id="3"')
---------- Differences in rawdump ----------
1c1
< <?xml version="1.0"?>
---
> <?xml version="1.0" encoding="UTF-8"?>
4c4
< <sumo-netstate>
---
> <netstate xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://sumo-sim.org/xsd/netstate_file.xsd">
9c9,10
<                 <vehicle id="2" pos="378.75" speed="27.80"/>
---
>                 <vehicle id="3" pos="12252332.75" speed="10496.23"/>
>                 <vehicle id="2" pos="5750.62" speed="214.70"/>
15c16
< </sumo-netstate>
---
> </netstate>

TEST had known bugs (see #967) on ts-simulation8 : bugs ticket967 ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

changing lanes is sometimes unsafe
(This bug was triggered by text found in file 'errors' matching 'Warning: Teleporting vehicle')
---------- Differences in errors ----------
0a1,2
> Warning: Teleporting vehicle 'collider'; collision with 'victim', lane='end_2', gap=-22.30, time=4.00 stage=1.
> Warning: Vehicle 'collider' teleports beyond end of route ('end'), time 4.00.

2 TESTS had known bugs (see #1055) on ts-simulation8 :

stops in cyclic routes don't work as expected
(This bug was triggered by text found in file 'errors' matching 'Teleport')
---------- Differences in errors ----------
0a1,4
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=420.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 420.00.
> Warning: Teleporting vehicle 'veh0'; waited too long (wrong lane), lane='1fi_0', time=788.00.
> Warning: Vehicle 'veh0' ends teleporting on edge '1si', time 788.00.
---------- Differences in rawdump ----------
17c17
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.82"/>
25c25
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
33c33
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
41c41
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
49c49
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
57c57
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
65c65
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
---
>                 <vehicle id="veh0" pos="5.92" speed="0.00"/>
73c73
<                 <vehicle id="veh0" pos="5.10" speed="0.00"/>
<truncated after showing first 30 lines>
extended rerouter cyclic_route stops_in_route ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )
extended rerouter cyclic_route stops_in_veh ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back 2junctions_2nd_blocked ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="across"')
---------- Differences in tripinfos ----------
9d8
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back no_space_behind_junction_blocker_braking ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id')
---------- Differences in tripinfos ----------
5d4
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #913) on ts-simulation8 : basic dynamics avoid_spill_back blocker_with_enough_free_space ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

crll bug
(This bug was triggered by FAILING to find text in file 'tripinfos' matching '<tripinfo id="ego"')
---------- Differences in tripinfos ----------
5,6c5
<     <tripinfo id="ego" depart="0.00" departLane="beg_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="6.00" arrivalLane="middle_0" arrivalPos="4.00" arrivalSpeed="2.56" duration="6.00" routeLength="17.45" waitSteps="0" rerouteNo="0" devices="tripinfo_ego" vType="DEFAULT_VEHTYPE" vaporized=""/>
<     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="15.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="10.73" duration="15.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>
---
>     <tripinfo id="across" depart="0.00" departLane="across1_0" departPos="5.10" departSpeed="0.00" departDelay="0.00" arrival="14.00" arrivalLane="across2_0" arrivalPos="18.55" arrivalSpeed="13.75" duration="14.00" routeLength="108.70" waitSteps="0" rerouteNo="0" devices="tripinfo_across" vType="DEFAULT_VEHTYPE" vaporized=""/>

TEST had known bugs (see #689) on ts-simulation8 : basic routes simtime_fractional b0_e50_01 ( Last six runs Jan2014 Dec2013 Nov2013 Oct2013 Sep2013 Aug2013 )

fractional end time bug
(This bug was triggered by text found in file 'summary' matching 'inserted="1"')
---------- Differences in summary ----------
55c55
<     <step time="50.00" loaded="1" inserted="0" running="0" waiting="0" ended="0" meanWaitingTime="-1.00" meanTravelTime="-1.00"/>
---
>     <step time="50.00" loaded="1" inserted="1" running="1" waiting="0" ended="0" meanWaitingTime="0.00" meanTravelTime="-1.00"/>