24Feb2021 - detailed test results for TextTest

To reconnect the TextTest GUI to these results, run:

texttest -a texttest -c /home/delphi/texttest/texttest -d /home/delphi/texttest/selftest -reconnect /home/delphi/.texttest/tmp/texttest.02Mar000003.1204518 -g

To start TextTest for these tests, run:

texttest -a texttest -c /home/delphi/texttest/texttest -d /home/delphi/texttest/selftest

default: 852 tests: 793 succeeded 59 FAILED

Detailed information for the tests that FAILED:

TEST FAILED on ts-sim-scenario-ba : TestSelf Documentation ConfigFileEntriesPosix ( Last six runs Mar2021 Feb2021 )

---------- Differences in output ----------
52c52
< diff_program|{'default': 'tkdiff'}|External program to use for graphical file comparison
---
> diff_program|{'default': '/usr/bin/tkdiff'}|External program to use for graphical file comparison

TEST FAILED on ts-sim-scenario-ba : TestSelf FileViewers Console BadViewers ( Last six runs Mar2021 Feb2021 )

---------- Differences in output ----------
10c10
< ([Errno 2] No such file or directory: 'no_such_tool': 'no_such_tool')
---
> ([Errno 2] No such file or directory: 'no_such_tool')

3 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L0L
---
> I0
180c180
< L1L
---
> I1
183c183
< L1L
<truncated after showing first 30 lines>
QueueSystems NormalOperation Ec2Only RemoteSlave ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Ec2Only RemoteSlaveCheckout ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Ec2Only RemoteSlaveFilesFromOtherSlave ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems NormalOperation Ec2Only RemoteSlaveBatch ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L1L
---
> I1
38c38
< L0L
---
> I0
92c92
< L1L
---
> I1
95c95
< L1L
---
> I1
130c130
< L0L
---
> I0
133c133
< L1L
---
> I1
136c136
< L99L
---
> I99
152c152
< L500L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems NormalOperation Ec2Only RemoteSlaveRequiredData ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
40c40
< L0L
---
> I0
43c43
< L1L
---
> I1

TEST FAILED on ts-sim-scenario-ba : QueueSystems SlaveReuse Slave ReuseAddedApplication ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L0L
---
> I0
183c183
< L1L
---
> I1
186c186
< L1L
<truncated after showing first 30 lines>

2 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L0L
---
> I0
82c82
< L1L
---
> I1
QueueSystems ErrorHandling Console SlaveCrash ( Last six runs Mar2021 Feb2021 )
QueueSystems ErrorHandling Console SlaveCrash ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost BadMemoryResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
125c125
< L1L
---
> I1
128c128
< L0L
---
> I0
168c168
< L1L
---
> I1
171c171
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost NoPerfMachine ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
129c129
< L1L
---
> I1
132c132
< L0L
---
> I0
172c172
< L1L
---
> I1
175c175
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost NoPerfParallel ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
81c81
< L1L
---
> I1
84c84
< L0L
---
> I0
134c134
< L1L
---
> I1
137c137
< L0L
---
> I0
179c179
< L1L
---
> I1
182c182
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost NoPerfResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
130c130
< L1L
---
> I1
133c133
< L0L
---
> I0
173c173
< L1L
---
> I1
176c176
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost PerfMachine ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
130c130
< L1L
---
> I1
133c133
< L0L
---
> I0
174c174
< L1L
---
> I1
177c177
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost PerfParallel ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
81c81
< L1L
---
> I1
84c84
< L0L
---
> I0
138c138
< L1L
---
> I1
141c141
< L0L
---
> I0
184c184
< L1L
---
> I1
187c187
< L1L
<truncated after showing first 30 lines>

2 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
132c132
< L1L
---
> I1
135c135
< L0L
---
> I0
176c176
< L1L
---
> I1
179c179
< L1L
<truncated after showing first 30 lines>
QueueSystems Performance CheckExecHost PerfResource ( Last six runs Mar2021 Feb2021 )
QueueSystems Performance CheckExecHost ShortMachineNames ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance Miscellaneous MeasureCpuResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
86c86
< L1L
---
> I1
89c89
< L0L
---
> I0
136c136
< L1L
---
> I1
139c139
< L0L
---
> I0
180c180
< L1L
---
> I1
183c183
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance Miscellaneous ReportOtherJobs ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
134c134
< L1L
---
> I1
137c137
< L0L
---
> I0
178c178
< L1L
---
> I1
181c181
< L1L
<truncated after showing first 30 lines>

13 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L0L
---
> I0
167c167
< L1L
---
> I1
170c170
< L1L
<truncated after showing first 30 lines>
QueueSystems ErrorHandling Console SlaveEmptyDataFile ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Console JobIdOnSucceeded ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddApplication ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddApplicationSubDir ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddSuiteMultipleTests ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddTest ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddTestEnvRefDown ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave AddTestEnvRefUp ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave ReaddTest ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave ReuseAddedApplication ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave VirtualDisplay AddAppDifferentMode ( Last six runs Mar2021 Feb2021 )
TestSelf TestData Console AbsolutePathData ( Last six runs Mar2021 Feb2021 )
TestSelf TestData Console CopyEnvironmentPath ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems NormalOperation Console BatchSlave ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L1L
---
> I1
38c38
< L0L
---
> I0
78c78
< L1L
---
> I1
81c81
< L1L
---
> I1
120c120
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L99L
---
> I99
142c142
< L500L
<truncated after showing first 30 lines>

6 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L0L
---
> I0
166c166
< L1L
---
> I1
169c169
< L1L
<truncated after showing first 30 lines>
QueueSystems NormalOperation Console KeepInfoInRerun ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Console KeepInfoInSlave ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Console KeepScreenshotsInSlave ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Console SlaveLocalTmpDir ( Last six runs Mar2021 Feb2021 )
QueueSystems Performance CheckExecHost NoPerfMachine ( Last six runs Mar2021 Feb2021 )
TestSelf TestData Console ReferenceDataEnvironment ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems NormalOperation Console SlaveAutoRerun ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L1L
---
> I1
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L1L
---
> I1
121c121
< L0L
---
> I0
124c124
< L1L
---
> I1
127c127
< L99L
---
> I99
143c143
< L500L
<truncated after showing first 30 lines>

2 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
123c123
< L1L
---
> I1
126c126
< L1L
---
> I1
161c161
< L0L
---
> I0
164c164
< L1L
<truncated after showing first 30 lines>
QueueSystems NormalOperation Console SlaveReconnecJobId ( Last six runs Mar2021 Feb2021 )
QueueSystems NormalOperation Console SlaveReconnect ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems NormalOperation Console SlaveReconnectNoExtra ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
122c122
< L1L
---
> I1
125c125
< L1L
---
> I1

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost BadMemoryResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
124c124
< L1L
---
> I1
127c127
< L0L
---
> I0
167c167
< L1L
---
> I1
170c170
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost NoPerfParallel ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
81c81
< L1L
---
> I1
84c84
< L0L
---
> I0
158c158
< L1L
---
> I1
161c161
< L0L
---
> I0
203c203
< L1L
---
> I1
206c206
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost NoPerfResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
154c154
< L1L
---
> I1
157c157
< L0L
---
> I0
197c197
< L1L
---
> I1
200c200
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost PerfMachine ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
124c124
< L1L
---
> I1
127c127
< L0L
---
> I0
168c168
< L1L
---
> I1
171c171
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance CheckExecHost PerfParallel ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
81c81
< L1L
---
> I1
84c84
< L0L
---
> I0
160c160
< L1L
---
> I1
163c163
< L0L
---
> I0
206c206
< L1L
---
> I1
209c209
< L1L
<truncated after showing first 30 lines>

2 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
155c155
< L1L
---
> I1
158c158
< L0L
---
> I0
199c199
< L1L
---
> I1
202c202
< L1L
<truncated after showing first 30 lines>
QueueSystems Performance CheckExecHost PerfResource ( Last six runs Mar2021 Feb2021 )
QueueSystems Performance CheckExecHost ShortMachineNames ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance Miscellaneous MeasureCpuResource ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
110c110
< L1L
---
> I1
113c113
< L0L
---
> I0
159c159
< L1L
---
> I1
162c162
< L0L
---
> I0
203c203
< L1L
---
> I1
206c206
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems Performance Miscellaneous ReportOtherJobs ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
35c35
< L0L
---
> I0
38c38
< L0L
---
> I0
79c79
< L1L
---
> I1
82c82
< L0L
---
> I0
179c179
< L1L
---
> I1
182c182
< L0L
---
> I0
223c223
< L1L
---
> I1
226c226
< L1L
<truncated after showing first 30 lines>

TEST FAILED on ts-sim-scenario-ba : QueueSystems SlaveReuse Slave AddApplicationReconnect ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
40c40
< L1L
---
> I1
47c47
< L1L
---
> I1
71c71
< L500L
---
> I500
74c74
< L30L
---
> I30
81c81
< L99L
---
> I99
98c98
< L1L
---
> I1
103c103
< L1L
---
> I1
130c130
< L1L
<truncated after showing first 30 lines>

4 TESTS FAILED on ts-sim-scenario-ba :

---------- Differences in externalmocks ----------
36c36
< L0L
---
> I0
39c39
< L0L
---
> I0
80c80
< L1L
---
> I1
83c83
< L0L
---
> I0
124c124
< L1L
---
> I1
127c127
< L0L
---
> I0
168c168
< L1L
---
> I1
171c171
< L1L
<truncated after showing first 30 lines>
QueueSystems SlaveReuse Slave VirtualDisplay AddApplication ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave VirtualDisplay AddTest ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave VirtualDisplay AddTestSlowerThanTimeout ( Last six runs Mar2021 Feb2021 )
QueueSystems SlaveReuse Slave VirtualDisplay AddTestXvfbCrash ( Last six runs Mar2021 Feb2021 )

TEST FAILED on ts-sim-scenario-ba : TestSelf UITesting VirtualDisplay SlaveDisplay ( Last six runs Mar2021 Feb2021 )

---------- Differences in externalmocks ----------
36c36
< L0L
---
> I0
39c39
< L0L
---
> I0
80c80
< L1L
---
> I1
83c83
< L0L
---
> I0
124c124
< L1L
---
> I1
127c127
< L0L
---
> I0
167c167
< L1L
---
> I1
170c170
< L1L
<truncated after showing first 30 lines>