it's required to save log information of test command in (specified) file

Other improvements that would be instrumental are:

- get list of log messages treated as indication of failure (for easy identification and building todo list)

- allow giving a list and / or glob pattern in name of test group / grid / case in arguments of testgrid, for instance:

Draw[]> testgrid bugs modalg* {A1 A2}

would execute all grids starting with 'modalg' in bugs group, only test cases A1 and A2

One more point: output information on count of found test cases before tests start, in order to provide some visible feedback even if tests are heavy and it takes long time to get first results of test cases.

Something like:
Draw[]> testgrid
Running tests (total 15432 test cases found)...

One more point: in parallel execution, add possibility to randomize order of test cases before adding to queue, in order to balance load and reduce chances for the tests contention for resources (which is generally higher between tests in the same group). Naturally this randomization should be stable, i.e. the randomized order should be the same for the same set of tests (on the same platform).

Next point: for MEMORY message output at the end of the test, use meminfo -h instead of -w, as (hopefully) more precise

One more idea: add option (e.g. -beep) to issue a sound signal at the end of the test (can be as simple as "puts \7\7\7\7" or more complicated, up to using human-pronounced "Your test has completed" :-)

In the log produced by testdiff command, currently differences in images are titled by last name of the log directory. This is meaningless if logs are saved in directories with same names but different paths (as we have in Jenkins environment). It would be better to denote paths to two two compared versions as A and B, and then use "A" and "B" as titles over the images.

Branch [archived branch] has been created by Participant.

[revision removed]


Detailed log of new commits:

Author: ski
Date: Thu Jan 15 17:21:22 2015 +0300

    Titles of differences in images produced by testdiff command were changed.

Author: ski
Date: Thu Jan 15 15:48:00 2015 +0300

    Used meminfo -h to control memory

Author: ski
Date: Thu Jan 15 15:34:07 2015 +0300

    Sound signal at the end of the test

Author: ski
Date: Thu Jan 15 15:01:31 2015 +0300

    Print information on count of found test cases before tests start

Author: ski
Date: Thu Jan 15 14:10:26 2015 +0300

    0023992: it's required to save log information of test command in (specified) file
    
    It is possible now to save log information of test command in specified file.

1) It is possible now to save log information in specific text(a) or html(b) file with snapshot.
    a) test bugs vis buc60574 -outfile D:/results
    b) test bugs vis buc60574 -outfile D:/results.html
Snapshot will be created with the same name as a log file (D:/results.png)
Option"-overwrite" should be used for forcibly writing log in existing file.
If "-echo" option is enabled, "-outfile" and "-overwrite" will be ignored.

2) Number of test cases is shown:
Draw[1]> testgrid checkgroup
Running tests (total 28 test cases)...

3) You can use option "-beep" to issue a sound signal at the end of the tests
Can be used with both "test" and "testgrid" commands.
It seems that number of signals could not be changed on Windows 8.

4) "meminfo -h" command is used to control memory in the end of tests

5) Title of log produced by command testdiff was changed (see attached "Attachment 1 (PNG)" file). Also, tooltips for snapshots titles were created.

Note that - "allow giving a list and / or glob pattern in name of test group
             / grid / case in arguments of testgrid, for instance:
             Draw[]> testgrid bugs modalg* {A1 A2}
             would execute all grids starting with 'modalg' in bugs group,
             only test cases A1 and A2"
functionality were already integrated, for example you can run tests with such command:
    testgrid bugs modalg* A\[12\]
and the result will be the same as it was described.
  
Getting list of log messages treated as indication of failure (for easy identification and building todo list) is done in branch #0023971.

Randomization of tests order is not done for the moment.

Please, review.

Branch [archived branch] has been updated by Participant.

[revision removed]


Detailed log of new commits:

Author: ski
Date: Fri Jan 16 16:22:44 2015 +0300

    0023971: Possibility to extract all error messages from test log
    
    It is possible now to extract all error messages from test log using key "-errors"
    
    Conflicts:
        src/DrawResources/TestCommands.tcl

Changes from branch #0023971 were merged with this branch CR23992.

Please, review.

No remarks, please test

Branch [archived branch] has been updated forcibly by Participant.

[revision removed]

Branch [archived branch] has been rebased on the current master

Dear Commenter 1,

Branch CR23992 from occt git-repository (and master from products git-repository) was compiled on Linux, MacOS and Windows platforms and tested.
[revision removed]

Number of compiler warnings:
occt component:
   Linux: 18 (18 on master)
   Windows: 0 (0 on master)
products component :
   Linux: 11 (11 on master)
   Windows: 1 (1 on master)

Regressions/Differences:
Not detected

Testing cases:
Not needed

Testing on Linux:
Total MEMORY difference: 89807551 / 369695228
Total CPU difference: 51506.74999999993 / 49863.81000000002

Testing on Windows:
Total MEMORY difference: 42825701 / 276276616
Total CPU difference: 37331.1875 / 36894.0

Branch [archived branch] has been deleted by Participant.

[revision removed]