Archived issue #0023880

Integration of grid "ncl" into the new testing system

Open CASCADEOCCT:Testsclosed19 public notes

Search issues

Description

Test grid is located in /dn45/occttests/tests/ED/ncl
It's impossible to get output from following commands:
QANColPerfArray1
QANColPerfArray2
QANColPerfDataMap
QANColPerfDoubleMap
QANColPerfIndexedDataMap
QANColPerfIndexedMap
QANColPerfList
QANColPerfQueue
QANColPerfSList
QANColPerfSequence
QANColPerfSet
QANColPerfStack

Steps to reproduce

DRAW commands QANColPerf* should output results to DRAW interptretor and not cout

Public activity

19 archived notes

Participants are labeled by their role within this record.

01Commenter 1
Log messages has forwarded to the draw interpreter, ncl-tests has implemented.
02Commenter 2
Branch [archived branch] has been created by Participant.

[revision removed]


Detailed log of new commits:

Author: abv
Date: Sun Nov 16 18:52:05 2014 +0300

    0023880: Integration of grid "ncl" into the new testing system
    
    Function perf_sprint_all_meters added in OSD_PerfMeter.h to allow printing to string buffer rather than stdout. Macro PERF_PRINT_ALL converted to functional form.
    
    Command dperf added in DRAW to print and conditionally reset all meters.
    Description of these tools is added in Debug Hints.
03Commenter 3
I have pushed fix that extends OSD_PerfMeter with possibility to get results to string, and QANColPerf* commands to output to DRAW, to branch CR23880_3.

The tests are also available, however I do not integrate them since they use fixed numbers for expected CPU values and thus are bound to particular hardware. I deem it would be more correct to compare performance of OCCT classes against equivalent STL classes, see command QANTestNCollectionPerformance. The parameter to be controlled would be ratio of performance and it can be expected to less depend on hardware.
04Commenter 2
Branch [archived branch] has been updated by Author.

[revision removed]


Detailed log of new commits:

Author: Author
Date: Thu Dec 11 18:55:32 2014 +0300

    Modified output of command QANTestNCollectionPerformance.
    Added test case perf/ncollection/A1

05Author
Test case which control ratio of performance between OCCT classes against equivalent STL classes was created.
perf ncollection A1 - OK

Please, review.

06Commenter 6
Reviewed, please test
07Commenter 2
Branch [archived branch] has been updated forcibly by Participant.

[revision removed]
08Commenter 8
Branch [archived branch] has been rebased on the current master
09Commenter 9
Dear Commenter 1,

Branch CR23880_3 from occt git-repository (and master from products git-repository) was compiled on Linux, MacOS and Windows platforms and tested.
[revision removed]

Number of compiler warnings:
occt component:
   Linux: 18 (18 on master)
   Windows: 0 (0 on master)
products component :
   Linux: 11 (11 on master)
   Windows: 1 (1 on master)

Regressions/Differences:
Not detected

Testing cases:
perf ncollection(019) - KO
http://occt-tests/CR23880-3-master-occt/Debian60-64/perf/ncollection/A1.html
http://occt-tests/CR23880-3-master-occt/Windows-32-VC10/perf/ncollection/A1.html

Testing on Linux:
Total MEMORY difference: 368549776 / 367862128
Total CPU difference: 48086.36000000021 / 51444.81000000015

Testing on Windows:
Total MEMORY difference: 277481312 / 277277864
Total CPU difference: 35566.0625 / 37472.0935757
10Commenter 2
Branch [archived branch] has been updated forcibly by Author.

[revision removed]
11Author
Ratio of performance was corrected according to test case behavior on virtual machines.
Please, review.

12Commenter 12
No remarks, please test (I suppose that executing updated test perf ncollection A1 on previously built branch should be sufficient)
13Commenter 2
Branch [archived branch] has been updated forcibly by Participant.

[revision removed]
14Commenter 14
Branch [archived branch] has been rebased on the current master
15Commenter 2
Branch [archived branch] has been updated by Participant.

[revision removed]


Detailed log of new commits:

Author: apv
Date: Mon Jan 26 15:56:25 2015 +0300

    Small correction of test-case for Windows platform

16Commenter 16
Dear Commenter 1,

Branch CR23880_3 from occt git-repository (and master from products git-repository) was compiled on Linux, MacOS and Windows platforms and tested.
[revision removed]

Number of compiler warnings:
occt component:
   Linux: 18 (18 on master)
   Windows: 0 (0 on master)
products component :
   Linux: 11 (11 on master)
   Windows: 1 (1 on master)

Regressions/Differences:
Not detected

Testing cases:
perf ncollection(019) - OK
http://occt-tests/CR23880-3-master-occt/Debian60-64/perf/ncollection/A1.html
http://occt-tests/CR23880-3-master-occt/Windows-32-VC10/perf/ncollection/A1.html

Testing on Linux:
Total MEMORY difference: 369852620 / 370114884
Total CPU difference: 53009.8300000001 / 51750.710000000094

Testing on Windows:
Total MEMORY difference: 276067036 / 275769192
Total CPU difference: 45813.3125 / 38148.296875
17Commenter 2
Branch [archived branch] has been deleted by Participant.

[revision removed]
18Commenter 2
Branch [archived branch] has been deleted by Participant.

[revision removed]
19Commenter 2
Branch [archived branch] has been deleted by Participant.

[revision removed]

Related records