Archived issue #0023210
Tcl-only procedures for running tests
Description
This issue is for integration of Tcl-only procedures for OCCT automatic testing system.
The procedures prepared initially in context of #23087 are partially based on Perl and TAP, though do not really take any serious advantage of these tools. The drawbacks are serious: the need to have one more tool (Perl) properly configured is a problem for configuration, and convenience of these tools for developers is low due to poor reporting.
The new tools are based on Tcl, thus do not require Perl at all, and work directly in DRAW environment. They provide more clear output for developers, and should be easier to modify and maintain (especially for people not knowing Perl).
The additional features implemented in the first version are:
- generation of reports during the test run
- possibility to run tests in parallel (on one workstation)
- explicit treatment of tests skipped due to missed data file
- improved parsing rules, including possibility to ignore errors
- explicit treatment of improvements (absence of expected error)
- output of summary of regressions and improvements
The procedures prepared initially in context of #23087 are partially based on Perl and TAP, though do not really take any serious advantage of these tools. The drawbacks are serious: the need to have one more tool (Perl) properly configured is a problem for configuration, and convenience of these tools for developers is low due to poor reporting.
The new tools are based on Tcl, thus do not require Perl at all, and work directly in DRAW environment. They provide more clear output for developers, and should be easier to modify and maintain (especially for people not knowing Perl).
The additional features implemented in the first version are:
- generation of reports during the test run
- possibility to run tests in parallel (on one workstation)
- explicit treatment of tests skipped due to missed data file
- improved parsing rules, including possibility to ignore errors
- explicit treatment of improvements (absence of expected error)
- output of summary of regressions and improvements
Public activity
3 archived notes
Participants are labeled by their role within this record.
Please review the version proposed for integration in branch CR23210
It was integrated to master from CR23087_CR23210_master.
Integrated into occt repository with 0023087