SilkTest Workbench: Enhance Results Configuration Options
When executing Visual Tests or .Net scripts in the Workbench; the following general options are available for configuring how Results are generated:
Save results with a new run number.
Append Results to current run number.
Overwrite existing run number with new Results.
Do not save this Result.
As our Visual Tests are executed every night, we do not really need to save every single result; but they are obviously useful for debugging purposes, in the event that a test does fail.
It would therefore be useful if some additional options were available; that allowed user to specify the number of Result Assets that can be saved in the Database, and if specific settings could be configured for both Passed and Failed tests.
For example - if the Visual Test returns a Result of 'Passed' apply the setting 'Overwrite existing run number with new Results'; and if it Fails then 'Save the Results with a new run number'.
This also make senses from a maintenance perspective; as it would help prevent Results assets consuming so much space in the Database.
Anonymous
shared this idea
1 comment
-
Anonymous
commented
Just to clarify; it would be useful to have the option to define how many passed or failed results assets to keep for all scripts. For example: Save "x" number of results. This would allow us to specify whatever number of maximum results to keep without having to use the purge tool to maintain the records. Rather than running the purge on a regular schedule to all but last 3 Results; it would be nice if we could configure the system to save no more than 3 failed results. This would allow the system to self maintain the number of results files.
Setting this on a per-script level would be more overhead and maintenance; so we just want to be able to define something like the following:
Passed: Overwrite existing run number with new Results.
Failed: Save maximum of "X" results with a new run number.