Overview of test results

This topic contains information about various tabs and panels, and on viewing test results.

Local results

In TestArchitect Client, local test results, which are not stored in the repository, only consist of the Summary tab.

The Summary tab reports basic test run information, which summarizes various aspects of the test. Additionally, local test results show the following tabs when they are viewed in a web browser.

Table 1. Local test results

Tab name	Description
Result Details	Displays a detailed (line-by-line) log of the test execution, which can be essential for test run analysis and debugging.
Known Bug Summary	Displays details about known bugs marked on action lines.
Failure/Error Summary	Exhibits a list of the failures occurring during the test run.
Log Information	Displays the logging information from the report actions, that is, report, report check, report warning, and report error in the test procedure.

Repository results

Repository test results are saved in the repository and have the same tabs as the local test results, but include an additional Information tab.

A non-serial test result is a typical test result generated when TestArchitect executes only a single test module via the Execute Test dialog box (or by pressing F9). A non-serial test result does not contain execution information from other test modules.

Serial results

A serial result is generated after a serial test run, which is implemented when you drag several test modules into the Execute Test dialog box, or apply the Execute Test command to a test folder. Unlike non-serial test results, serial test results contain execution information from multiple test modules. The main Summary tab of the serial result shows the test module summaries and hyperlinks to test result summaries on web browser for each of the executed test modules.

Test suite results

A test suite is a container for sets of test modules. Therefore, a test suite result is as same as a serial result containing execution information from multiple test modules. The main Summary tab of the test suite result shows the test module summaries and hyperlinks to test result summaries for each of the executed test modules.

Subresult

This category of result is generated when TestArchitect executes subtest modules from one master test module via calls to the run test built-in action.

Generally, this result is similar to the non-serial test results, with the exception that they contain extra information about the executed subtest modules.

Summary tab
The test result Summary tab reports basic test run information which summarizes various aspects of the test. A summary report represents the results of a single run of one test module.

Result Details tab
The Result Details tab displays a detailed (line-by-line) log of the test execution, which can be essential for test run analysis and debugging.

Known Bug Summary tab
Reviewing test results can assist you in determining if and when JIRA bug issues on a JIRA server should be closed.

Failure/Error Summary tab
This section displays all failure, error, or warning encountered during the test run.

Log Information tab

Information tab
The test result Information tab displays general information about the test, including the date, time and duration of the test run, the type of machine or device running the test, the AUT version, etc. The numbers of test cases flagged as Passed, Failed, Warning, Error, and Ignored Fails are also displayed.

Test result status
The topic of this section contains information about detailed test result status.