Open System Testing Architecture

TOC PREV NEXT INDEX



Results Display
· Test Results Display Overview
· Results Display Pane
· Audit Results Display Option
· Report Results Display Option
· History Results Display Option
· HTTP Data List Results Display Option
· Statistics Display Option Graphs

Test Results Display Overview

Executing a test and analyzing the results enables you to identify whether a web site is able to meet the processing demands you anticipate will be placed on it. HTTP/S Load provides a variety of data collection and display options to assist you in the analysis of test results. When a test is run a wide range of data is generated automatically. Virtual user response times and resource utilization information is recorded from all web sites under test, along with performance data from the host computers used to run the test. After a test run is complete the results can be displayed to assist you in the analysis of a web sites' performance and the network over which the test was run. Open the test you want from the Repository Window and click on the Results tab in the Active Test Pane, then select the results you want to display.

Most available results record server statistics including timer information and CPU usage data. Other results include the Test Audit log file which records significant events that occur and the HTTP Data List, which gives details of the HTTP/S requests issued during a test run, including the response times and codes for every request. In addition there are the Custom NT Performance and the Custom SNMP results, which record the data collection queries of the Profiles you may have included ina test.

The range of results produced also depends on the design of your test and the content of your scripts. For example History and Report files are only produced if the scripts included in a test have been modeled to incorporate the appropriate SCL commands which generate the data content for these files.

Use Commander to control exactly which results are displayed and how they are presented. You can choose from a wide range of useful customizable graphs to display the results you need. There is also the facility to export graphs in spreadsheet format, to assist in the production of reports and aid further analysis.

Results Display Pane

Display the graphs you want using the Results Pane. The Results Pane presents you with a list of test runs and results associated with the test run you select. The graphs available will vary according to the content of the test results collected.

After a test run is complete test results are stored in the Repository in time-stamped folders, along with the tests that were executed to generate them. Work from the Repository Window and the Active Test Pane to select the test and the results you want to display.

Open the test you want from the Repository Window and click on the Results tab Results, in the Active Test Pane to view the results. When you select a test run the available results are listed. Select a category a results entry from the list to display the results data.

Some graphs give the you option to filter the URL's displayed. Click the Filter button when it is active, or right-click and select Filter URL's, to control the information displayed. You can also opt to and to customize the display and to export data to spreadsheet format. Right-click and select to either Filter URL's, Customize or Export to Excel.

Statistics Results Display Option

When you have displayed the graphs you need you can customize them to improve the presentation. Right-click within a graph and select Customize and make your changes. The options include changing the graph style from the default line plot to a vertical bar, as well as controlling the color of the graph contents. You can also zoom in on a graph by clicking-and dragging over the area of the graph you want to study.

Some graph can be modified after they have been displayed by filtering the URL data they contain. Right-click within the graph, select Filter URLs and make your choices. Also available in the right-click menu is the option to export the test result data in spreadsheet format.

Related Topics
· Display Test Results
· Filter HTTP Data List Results
· Customize Test Results
· Export Test Results
· Delete Test Results
Display Test Results
1 In the Repository Window, double-click Tests to expand the directory structure.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click the Results tab.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select the data you want from the list.
Note: Some graphs give the you option to control the information displayed and export data to spreadsheet format. Right-click and select either Filter URL's, Customize or Export to Excel.
Customize Test Results
1 In the Repository Window, double-click Tests to expand the directory structure.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click the Results tab.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select the data you want from the list.
6 Right-click inside the graph table and select Customize.
7 Select the Graph Type you need, either:
· Line plot
· Vertical bars
· Area under points where the area beneath the line plot is a solid color.
Choose the display colors for the all the graph elements including the font and colors of the title display and whether to show or hide the title.
8 Click OK to apply your choices.
Export Test Results
1 In the Repository Window, double-click Tests to expand the directory structure.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click the Results tab.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select the data you want from the list.
6 Right-click inside the graph or table and select Export to Excel, or Export if you are in exporting HTTP Data List information.
Excel is automatically launched converting the test results into Microsoft Excel Workbook format and displayed in a graph.
Save and edit your results as required.
7 Or if you are exporting HTTP Data List table information, give your new file a name and save it as a .CSV file in the location of your choice.
Delete Test Results
1 From the Results tab, open a graph.
2 Click , in the toolbar and select the sets of results you want to delete from the Delete Test Runs dialog box.
Note: The test runs are time-stamped to help identify them.
3 Click Delete to delete the results from the Repository.

Audit Results Display Option

The Audit file contains a log of significant events that have occurred during a test run. Including the times and details of test initiation and completion, errors that may have occurred and virtual user details.

If you run a test using several networked computers, each host computer that is used to perform the distributed parts of the test writes a local audit file on the computer it is running on.

Display Audit Data
1 In the Repository Window, double-click Tests.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click Results.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select Test Audit log from the list.
Audit information is displayed in the Results tab in table format:

Report Results Display Option

The Report file is a sequential text file that is used to record information about a single test run. Usually, a single record is written to the report file whenever a test case passes or fails.

In addition, further Record log entries may be written to the file if the scripts included in the test have been modeled to incorporate the appropriate SCL code. Use the ~REPORT SCL command and associated clauses in a script, to generate the data content for the Test Report log. For more information on SCL refer to the SCL Reference Guide; an on-line copy is available within the Script Modeler, Help menu.

Display Report Data
1 In the Repository Window, double-click Tests.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click Results.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
5 Note: The test runs are time-stamped to help identify them.
6 Click , on the right-hand side of the Available Results text box and select Test Report log from the list.
Report information is displayed in the Results tab in table format:

History Results Display Option

The History file is a sequential text file that is used to maintain a chronological history of each occasion on which the test was run, together with the results of that test. Usually, a single record is written to the history file when the test completes.

In addition, further Test History log entries may be written to the file if the scripts included in the test have been modeled to incorporate the appropriate SCL code. Use the ~HISTORY SCL command and associated clauses in a script, to generate the data content for the Test History log. For more information on SCL refer to the SCL Reference Guide; an on-line copy is available within the Script Modeler, Help menu.

Display History Data
1 In the Repository Window, double-click Tests.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click Results.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select Test History log from the list.
History information is displayed in the Results tab in table format.

HTTP Data List Results Display Option

The HTTP Data List file gives details of the HTTP requests issued by the script(s) during a test run. The information stored includes the response times and codes for the HTTP request issued during a test. However, the quality of the HTTP data recorded depends on the level of Server Statistics you specified when you created the test and defined the properties to be applied. The Server Statistics setting controls the number of virtual users that the statistics are gathered for and can be edited in the Test Definition section.

The information collected is presented in a table and can be sorted by clicking on the column headings to reverse the display order of the data entries. These results can also be filtered to show only the entries you want by clicking inside the table and selecting the Filter option.

HTTP Data List can be exported to a .CSV text file which allows them to be imported into many other data analysis and report generating tools.

Display the HTTP Data List
1 In the Repository Window, double-click Tests.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click Results.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select HTTP Data List from the list.
HTTP Data List information is displayed in table format:
6 Click the Filter button when it is active to control the results displayed. See Filter HTTP Data List Results.
7 Right click within the table and select Export to convert the data into .CSV text file for use in other packages. See Export Test Results.
Filter HTTP Data List Results
1 In the Repository Window, double-click Tests to expand the directory structure.
2 Double-click the test whose results you want to display.
3 In the Active Test Pane click the Results tab.
4 Click , on the right-hand side of the Test Runs text box and select a set of results from the list.
Note: The test runs are time-stamped to help identify them.
5 Click , on the right-hand side of the Available Results text box and select a set of results from the list.
Note: Only results containing HTTP statistics can be filtered.
6 Click the Filter button or right-click inside the graph table and select Filter.
The Filter dialog box offers a variety of selection criteria as illustrated:

7 The filter criteria available correspond to the column categories in the HTTP Data List table. Select your the settings from the filter options:
· Time: Date and time HTTP GETs and POSTs were issued.
· Response Time: Web site response time to GETs.
· Response Code: Code issued by web site in response to GETs.
· Reply Size: Size of data response to GETs issued by web site.
· URLs: Filter by URL.
· User ID: Filter by virtual user(s) identity (IP address).
8 Select the filter options you want then click OK to apply them.
Note: Click the Defaults button to apply the original filter settings, which reflect the full range of data measurements of the HTTP Data List listed.

Statistics Display Option Graphs

The Statistics option provides you with a number of graphs where you can view and scrutinize your test results. There are thirteen graphs in total but all of them may not be associated with every set of results you produce. The graphs applicable to the set of results you select are automatically listed in the Graphs and Test Runs dialog box.

The volume of statistics recorded is controlled by the logging level you set for the task group's virtual users. The logging level determines the number of virtual users that statistics are saved for and therefore the quality of the data displayed in the graphs you view.

HTTP Active User v Elapsed Time graph

Note: Graphs are displayed in a line plot style as illustrated above by default. Right-click within a graph and select Customize from menu to change the appearance of your graphs.

HTTP Errors v Active Users graph

Note: This graph has been customized to display the data points as vertical bars. Right-click within a graph and select Customize > Vertical bars from menu to change the appearance of your graphs.

HTTP Errors v Elapsed Time graph

Note: This graph has been customized to display the area under the data points as a solid. Right-click within a graph and select Customize > Area under points from menu to change the appearance of your graphs.

HTTP Monitored Bytes per Second v Elapsed Time graph

HTTP Responses v Elapsed Time graph

HTTP Response Time (Average per Second) v Number of Responses graph

HTTP Responses v Elapsed Time graph

Timer List graph

Timer Values v Active Users graph

Timer Values v Elapsed Time graph
Custom NT Performance graph:

Custom SNMP graph


CYRANO
Customer Support: France +33 (0) 1 56 33 40 00
USA +1 (978) 462-0737
UK +44 (0) 1274 761024
support-fr@cyrano.com
support-us@cyrano.com
support-uk@cyrano.com
TOC PREV NEXT INDEX