Open System Testing Architecture

TOC PREV NEXT INDEX



Creating and Editing Profiles
· Profiles Overview
· Profile Creation
· SNMP Profiles
· NT Performance Monitor Profiles
· General Profile Procedures

Profiles Overview

A Profile is a collection of queries which determine the data collection carried out during test execution. Create, then incorporate them into your tests to enhance the results produced, by targeting specific devices within the web application environment under test with precise data collection queries.

Profiles give you the flexibility to collect a wide range of performance data during a test run. A Profile can contain a single data collection query and be used to target a single computer. Or alternatively, you can include multiple queries and apply one or more Profiles to target all host computers and devices that comprise the web site under test.

Incorporating Profiles into a test also improves the monitoring options available during test execution. The progress of the data collection defined by a Profile can be monitored, with results data from the target host computers and other devices displayed in graphs according to the queries you select. The data can be displayed in graph format after the test run is complete. Data collected by Profiles can also be exported to spreadsheet or database programs for further analysis and printing.

Profiles are stored in the Repository and can be used by reference in multiple tests. The same Profile can be used as many times as necessary within the same test to collect the identical category of data from different host computers.

After you have setup Profiles and recorded scripts, create a new test then develop it's structure by adding the Profiles and scripts you need. Execute the test to run the Profile and generate the results you need.

Profile Creation

Profile creation is a process that can be carried out independently of test generation. Work from the Repository Window using the functionality attached to the default Profiles folder, or use the Profiles Menu Bar option, to select the type of Profile you want to create. Launch either SNMP or NT Performance Monitor and specifying the type of data to be collected and which computers or other web application environment components to monitor.

All Profiles you create are stored in the Repository and can be used by reference in multiple tests. HTTP/S Load supports two Profile creation modules in this installation of OpenSTA, they are NT Performance Monitor and SNMP. Use NT Performance Monitor to create Profiles and monitor computers running Windows operating systems. Use SNMP Profiles to target any machine capable of running an SNMP management process. This includes all computers, regardless of the operating system installed, and other devices which may form a part of a web site under test.

Creating Profiles using these modules has many similarities. When you begin the creation process you are presented with a table format display in the Main Window which organizes the Profile configuration options into columns and the data collection queries, or tasks, in separate rows. A single row is displayed by default but you can add additional rows to incorporate other queries by clicking ,in the toolbar. Define the settings of your data collection query by clicking on the appropriate cells and function buttons. You have the options to add a task description, select the query type, select the target machine and specify the interval in seconds between data recording. You can also select to record the raw value of the data, or the Delta Value which records change between the data collected at each interval. SNMP Profiles have an additional column named SNMP Server where you can select the target device. These two Profile types also differ in the nature of queries they support.

Profiles must be defined according to the rules for OpenSTA Datanames and are stored in the same default location within the program file directory structure, for example:

C:\Program Files\OpenSTA\Repository\
Profiles\Profile-Name.NTP or Profile-Name.SMP

NT Performance Monitor Profiles are saved as .NTP files, SNMP Profiles are saved as .SMP files.

SNMP Profiles

The SNMP module is used to produce system monitoring Profiles to collect system performance data during a test run.

Simple Network Management Protocol is the Internet standard protocol developed to manage nodes on an IP network, but SNMP is not limited to TCP/IP. It can be used to manage and monitor all sorts of equipment including computers, routers, wiring hubs, printers; that is, any machine capable of running an SNMP management process, known as an SNMP agent. All computers and many peripheral devices meet this requirement, which means you can create and apply SNMP Profiles in a test to collect data from most components within the a web site under test. This enables you to comprehensively assess the efficiency of a web application environment taking into account the impact of all components on the overall performance the web site.

The settings you specify in a Profile apply to all the tests that use them since Profiles are applied by reference.

Related Topics:
· Create a New SNMP Profile
· General Profile Procedures
· Delete a Profile
Create a New SNMP Profile
1 In Commander, select File > New Profile > SNMP.
The Profile appears in the Repository Window with a small crossed red circle over the Profile icon , indicating that the file has no content. As soon as you open the Profile and specify a query in the Active Profile Window, the icon changes to reflect this and appears .
2 Give your Profile a name within the Repository Window and press Return.
Note: This procedure can be carried out no matter what files you have open in the Main Window
3 Double-click the Profile , within the Repository Window to open it in the Main Window, which presents you with a single row table format display.
4 Click on the table cell in the Description column and enter a name for the data collection query.
Note: When you run a test the descriptions you give to Profile queries are listed in the Available Views text box, displayed in the Monitoring tab of the Active Test Pane. You can select query descriptions to monitor the progress of the test during execution.
5 Click , in the toolbar, then click Scan to initiate the SNMP Server Scan. Note: The Start IP and End IP text boxes in the SNMP Server Scan dialog box can be edited if necessary to increase the range of the scan.
The SNMP Server Scan locates all the devices on the network currently running SNMP and populates the SNMP Server column with their IP addresses from where you can select a target device.
6 Click on the table cell in the SNMP Server column then click , to display a list of networked devices and select a device from this list. Or enter the name of the device you want to monitor.
7 Click , in the table cell in the Query column.
Note: The Select Query dialog box only appears after you have chosen a target device for your query in the SNMP Server column.
8 In the Select Query dialog box, click to the right of the Category text box and select a category from the drop down list, for example system.
9 Select a query associated with the category you have selected.
Note: The query must have an integer as it's Current Value.
10 Click on the table cell in the Interval column and enter a time period (in seconds) to control the frequency of data collection, or use , to set a value.
11 Leave the Delta Value column check box unchecked to record the raw data value; or check the box to record the Delta value, which records change between the data collected at each interval.
12 Each row within the Active Profile Pane defines a single data collection query. Click , in the toolbar to add a new row and add an additional query to the Profile. Select a row then click , in the toolbar to delete it.
13 The Profile is automatically saved in the Repository when you switch to a different task

NT Performance Monitor Profiles

The NT Performance Monitor module is used to produce system monitoring Profiles to collect system performance data from computers running Windows during the execution of a test.

NT Performance Monitor is a graphical tool for measuring the performance of your computer or other computers on a network. You can view the behavior of objects, such as processors, memory, cache, threads, and processes on the computers you specify in the Profile. Each of these objects has an associated set of counters that provide information about device usage, queue lengths, delays, and information used to measure throughput and internal congestion.

If the web server under test is Microsoft IIS then you can select the web service counter to monitor the web server.

NT Performance Monitor provides graphs that can be displayed to monitor the execution of a test as well as displaying test results. You can select a test and open these graphs to analyze your test results.

Create a New NT Performance Monitor Profile
1 In Commander, select File > New Profile > NT Performance.
The Profile appears in the Repository Window with a small crossed red circle over the Profile icon , indicating that the file has no content. As soon as you open the Profile and specify a query in the Active Profile Window, the icon changes to reflect this and appears .
2 Give your Profile a name within the Repository Window and press Return.
Note: This procedure can be carried out no matter what files you have open in the Main Window
3 Double-click the Profile , within the Repository Window to open it in the Main Window, which presents you with a single row table format display.
4 Click on the table cell in the Description column and enter a name for the data collection query.
Note: When you run a test the descriptions you give to Profile queries are listed in the Available Views text box, displayed in the Monitoring tab of the Active Test Pane. You can select query descriptions to monitor the progress of the test during execution.
5 Click , on the right of the table cell in the Query column.
6 In the Browse Performance Counters dialog box, choose the computer you want to monitor. You can select to either:
· Use local computer counters; which will collect data from the computer you are currently using.
· Or Select counters from computer; which allows you to specify a networked computer. Type \\ then the name of the computer, or click and select a computer from the list.
7 Select the Performance object you want to monitor by clicking and selecting an object from the drop down list.
Note: Click Explain to launch a dialog box which displays an brief overview of the options you select to assist in your choice.
8 Select a Performance counter in the associated with the performance object.
9 Select an instance of the performance object you have chosen.
Note: Not all performance objects have instances associated with them.
10 Click on the table cell in the Interval column and enter a time period (in seconds) to control the frequency of data collection, or use , to set a value.
11 Leave the Delta Value column check box unchecked to record the raw data value; or check the box to record the Delta value, which records change between the data collected at each interval.
12 Each row within the Active Profile Pane defines a single data collection query. Click , in the toolbar to add a new row and add an additional query to the Profile. Select a row then click , in the toolbar to delete it.
13 The Profile is automatically saved in the Repository when you switch to a different task.

General Profile Procedures

The following procedures apply to NT Performance Monitor and SNMP Profiles:

· Edit a Profile
· Rename a Profile
· Delete a Profile
Edit a Profile
1 In Commander, double-click Profiles , in the Repository Window to expand the directory.
2 Double-click the Profile you want to edit.
Note: Queries you have previously defined in the Profile are automatically highlighted when you open a Profile and click , on the right of the table cell in the Query column.
3 Make your changes in the Active Profiles Pane.
Click , in the toolbar to add a new row and add an additional query to the Profile. Select a row then click , in the toolbar to delete it.
Note: Your changes are automatically saved in the Repository.
Rename a Profile
1 In Commander, double-click Profiles , in the Repository Window to expand the directory.
2 Right-click the Profile and select Rename, or double-click slowly on the Profile.
3 Enter the new name and press Return.
Note: Your changes are automatically saved in the Repository.
Delete a Profile
1 In Commander, double-click Profiles , in the Repository Window to expand the directory.
2 Right-click on the Profile and select Delete from the menu.
Or click on the Profile you want to remove and press Delete.
3 Click Yes to confirm the deletion.


CYRANO
Customer Support: France +33 (0) 1 56 33 40 00
USA +1 (978) 462-0737
UK +44 (0) 1274 761024
support-fr@cyrano.com
support-us@cyrano.com
support-uk@cyrano.com
TOC PREV NEXT INDEX