Results Display

Related Topics

· Display Test Results

· Filter HTTP Data List Results

· Customize HTTP Data Graphs Display

· Zoom In and Out of a Graph

· Export Test Results

· Close Results Display Options

· Delete Test Results

HTTP/S Load provides a variety of data collection and display options to assist you in the analysis of Test results. Running a Test and displaying the results enables you to identify whether the web application environments under test are able to meet the processing demands you anticipate will be placed on them. After a Test-run is complete the results can be displayed using Commander to help you analyze the performance of target web applications and the network over which the Test was run. Open the Test you want from the Repository Window and click on the Results tab in the Active Test Pane, then choose the results you want to display from the selection boxes. Use Commander to control which results are displayed and how they are presented. Depending on the category of results you select, data can be displayed in graph or table format and exported as a spreadsheet or printed. You can choose from a wide range of customizable graphs to display the results you need and view multiple graphs and tables simultaneously to compare results.

When a Test is run a wide range of results data is collected automatically. Virtual User response times and resource utilization information is recorded from all web sites under test, along with performance data from web application components and the Hosts used to run the Test. Results categories include the Test Summary option which presents a brief description of the Test and the Task Groups settings that applied during a Test-run. The Test Audit log records significant events that occur during a Test-run and the HTTP Data List records the HTTP/S requests issued, including the response times and codes for every request. The Timer List option records the length of time taken to load each web page defined in the Scripts referenced by a Test.

Creating and referencing Profiles in a Test helps to improve the quality and extend the range of the results data produced during a Test-run. Profiles give you the ability to target the Host computers and devices used to run a Test and the back-end database components of web applications under test, with user-defined data collection queries. Use Sybase Monitor Profiles to query the Sybase server components of web applications. Use NT Performance and SNMP Profiles to collect data from Host devices within target web applications or the test network.

The range of results produced during a Test-run can depend on the content of the Scripts that are referenced by a Test. For example Report and History logs are only produced if the Scripts included have been modeled to incorporate the SCL commands used to generate the data content for these logs.

Results Tab

After a Test-run is complete, the results are stored in the Repository in date and time stamped folders. Work from the Repository Window to open the Test you want in the Active Test Pane, then click on the Results tab to access the results data.

The Results tab contains two selection boxes from where you can pick the results you want to display. When you choose a set of results in the Test-run selection box, the display options associated with it are listed in the Available Results selection box. Choose a category from the list to display the results data in the workspace below.

Multiple graphs and tables from different Test-runs associated with the selected Test can be displayed concurrently. Use this function to compare Test results by selecting additional display options from the Available Results list.

Graphs can be customized to improve the presentation of data, right-click within a graph then select Customize. The options include modifying the graph style from the default line plot to a vertical bar, as well as controlling the color of elements within the graph display.

Some graphs and tables can be modified by filtering the URL data they contain. Right-click within a graph or table, then select Filter URLs to control the information displayed. You can also opt to export results data to spreadsheet format if for further analysis. Right-click and select Export to Excel from the menu.You can also zoom in on a graph by clicking-and dragging over the area of the graph you want to study.

Display Test Results

1 In the Repository Window, double-click Tests to expand the directory structure.

2 Double-click the Test , whose results you want to display.

3 In the Active Test Pane click the Results tab.

4 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

5 Click , on the right-hand side of the Available Results selection box and choose the display option you want from the list.

Note: All available results have display and output options associated with them including filtering, customizing, exporting and printing. Right-click within a graph or table to display and select from the choices available.

Tip: Display multiple graphs and tables concurrently to compare results using the Test Runs and Available Results selection boxes to view additional options from the list.

Note: Click , in the title bar of a graph or table to close it.

Customize HTTP Data Graphs Display

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose the data you want to display from the list.

4 Right-click inside the graph table and select Customize.

5 Select the Graph Type you want:

· Line plot.

· Vertical bars.

· Area under points, where the area beneath the line plot is a solid color.

Choose the display colors for the all the graph elements including the font and colors of the title display and whether to show or hide the title.

6 Click OK to apply your choices.

Note: The customize settings you select are not saved when you close a graph.

Zoom In and Out of a Graph

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose a graph.

4 With the graph displayed in the Results tab, click and drag over the area you want to zoom in on and release your mouse button. The data range you selected is magnified to fill the graph window.

5 Double-click anywhere in the graph to zoom out and return to the full graph display.

Export Test Results

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose the data you want to display from the list.

4 Right-click inside the graph or table and select either Export to Excel, or Export depending on the option available.

Note: The Export to Excel option automatically launches Excel and converts the data into Microsoft Excel Workbook format where it is displayed in a graph. Save and edit your results as required.

If you are exporting HTTP Data List table information, give your new file a name and save it as a .CSV file in the location of your choice.

Close Results Display Options

1 Open a Test and display the results you need.

2 Click , in the title bar of a graph or table to close it.

Or: Open a different Test or a Profile.

Note: You can move between tabs within the currently selected Test without affecting the display options you have chosen in the Results tab.

Delete Test Results

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , in the toolbar.

3 In the Delete Test Runs dialog box, select the Test-runs you want to delete.

Note: Test-runs are labelled with a date and time stamp to help you identify them.

4 Click Delete to remove the results from the Repository.

Audit Results Display Option

The Audit log contains a list of significant events that have occurred during a Test-run. Including the times and details of Test initiation and completion, errors that may have occurred and Virtual User details.

Additional Audit log entries may be written to the log if the Scripts included in the Test have been modeled to incorporate the appropriate SCL code. Use the LOG SCL command in a Script, to generate the data content for the Test Audit log. For more information on SCL refer to the SCL Reference Guide; an on-line copy is available within the Script Modeler, Help menu.

Display Audit Data

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose Test Audit log from the list.

Audit information is displayed in the Results tab in table format:

Tip: Choose additional display using the selection boxes to view and compare Test results.

Note: Click , in the title bar to close it.

Report Results Display Option

The Report log is a sequential text file that is used to record information about a single Test-run. Usually, a single record is written to the report log whenever a Test case passes or fails.

Additional Report log entries may be written to the log if the Scripts included in the Test have been modeled to incorporate the appropriate SCL code. Use the REPORT SCL command in a Script, to generate the data content for the Test Report log. For more information on SCL refer to the SCL Reference Guide; an on-line copy is available within the Script Modeler, Help menu.

Display Report Data

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose Test Report log from the list.

Report information is displayed in the Results tab in table format:

Tip: Select additional Test-runs and display options to compare results.

Note: Click , in the title bar to close it.

History Results Display Option

The History log is a sequential text file that is used to maintain a chronological history of each occasion on which the Test was run, together with the results of that Test. Usually, a single record is written to the History log when the Test-run is complete.

In addition, further Test History log entries may be written to the log if the Scripts included in the Test have been modeled to incorporate the appropriate SCL code. Use the HISTORY SCL command in a Script, to generate the data content for the Test History log. For more information on SCL refer to the SCL Reference Guide; an on-line copy is available within the Script Modeler, Help menu.

Display History Data

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose Test History log from the list.

History information is displayed in the Results tab in table format.

HTTP Data List Results Display Option

The HTTP Data List file gives details of the HTTP requests issued by Scripts during a Test-run. The information stored includes the response times and codes for the HTTP requests issued during a Test. The quality of the HTTP data recorded depends on the level of Server Statistics you specified when you created the Test and defined the properties to be applied. The Server Statistics setting controls the number of Virtual Users that the statistics are gathered for and can be edited in the Test Definition section.

The information collected is presented in a table and can be sorted by clicking on the column headings to reverse the display order of the data entries. These results can also be filtered to show only the entries you want by clicking inside the table and selecting the Filter option.

HTTP Data List can be exported to a .CSV text file which allows them to be imported into many other data analysis and report generating tools.

Display the HTTP Data List

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose HTTP Data List from the list.

HTTP Data List information is displayed in table format:

4 Click the Filter button when it becomes active to control the results displayed.See Filter HTTP Data List Results.

Right-click within the table and select Export to convert the data into a .CSV text file for use in other packages. See Export Test Results. Tip: Select additional Test-runs and display options to compare results.

Note: Click , in the title bar to close it.

Filter HTTP Data List Results

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose a set of results from the list.

Note: Only results containing HTTP statistics can be filtered.

4 Click the Filter button or right-click inside the graph and select Filter URLs.

The Filter dialog box offers a variety of selection criteria as illustrated:

5 The filter criteria available correspond to the column categories in the HTTP Data List table. Select your the settings from the filter options:

· Time: Date and time HTTP GETs and POSTs were issued.

· Response Time: Web site response time to GETs.

· Response Code: Code issued by web site in response to GETs.

· Reply Size: Size of data response to GETs issued by web site.

· URLs: Filter by URL.

· User ID: Filter by Virtual User(s) identity (IP address).

6 Select the filter options you want then click OK to apply them.

Note: Click the Defaults button to apply the original filter settings, which reflect the full range of data measurements of the HTTP Data List listed.

Note: The filter settings you select are not saved when you close a graph or table.

HTTP Data Graphs

The volume of HTTP data recorded is controlled by the logging level you set for a Task Group's Virtual Users. The logging level determines the number of Virtual Users that data is collected for and controls the quality of the data displayed in the graphs. The HTTP data collected relates only to responses to HTTP requests issued as part of Test.

The HTTP data collected during a Test-run can be displayed in a number of different graphs where you can scrutinize your Test results. There are seven graphs in total which you can select from the Available Results selection box in the Results tab of the Active Test Pane.

Right-click within a graph and select to Customize, Export to Excel Filter URLs.

Display HTTP Data Graphs

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose an HTTP data list option such as HTTP Monitored Bytes / Second v Elapsed Time.

This graph shows the total number of bytes per second returned during the Test-run.

4 Click the Filter button when it becomes active to control the results displayed or right-click inside the graph and select Filter URLs.

Note: Graphs are displayed in the default line plot style. Right-click within a graph and select Customize from menu to change their appearance.
Right-click within the graph and select Export to Excel convert the dataNote: Click , in the title bar to close it.

HTTP Response Time (Average per Second) v Number of Responses Graph

This graph displays the average response time for requests grouped by the number of requests per second during a Test-run.

Use the Filter button when it becomes active to control the results displayed. Alternatively, right-click within the graph and select the Filter URLs option.

Other right-click menu options include Export to Excel Customize option.HTTP Errors v Active Users Graph

This graph is used to display the effect on performance measured by the number of HTTP server errors returned as the number of active Virtual Users varies during a Test-run.

Note: This graph has been customized to display data points as vertical bars. Right-click within a graph and select Customize, then select Graph Type Vertical bars.

Make use of the URL Filter and Export to Excel options associated with this graph by right-click within it.

HTTP Errors v Elapsed Time Graph

This graph displays a cumulative count of the number of HTTP server errors returned during the Test-run.

Note: This graph has been customized to display the area under the data points as a solid. Right-click within a graph and select Customize > Area under points from menu to change the appearance of your graphs.

HTTP Responses v Elapsed Time Graph

This graph displays the total number of HTTP responses per second during the Test-run.

Right-click within a graph and select to Customize, Export to Excel Filter URLs.

HTTP Response Time v Elapsed Time Graph

This graph displays the average response time per second of all the requests issued during the Test-run.

Use the right-click menu options to Customize, Export to Excel Filter URLs.

HTTP Active User v Elapsed Time Graph

This graph displays the total number of active Virtual Users sampled at fixed intervals during a Test-run.

Right-click within a graph and select to Customize, Export to Excel Filter URLs.

Timer List

The Timer List file gives details of the Timers recorded during a Test-run. Timer results data records the time taken to load each web page specified by a Script for every Virtual User running the Script during a Test-run. The level of Timer information recorded is controlled by adjusting the Task Group settings of the Test within the Configuration tab of the Active Test Pane.

The information collected is presented in a table and can be sorted by clicking on the column headings to reverse the display order of the data entries.

Timer List can be exported to a .CSV text file which allows results to be imported into many other data analysis and report generating tools.

Display the Timer List

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose Timer List from the list.

Timer List information is displayed in table format:

Note: Right-click within the graph and select Export to save the datato a .CSV text file, which allows results to be imported into other data analysis and report generating tools.Tip: Display multiple graphs and tables concurrently to compare results using the Test Runs and Available Results selection boxes to view additional options from the list.

Note: Click , in the title bar to close it.

Timer Values v Active Users Graph

This graph is used to display the effect on performance as measured by timers, as the number of Virtual Users varies.

This graph enables you to choose which timers you want to display. A dialog box appears when you select this option. Use it to choose the timers you want to view, then click OK to proceed.

Right-click within a graph and select to Customize, Export to Excel Filter URLs.

Timer Values v Elapsed Time Graph

This graph is used to display the average timer values per second.

This graph enables you to choose which timers you want to display. A dialog box appears when you select this option. Use it to choose the timers you want to view, then click OK to proceed.

Right-click within a graph and select to Customize, Export to Excel Filter URLs.

SNMP and NT Performance Profile Graphs

The data collection queries defined in a Profile generate results data that can be displayed in custom graphs. All NT Performance Profile data is displayed in the Custom NT Performance graph. All SNMP Profile data is displayed in the Custom SNMP graph.

If you have more than one Profile of the same type referenced in a Test, all the results collected are merged and displayed in one graph.

Use the Filter option to select and display specific data collection queries defined in the Profiles. The unique names you assigned to each query are displayed below the graph in a color coded key. The IP address of the Host used to run the Profile Task during a Test-run is automatically listed alongside the query name.

Right-click within a graph and select to Customize, Export to Excel Filter.

See Also:

· Display Custom Profile Graphs

· Custom SNMP Graph

Display Custom Profile Graphs

1 Open a Test with the Results tab of the Active Test Pane displayed.

2 Click , on the right-hand side of the Test Runs selection box and choose a Test-run from the list, labelled with a date and time stamp.

3 Click , on the right-hand side of the Available Results selection box and choose Custom NT or Custom SNMP from the list.

The Custom NT Performance Graph is displayed below:

Tip: Select additional Test-runs and display options to compare results.

Note: Click , in the title bar to close it.

Custom SNMP Graph