Viewing Test Results

Use the Main menu to view or download the test results (the Test Log and Auto-Saved reports) that have been saved on the TAS. You can access the results of your tests or the results of other users' tests.

Optional User Authentication was added for the Result Website. See additional details below.

TIPS:

You can customize the settings for Auto-Saved reports and change the report types, granularity, and formats.
When you capture a Test Report from the Test Session window, you can also customize the report settings or only capture a portion of a full Test Report.

The file names of Test Reports and Test Logs are formed by combining the date and time the test completed, the test session name (test sessions that have not been saved are labeled "UNNAMED"), and the run ID of the test session. Test reports have an ".xls" or ".csv" extension and Test Logs have a ".log.txt" extension.

To view test results:

Select View > Test Results from the Main menu. A new Test Results browser window opens and displays a list of the results saved from your test sessions.

When you select Enable ToolTips, many components on the page will provide helpful hints. Recommended for first time users.

You can click on the Help button and it will take you to this page.

If you want to view another Users results, click the View Another User link and select the user's name from the User Results Directory list. You can click on the Help button and it will take you to this page. Optional User Authentication which restricts user access was added for the Result Website . See additional details below.

TIP: You can access this page directly from your browser when you are not logged in to the test system.

Open your browser and go to the home page.
Click the Test Results link and a new page opens with a list of User Results Directories.
Click one of the directory links.

Test Results browser window opens and displays a list of the results saved from your test sessions :

Switch User

If you want to view another Users results, click the Switch User link and select the user's name from the User Results Directory list.

Page

Select to page you want to view. Up to 10K files will be displayed. Use Search Criteria to view beyond 10k.

Search Results by entering a partial filename, or create date/time, or a REGEX compatible expression (click the bell

for a Search Dialog) Click Submit to send the query to the TAS.

TIPS:

Files start with test start time in YY-MM-DD_HH.MM.SS, when searching with a simple REGEX of "19-05-[0-9][0-9]" will yield all results starting in May 2019.
Limiting the search to log.txt will find just one file per test session, this can be helpful when attempting to pinpoint a test, then just change the query to the test's start time to see all results for the test.
Use the to Create Search Queries
and many components on the page will provide helpful hints

Bell

Select Search Filename Search Criteria to build query. Select - Search with Start Date - Enter Date (MM / DD/ YY). May also enter Hour and Minute as additional criteria. Select - RID - Enter Run Time Identifier indicated in the Filename. OR Select Test Run Search - search by a specific test run from your current list of results. It's mutually exclusive from date / time / ROD search. This search will show all result files for the given test run, other files (ex, pcap) will not be found by this type of search as they do not follow the "START_TIME_RID-NNN" naming convention. See example :

Click Apply to copy the Formatted Query to the Results Page Search field and close the window. Click Search to copy the Formatted Query to the Results Page Search field , send the query to the TAS and close the window. Click Cancel to Not save the query and close the window. Click Clear to rest the dialog and to clear all the fields.

Files per page

Select Files per page. Options : 30, 50 (default), 80, 100, 200, 250

Pass/Fail Results

The Pass/Fail Criteria filter allows you to select ANY results (Passed or Failed), PASS (Passed tests only) , FAIL (Failed tests only), OFF (do not use pass/fail criteria - N/A will be included with this criteria) Options: OFF , ANY, PASS , FAIL

Download Files

You can select multiple files for downloading, at once, selected either by test run (Test Mode) or by individual files (File Mode). In Test selection mode, selecting one file will automatically select all files related to the same test (by the start_time_rid prefix):

Download Zip

Select Download ZIP to download a single ZIP file with all files inside.

Test or File

You can toggle between Test and File mode. See Download Files.

Filename, Created, Size, Pass/Fail

Able to sort by File name, Creation Date, Size (bytes) and Pass / Fail. Click on the relevant column to sort.

Select result file

Select the result file (s) to view the file in your browser, or right-click the link and save the file to a location that you choose. Clicking on the magnifying glass next to a filename will search the results for all the files associated with the same test run:

Optional Authentication for the Result Website.

User Authentication

The feature is controlled via TAS Manager CLI command, results-auth-admin [ on | off | check ]

##>results-auth-admin

Usage: results-auth-admin [on|off|check]

##>results-auth-admin check

results-auth-admin: on

##>

When enabled, you will be prompted to login:

Select View > Test Results from the Main menu. When Authentication is enabled, you will be prompted to login:

Note: If the TAS is not running, you will not be able to login. The TAS is used for authentication. You will get an error “Error!Can't connect to TAS”.

If you enter an unknown or invalid Username or Password you will get an error.

If you are logged in as Test Admin or greater, you can see all user results and you are able to switch between users. Links to the Usage CSV files are provided:

When you are logged in as a Test Admin, you can see the Switch User button. When logged in as test operator you are brought directly to your own results listing and there is no Switch User button.

With the Authentication enabled, the Download ZIP option is not supported.

When going directly to specific URL (entering by hand or copy/pasting into address bar), if the user was not logged in yet, they would be required to login via the login page :

If you enter unknown/invalid Username or Password you will get an error,

If the credentials are correct, but the user doesn’t have access to the specific resource in the URL, the page will redirect to the user’s default landing page. For example if Test Operator Bingyu tries to reach a URL for sms results, it will just show this page :

And the link will end up here:

If the user has the access to the test results, there will be a new window popup as the default landing page, it requires user’s permissions according to the specific browser

a. Firefox

b. Chrome

Select ‘Allow pop-ups for URL’ for the default landing page. Go to ‘settings’ to change it :

a. Firefox : options->Privacy&Security->Permissions->Block pop-up windows->Exceptions

b. Chrome : settings-> advanced->Privacy and Security->Site Settings->Pop-ups and redirects

With different type of test results, the browser will execute them differently based on the following:

.log, .txt, most browsers would show it directly;

The other formats like .pcap .csv .xls ,etc. would activate the downloading process.

How your browser responds to each type of file may be configurable in the browser settings.

Also when Auth is enabled, the RESTful API should return the correct getFile.cgi? URLS in the Results List:

"resultFilesList": [

"http://TASIP/getFile.cgi?sms/19-08-13_08.05.55__RID-1__SCH_TEST_AFW1b.log.txt",

"http://TASIP/getFile.cgi?sms/19-08-13_08.05.55__RID-1__SCH_TEST_AFW1b.xls"

]

When Authentication is turned off, you have direct access to the Usage Report.csv files.

NOTES:

You can only view test reports if a compatible program is installed on the client platform.
Test results are not saved to the TAS if a test session is stopped with a forced abort.
If a test session fails before reaching the Started state, only the Test Log is saved.
The storage capacity of the TAS varies depending on the system configuration. When this capacity is reached, the oldest test results are purged.

NOTE: For every test session that has test cases with External Apps enabled, we automatically produce a network traffic capture file (tsn_tcn_veth_capture.pcap) and an error file (tsn_tcn_error_results.ret) under test results displayed by the TAS. The Network Traffic file only captures the network traffic for the test case from the External Apps point of view, not the Landslide viewpoint and the error file logs any errors that occurred in the External Apps point of view only.

Viewing Test Results

Optional Authentication for the Result Website.

Learn about: