Layer 5 - 7 Protocol Measurements


The values on the L5-7 tabs for relevant protocol layer reports the processing measurements for bearer plane testing (when any of the Advanced Data protocols are used). The MN (client) side of the test is reported in the L5-7 Client tabs separated by protocol layer collect measurements from the Network Host emulator used in the test. These measurements are available when Data Traffic is included in the test.

NOTES:

Measurement Values

In the default view, the Reports tab displays the Summary view, which summarizes the measurements for the test session. If your test includes multiple test cases, you can view the report for a single test case by changing the report view...

Unless otherwise noted, cumulative values report the number of occurrences or rates calculated since the start of the test, and per-interval values report the number of occurrences or rates calculated during the interval. You can view either by changing the measurement values...

Elapsed Time is the first measurement on every tab. It reports the amount of time between the start of the test and the end of the report interval.

Test Iteration reports the current iteration in a repeating test session. It is only displayed when a Number of Iterations is defined for the test session.

The measurements reported from the enhanced DMFs are reported on L5-7 tabs, as Basic and Advanced. and Enhanced protocols.  There will be no measurements at just the L5-7 level.   

A sub tab is a predefined fixed tab of measurements that displays below a top level tab. That is, they are displayed under the L5-7 tabs, where Basic and Advanced protocol-specific sub tabs display.

To access these sub tabs, click L5-7 Client|Basic, L5-7 Client|Advanced, L5-7 Client|Http, etc….  The sub tabs do not have a top level tab, for example, L5-7 Client tab does not display, L5-7 Client|Common sub tab displays.

A sub total tab is a tab of measurements that represents the per session, per bearer, per dmf, per bearer, and so on, for any set of measurements or tabs.  The TS reports sub total names and measurement values at runtime, and the TAS basically prepares copies of ALL measurements defined by the test case.  The TAS displays the values reported by the TS.

NOTE: For example, to access a sub total tab, click the subtotal name reported by the TS, that is, DMF_0, Bearer_1, MN_3, Sess_2, etc. Also, sub tabs may report sub totals, e.g., the Basic data measurements for the second DMF in the TC:  L5-7|Basic, subtotal DMF_1.  When a sub total tab is reported, all the measurements display on a Totals sub tab in the GUI.

Use Report Options to select test cases measurements, however, some test cases may report these values automatically.

Refer to the following topics for a detailed description of measurements:

L5 - 7 Per Interval Measurements

L5-7 Per-Interval (P-I) Reports

Enhanced DMF (L5-7) reports negative value for some Per Interval reports (Report Options > Per Interval Reports).

The P-I interval reports the difference in the rate between the two intervals.  A negative P-I value means the rate changed slower between the intervals (and does not indicate the rate that occurred between the intervals).  For example, if the P-I reports  -3 bps, it means the rate was 3 bps slower from last interval.

NOTE: The cumulative rate (other than in L5-7 measurements) is calculated by the TAS  as (Value (n) – Value (0) ) / (Time (n) – Time(0)), and reports the average rate over the whole test and up to the interval. The P-I value shows the actual rate that occurred within a given interval.

The Cumulative P-I is calculated as follows:

Value2 (Cumulative) – Value1 (Cumulative) = Value2 (P-I).

For example, if the previous interval’s P-I value was 0, and the cumulative value was 500,000 for seven intervals, then the P-I value would be 0 (that is, 500000 – 500000 = 0), then if the value is 438873, the P-I value would be -61127 ( V2 – V1 ) that is, 433873 – 500000 = -61127.   

 

Basic Data Measurements

The following measurements are available on L5-7 Client|Basic tab when any of the basic data types (PING, RAW, UDP, and TCP) are used in a Continuous Data test. Network Basic Data measurements are on L5-7 Server|Basic tab titles are preceded by "Host".

If the simple query from DNS Client (Landslide) to DNS Server fails, relevant error measurements are reported on the following L5-7 tabs:

NOTE: These measurements do not record TCP activity when TCP is used as an underlying protocol in an Advanced Data message flow.

The following error messages are reported if a simple query from DNS Client (Landslide) to DNS Server fails:

Basic Data - DSCP Measurements

The following measurements are Per DMF result Packet Count by DSCP Type. See topic TOS Calculator for additional DSCP details.

NOTE: The Command measurements include mainflow and subflow transactions, and are based on actual Successful vs Failed transactions.

Advanced Data Measurements

NOTE: Network Advanced Data measurements are on L5-7 Server|Advanced tab titles are preceded by "Host".

The following measurements are available on the L5-7 Client|Advanced tab when any of the Advanced Data protocols are used in a Continuous Data test.

NOTES:

  • These measurements are based on Mainflow DMF transactions only (displays the configured rate of the DMFs).  They indicate either the current configured or the TS attempted to execute measurements.
  • The Configured measurements will not be calculated or displayed when the Test Activity is Sequencer (as the TAS does not know the Configured Rate at any given time).  

NOTE: The Command measurements include mainflow and subflow transactions, and are based on actual Successful vs Failed transactions.

The following error messages are reported if a simple query from DNS Client (Landslide) to DNS Server fails:

See error description above.

Advanced HTTP Measurements

The following measurements are available on the L5-7 Advanced HTTP tab.

SSL Measurements

The following measurements are available on the L5-7 Client|SSL tab when HTTPS DMF is used and when TLS is used on all Service Based Interfaces.

The following measurements are available on the L5-7 Server|SSL tab when HTTPS DMF is used when TLS is used on all Service Based Interfaces..

ABR Protocol Measurements - Abr Client (New L5-7 Client|ABR tab on L5-7 Client tab):

Tcl Variable

Description

AbrDnsReq

DNS Request

AbrDnsRes

DNS Response

AbrDnsTimeout

DNS Timeout

AbrDnsRetriesExceeded

DNS Retries Exceeded

AbrHttpReqSent

HTTP GET requests sent

AbrHttpRspRcvd

HTTP Responses received

AbrStartCount

Abr Start Count

AbrStartTime

Abr Start Time - Time it takes for arrival of first video packet at client

AbrMinStartTime

Abr Min Start Time

AbrMaxStartTime

Abr Max Start Time

AbrTotalSegRcvd

Total Segments received

AbrVideoResolution

Average video resolution - The calculation of average video resolution = Sum across resolutions ((# seg at a given resolution) * (resolution) / (total number of segments))

AbrMinVideoResolution

Min video resolution

AbrMaxVideoResolution

Max video resolution

AbrLowSegRcvd

Low quality segments received

AbrMedSegRcvd

Med quality segments received

AbrHighSegRcvd

High quality segments received

AbrSwitchUpCount

Switch to upper quality count

AbrSwitchDownCount

Switch to lower quality count

AbrUninterupptedVideoPlay

Uninterrupted video playback - Video played back without running out of buffer

AbrBufferInterruption

Number of Buffer interruptions

AbrLateSegCount

Late segments

AbrSegLateTime

Average segment late time

AbrSegMinLateTime

Min segment late time

AbrSegMaxLateTime

Max segment late time

AbrTransScoreCount

Transmission score count

AbrTransScore

Average transmission score - This score based on each quality of video segments used. Each low quality segment scores 2.0, each medium quality segment scores 3.5, each high quality segment scores 5, total score is the summary of all segment scores dived by segment number.

Algorithm for ABR Score:

Abr Total Score = (Abr Trans Score) * (1 – (Late Seg Count) / (Total Seg Count))

AbrMinTransScore

Min transmission score

AbrMaxTransScore

Max transmission score

AbrScoreCount

Overall score count

AbrScore

Average overall score

AbrMinScore

Min overall score

AbrMaxScore

Max overall score

trafAbrFailureCount

Abr Failure Count

The following measurements will remain at zero (0) until the session is stopped

 

trafAbrReBufferRatioCnt

Overall Rebuffer Ratio Count

trafAbrReBufferRatio

Average Rebuffer Ratio

trafAbrMinReBufferRatio

Min Rebuffer Ratio

trafAbrMaxReBufferRatio

Max Rebuffer Ratio

trafAbrMediaBitrateCnt

Overall Media Bitrate Count

trafAbrMediaBitrate

Average Media Bitrate (b/s) - is a one time calculation at the end of each media flow. The P-I mode will show the Difference in the rates between two intervals and NOT the Avg rate for that interval (unless the previous interval was zero)

trafAbrMinMediaBitrate

Min Media Bitrate (b/s)

trafAbrMaxMediaBitrate

Max Media Bitrate (b/s)

 

ABR Protocol Measurements - Abr Server (New L5-7 Server|ABR tab on L5-7 Server tab):

Tcl Variable

Description

AbrHttpReqRcvd

HTTP GET requests received

AbrHttpRspSent

HTTP responses sent

AbrTotalSegSent

Total segments sent

AbrLowSegSent

Low quality segments sent

AbrMedSegSent

Medium quality segment sent

AbrHighSegSent

High quality segment sent

DNS Protocol Measurements

The following measurements are available on the L5-7 Client|Advanced DNS tab when DNS DMF is used.

 

MMS Measurements

The following measurements are available on the L5-7 Client|MMS tab when MMS Load testing for MME Nodal - MMS Support.

 

TraceRoute Client and Server measurements

 

ULP Client and ULP Server measurements

LPP Measurements are located in LPP Measurements topic.

ULP Client Messages

Name

GUI Name

Description

UlpClnSuplStartSent

Supl Start Sent

The total number of Supl Start Sent messages

UlpClnSuplResponseReceived

Supl Response Received

The total number of Supl Response Rcvd msgs

UlpClnSuplEndSent

Supl End Sent

The total number of Supl End Sent messages

UlpClnSuplEndReceived

Supl End Received

The total number of Supl End Received messages

UlpClnSuplPosInitSent

Supl Pos Init Sent

The total number Supl Pos Init Sent messages

UlpClnSuplPosReceived

Supl Pos Received

The total number of Supl Pos Received messages

UlpClnSuplPosSent

Supl Pos Sent

The total number of Supl Pos Sent messages

UlpClnDnsQuerySent

Dns Query Sent

The total number of Dns Query Sent messages

UlpClnDnsResponseReceived

Dns Response Received

The total number of Dns Response Rcvd msges

UlpClnDnsTimeout

Dns Timeouts

The total number of Dns Timeouts

UlpClnDnsRetriesExceeded

Dns Retries Exceeded

The total number of Dns Retries Exceeded

UlpClnUt1Timeout

Supl UT1 Timeouts

The total number of Supl UT1 Timeouts

UlpClnUt2Timeout

Supl UT2 Timeouts

The total number of Supl UT2 Timeouts

UlpClnUt3Timeout

Supl UT3 Timeouts

The total number of Supl UT3 Timeouts

UlpClnSuplEndSuccess

Supl End Success

The total number of Supl End Success messages

UlpClnSuplEndFailure

Supl End Failure

The total number of Supl End Failure messages

UlpClnSescUnspecified

Supl End Status Code - unspecified

The total number of Supl End Status Code Unspecified messages

UlpClnSescSystemFailure

Supl End Status Code - systemFailure

The total number of Supl End Status Code systemFailure messages

UlpClnSescUnexpectedMsg

Supl End Status Code - unexpectedMessage

The total number of Supl End Status Code unexpectedMessage messages

UlpClnSescProtoErr

Supl End Status Code - protocolError

The total number of Supl End Status Code protocolError messages

UlpClnSescDataMiss

Supl End Status Code - dataMissing

The total number of Supl End Status Code dataMissing messages

UlpClnSescUnexpectedDataValue

Supl End Status Code - unexpectedDataValue

The total number of Supl End Status Code unexpectedDataValue messages

UlpClnSescPosMethodFailure

Supl End Status Code - posMethodFailure

The total number of Supl End Status Code posMethodFailure messages

UlpClnSescPosMethodMismatch

Supl End Status Code - posMethodMismatch

The total number of Supl End Status Code posMethodMismatch messages

UlpClnSescPosProtoMismatch

Supl End Status Code - posProtocolMismatch

The total number of Supl End Status Code posProtocolMismatch messages

UlpClnSescTargetSetNotReachable

Supl End Status Code - targetSETnotReachable

The total number of Supl End Status Code  targetSETnotReachable messages

UlpClnSescVersionNotSuppd

Supl End Status Code - versionNotSupported

The total number of Supl End Status Code  versionNotSupported messages

UlpClnSescResourceShortage

Supl End Status Code - resourceShortage

The total number of Supl End Status Code  resourceShortage messages

UlpClnSescInvalidSessionid

Supl End Status Code - invalidSessionid

The total number of Supl End Status Code invalidSessionid messages

UlpClnSescNonProxyModeNotSuppd

Supl End Status Code - nonProxyModeNotSupported

The total number of Supl End Status Code nonProxyModeNotSupported messages

UlpClnSescProxyModeNotSuppd

Supl End Status Code - proxyModeNotSupported

The total number of Supl End Status Code proxyModeNotSupported messages

UlpClnSescPositioningNotPermitted

Supl End Status Code - positioningNotPermitted

The total number of Supl End Status Code positioningNotPermitted messages

UlpClnSescAuthNetFailure

Supl End Status Code - authNetFailure

The total number of Supl End Status Code authNetFailure messages

UlpClnSescAuthSuplInitFailure

Supl End Status Code - authSuplInitFailure

The total number of Supl End Status Code authSuplInitFailure messages

UlpClnSescIncompProtectionLevel

Supl End Status Code - incompatibleprotectionLevel

The total number of Supl End Status Code incompatibleProtetionLevel messages

UlpClnSescSvcNotSuppd

Supl End Status Code - serviceNotSupported

The total number of Supl End Status Code serviceNotSupported messages

UlpClnSescInsufficientInterval

Supl End Status Code - insufficientInterval

The total number of Supl End Status Code insufficientInternal messages

UlpClnSescNoSuplCoverage

Supl End Status Code - noSUPLCoverage

The total number of Supl End Status Code noSUPLCoverage messages

UlpClnSescConsentDeniedByUser

Supl End Status Code - consentDeniedByUser

The total number of Supl End Status Code consentDeniedByUser messages

UlpClnSescConsentGrantByUser

Supl End Status Code - consentGrantByUser

The total number of Supl End Status Code consentGrantByUser messages

UlpClnSescSessionStopped

Supl End Status Code - sessionStopped

The total number Supl End Status Code sessionStopped messages

UlpClnSuplInitReceived SUPL Init Received The total number of SUPL Init Received messages

ULP Server Messages

Name

GUI Name

Description

UlpSrvSuplStartReceived

Supl Start Received

The total number of Supl Start Received msgs

UlpSrvSuplResponseSent

Supl Response Sent

The total number of Supl Response Sent messages

UlpSrvSuplEndReceived

Supl End Received

The total number of Supl End Received messages

UlpSrvSuplEndSent

Supl End Sent

The total number of Supl End Sent messages

UlpSrvSuplPosInitReceived

Supl Pos Init Received

The total number of Supl Pos Init Received msgs

UlpSrvSuplPosReceived

Supl Pos Received

The total number of Supl Pos Received messages

UlpSrvSuplPosSent

Supl Pos Sent

The total number of Supl Pos Sent messages

UlpSrvSuplInitSent SUPL Init Sent The total number of SUPL Init Sent messages
UlpSrvSt1Timeout SUPL ST1 Timeouts The total number of SUPL ST1 Timeout messages
lpSrvSt2Timeout SUPL ST2 Timeouts The total number of SUPL ST2 Timeout messages

 

Basic Data with UDP Estimated Stats enabled

These KPIs start with "Estimated" indicate they are calculated by the new estimate algorithm designed for devices that clocks are not in sync.

Estimated Basic Data Message RTD Count The total count for RTD
Estimated Basic Data Message RTD Average The average latency from the source to the destination then back to source, measured from the time the source sends a packet until the source receives it.
Estimated Basic Data Message RTD Minimum  The minimum measured latency from the source  back to the source.
Estimated Basic Data Message RTD Maximum  The maximum measured latency from the source back to the source.
Estimated Basic Data Message RTD 99% Confidence 99% Confidence for RTD
Estimated Basic Data Message RTD 90th Percentile  90th Percentile for RTD
Estimated Basic Data Message RTD 98th Percentile  98th Percentile for RTD
Estimated Basic Data Message RTD Median  Median for RTD
Estimated Basic Data Message RTD Standard Deviation Standard Deviation for RTD
Estimated Basic Data Message OWD Count The total count for OWD
Estimated Basic Data Message OWD Average The average latency from the source to the destination, measured from the time the source sends a packet until the destination receives it.
Estimated Basic Data Message OWD Minimum  The minimum measured latency from the source to the destination.
Estimated Basic Data Message OWD Maximum  The maximum measured latency from the source to the destination.
Estimated Basic Data Message OWD 99% Confidence 99% Confidence for OWD
Estimated Basic Data Message OWD 90th Percentile  90th Percentile for OWD
Estimated Basic Data Message OWD 98th Percentile  98th Percentile for OWD
Estimated Basic Data Message OWD Median  Median for OWD
Estimated Basic Data Message OWD Standard Deviation Standard Deviation for OWD

 

Basic Data Client / Server: with UDP Estimated Stats enabled

Basic Data Message RTD 99% Confidence 99% Confidence for RTD
Basic Data Message RTD 90th Percentile  90th Percentile for RTD
Basic Data Message RTD 98th Percentile  98th Percentile for RTD
Basic Data Message RTD Median  Median for RTD
Basic Data Message RTD Standard Deviation Standard Deviation for RTD
Basic Data Message OWD 99% Confidence 99% Confidence for OWD
Basic Data Message OWD 90th Percentile  90th Percentile for OWD
Basic Data Message OWD 98th Percentile  98th Percentile for OWD
Basic Data Message OWD Median  Median for OWD
Basic Data Message OWD Standard Deviation Standard Deviation for OWD