The Insights page

The Insights page provides you with a number of charts that assist you in tracking the performance and effectiveness of tests and batches that teams execute on your account. Reviewing the charts allows managers to identify ongoing trends or risks. The scope of data that you can view is role based. Account admins can view data at the account and team level. Users that do not have admin rights can only view data that relates to the teams for which they are a member.

Generate the charts by specifying the value for two settings:

• Scope - Determines if data is taken with respect to the entire account or one or more teams that are assigned to your account
• Date Range - Sets the time frame boundaries for which the Insights data is collected.

The main tasks that you perform on the Insights page are:

• Setting the scope for which data is displayed, the account or team.
• Setting the date range over which data is displayed.

Page Layout

The Insights page is divided into several sections:

• The Insights toolbar.
• The Tests Analytics tab.
• The Batch Statistics tab.
• The Tab toolbar.

The Insights toolbar
Use the toolbar Scope selector to select the account or teams for which information is displayed and the Date Range feature to set the time frame used for extracting information from the database.

The Test Analytics tab
Displays a set of charts that provide an at-a-glance view of all executed tests and generated test statistics for the account or for a selection of teams over a selected time frame.

The Batch Statistics tab
Displays a list of Batches that were executed over the selected time frame. Each row in the list displays a separate batch and basic batch run and status information such as Last run, Pass, Fail, Unresolved and Total runs. Clicking a row, expands the row to display a set of charts and analytics for that Batch.

The Tab toolbar
Contains tools for arranging the display or extracting and sharing information presented on the tab. One or more of the following tools are available depending on the currently active tab:

Arrange display: Click the Arrange display icon and the page changes to allow you to reposition the charts. Drag and Drop the charts into a new position and then click the Arrange display icon again to return to the regular display.

Print PDF: Click the PDF icon to capture the screen, ready to save in PDF format.

Share link: Click the Share link icon to copy a link for the current page to the clipboard. From that point you can share the link.

Setting the Scope

Use the Scope selector to select the account or teams for which information is displayed on the tab. You can choose between displaying reports and charts that reflect test execution for the entire account or for a selection of one or more teams assigned to the account.

To set the scope:

1. Click the Scope drop-down list in the Insights toolbar.
2. Click the Account option in the list to set the scope to the account.
3. Click the Team option in the list and then select one or more team checkboxes to set the scope to the selected teams.
4. Click Apply to save your selection and update the charts and data presented on the Test Analytics tab.

Setting the Date Range

Applying a date range to the Insights page affects the charts and analytics that the Insights page displays in two ways. First, the period of time over which you sample the tests to produce the charts is increased or decreased to match the date range. Second, based on period of time that you select, Eyes adjusts the number of segments that it displays in the resulting charts so as to clearly present the data. The exact number of time segments that are used varies according to type of information presented in a specific chart.

You can select a date range from several preset date ranges or set a custom date range.

The preset date ranges include the following options:

• Last 7 days
• Last 30 days
• Last 90 days

When you select a Custom date range Eyes opens a standard date picker calendar from which you can select a Start date and End date.

To set a custom date range:

1. Click the Date Range drop-down list in the Insights toolbar.
2. Click one of the preset date range options to use one of the commonly used date ranges.
3. Click Custom date range to use the calendar to set the date range.
4. Select a date from the calendar on the left for the start date and select a date from the calendar on the right for the end date.
5. Click Apply to update the data on the charts to match your selections.

Test Analytics

The Insights - Test analytics tab displays charts that provide an at-a-glance view of test execution data, test results, and test scenarios. The scope for viewing information is role-based, as described in The Insights page. You can view charts by Account or by Teams that you are a member of, and within a selected Date Range.

Tests Execution By

This chart shows the number of tests executed within the scope and date range. It provides details of tests by status or by team.

• The total number of test scenarios executed and broken down by test result status (Passed, Failed, or Unresolved).

  

• The total number of test scenarios executed and broken down by team. This option is not available if the scope is Account.

  

Test Results Status

This pie chart displays the pass rate for all tests executed over a set period. The pass rate is the ratio of passed tests compared to those that did not pass, expressed as a percentage.

Automated Testing Coverage and Detected Issues

This chart has the following views:

• Detected Issues - Number of steps manually rejected and bug regions added to accepted checkpoints during the selected period.
• Total validations - Number of tested pages and components during the selected period.

If multiple teams are displayed, each team is represented separately on the chart.

Automated validation summary

This chart shows the number of automated actions over the past 30 days. You cannot modify the time frame in this chart. Automation actions are accept or reject commands or regions that were automatically applied to other screens.

The Impact of AI-Powered Automated Maintenance

This chart shows how many steps were resolved automatically over the selected period.

Time saved with automated maintenance over the past 90 days

This chart calculates the amount of time saved by auto maintenance over the past 90 days and past 12 months. You cannot modify the time frame in this chart.

Time saved calculation is based on the assumption that the average time to manually review an app page is 2.5 minutes.

Defined tests over time

Shows the number of tests defined for each interval for the set period of time. If you have multiple teams displayed, each team is displayed separately on the chart.

Display Top....

The Top chart ranks Apps or Tests based on how fragile or stable they are and uses the percentage of executions that passed as the measure of Stability. The higher the percentage of Tests or Apps that pass, the higher the Stability. Conversely, the lower the percentage of Tests or Apps that pass, the more Fragile they are.

Use the drop-down menu to select one of the following options to display:

• Top fragile apps
• Top stable apps
• Tests with low pass rate
• Tests with high pass rate

Applied issue regions over time

Shows the cumulative number of bug or comment regions that were added over time. If you have multiple teams displayed, each team is displayed separately on the chart.

Number of executed tests by...

A bar chart that shows the total number of test scenarios executed with respect to one of the following parameters:

• Assignee
• Browser
• Device
• OS
• Viewport

Batch Statistics

The insights page also contains Batch Statistics that track the performance of batches over time. You can read more about this page in the Batching guide.