Skip to main content

Applitools Dashboard

The Applitools Dashboard is a powerful web-based tool that allows you to view, analyze, and manage your visual test results. It provides an intuitive interface for reviewing visual differences, updating baselines, collaborating with team members, and gaining insights into your application's UI across different versions and environments.

In this section, we'll explore how to:

  • Access the Applitools dashboard
  • Acquire your Applitools API key
  • Navigate and understand the dashboard interface
  • Analyze test results and visual differences
  • Manage baselines and approve changes
  • Collaborate with your team
  • Utilize advanced features like root cause analysis

Accessing the Applitools Dashboard​

Step 1: Log in​

To access the dashboard:

  1. Navigate to the Applitools Dashboard.
  2. Log in with your Applitools account credentials.
    If you don't have an account yet, you can sign up for a free account.

Step 2: Acquiring your Applitools API key​

Your API key is essential for connecting your tests to the Applitools Eyes cloud service.

How to obtain your API key:​

  1. Once logged in, click on your account name or avatar in the top-right corner.
  2. Select "My API key" from the dropdown menu.
    My API Key Location
  3. Copy the displayed API key.
    My API Key Dialog

Use this API key in your project by setting it as an environment variable or entering it when prompted during the CLI setup.

export APPLITOOLS_API_KEY='your_api_key_here'

Recommended practice: It's advisable to set your API key as an environment variable APPLITOOLS_API_KEY instead of hardcoding it in your configuration file. This approach keeps your API key secure since configuration files are often checked into version control systems. However, rest assured that this API key only has EXECUTE permissions—it cannot be used to retrieve or modify test data or baselines. Its sole purpose is to authorize the execution of new tests within your account.

The Applitools Dashboard consists of several key components:

Test results page​

After logging in, you'll see the Test Results page, which lists all your recent test runs.

  • Batch List: A list of test batches, grouped by batch name.
  • Filter and Search: Tools to filter tests by date, application name, batch name, or status.
    Batch list and filters

Batch details​

Clicking on a batch opens the Batch Details view, showing individual tests within that batch.

  • Test List: A list of tests with their statuses (Passed, Unresolved, Failed).
  • Batch Information: Details like batch name, start time, and duration.
    Batch tests

Test details and steps​

Selecting a test displays the Test Details, where you can view each step and its comparison results.

  • Step List: Screenshots captured at each visual checkpoint.
  • Baseline and Checkpoint Images: Side-by-side comparison of the baseline and the new screenshot.
  • Differences Overlay: Highlighted areas where visual differences were detected.
    Step view

Analyzing test results and visual differences​

Viewing visual diffs​

For steps with visual differences:

  1. Click on the step to open the comparison view.
  2. Use the toolbar to switch between different comparison modes:
    • Side-by-Side: Displays baseline and checkpoint images next to each other.
    • Toggle: Quickly switch between images to spot changes.
  3. Step diffs

Interpreting differences​

  • Highlighted areas — Visual diffs are marked with colored overlays.
  • Region annotations (Set region ▾) — Use the dropdown to choose how Eyes treats a specific area:
    • Ignore region — Suppress diffs inside the region.
    • Floating region — Allow bounded movement (configure max up/down/left/right offsets).
    • Strict region — Enforce the highest sensitivity (Strict match level) for this area.
    • Dynamic region — Tolerate predictable dynamic patterns (e.g., timestamps/IDs) while still catching real issues.
    • Ignore colors region — Disregard color-only changes; still flag layout/content changes.
    • Layout region — Validate structure/flow only; ignore content differences within the region.

Root cause analysis​

For advanced debugging, use the Root Cause Analysis feature:

  1. Click on the "Root Cause" button (represented by a brackets icon).
  2. View differences in the underlying DOM and CSS.
  3. Identify specific code changes that led to visual differences.
    Root cause

Managing baselines and approving changes​

Accepting or rejecting changes​

For each test step with differences:

  • Accept (Approve): Confirms the changes are intentional, updating the baseline.
  • Reject: Marks the differences as unintended, indicating a potential bug.
    Accept changes

How to accept changes:​

  1. Click the "Thumbs Up" icon to accept the changes.
  2. Optionally, add a remark explaining the acceptance.

How to reject changes:​

  1. Click the "Thumbs Down" icon to reject the changes.
  2. Optionally, add a bug detailing the issue.

Saving decisions​

After reviewing all differences:

  • Click on the "Save" button to apply your decisions.
  • The baseline images will be updated accordingly for future test runs.
    Save baseline

Collaborating with your team​

Sharing test results​

  • Direct Links: Share URLs to specific tests or steps with team members.

Adding remarks and bugs​

  • Remarks: Add remarks on specific steps or differences to communicate with your team. Remarks
  • Bugs: Use tools to highlight areas of concern on the screenshots.
    Remark view

Integrations​

Applitools integrates with various tools to enhance collaboration:

  • Jira: Create Jira issues directly from the dashboard.
  • GitHub/GitLab: Link test results to pull requests.
  • Notifications: Receive notifications and updates in Slack, MS Teams, and Emails. These can be configured via the Admin teams settings.

Utilizing advanced features​

Batch management​

  • Batch grouping: Organize tests into batches for better management. Gallery view
  • Batch comparison: Compare entire batches to identify differences across test runs.
    Gallery view grouped

Test configuration overrides​

  • Modify test configurations directly from the dashboard for subsequent runs.

Accessibility testing​

  • Leverage Applitools to perform accessibility checks alongside visual testing.

Insights and analytics​

  • Access metrics and trends over time. Insights view
  • Identify patterns in test failures or UI changes.
    Attention view

Best practices​

  • Regular reviews: Schedule periodic reviews of test results to maintain baseline accuracy.
  • Collaborative workflow: Encourage team members to participate in reviewing and approving changes.
  • Baseline maintenance: Update baselines thoughtfully to prevent masking unintended changes.
  • Use descriptive names: Name your tests and batches meaningfully to simplify navigation.