Skip to main content

View Results in Halo

The Test Evolve Spark Visual test run view will update with the latest data from your test run every five seconds.

Run Card​

When a label is assigned to a node and a Spark Visual test run with that label has completed, a run card with a summary of the latest data for that run is displayed on that node.

Spark Visual Run Card

The information displayed includes:

  • The label associated with the visual regression test run.
  • The scenario pass percentage.
  • The number of visual checks completed during the test run.
  • The total number of failed visual regression checks.
  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned
  • How long since the last test result was received by Halo.

Run View​

Clicking on a visual run card will take you to a detailed view of your visual test run data, known as a run view.

Latest Scenarios Widget​

The 'Latest Scenarios' widget displays the count of each scenario's visual test status with a description of the status meaning.

Spark Visual Latest Scenarios Widget

The information displayed also includes:

  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned

Visual Checks Widget​

The 'Visual Checks' widget displays a summary of the visual checks performed in the test run.

Spark Visual Checks Widget

The information displayed also includes:

  • The number of checks completed during the test run.
  • The total number of failed visual checks.
  • The relative number of checks completed by label name.
  • How long since the last test result was received by Halo.

Scenarios Widget​

The 'Scenarios' widget displays completed scenarios in the test run broken down by status.

Spark Visual Scenarios Widget

The statuses are defined as follows:

  • Failed - One or more checks detected a visual regression
  • Error - Some visual checks may not have completed due to an exception or functional failure
  • Passed - Visual checks performed detected no visual regressions
  • Skipped - No visual checks were performed in these scenarios
  • New - New baseline created

Each scenario under the Failed and Error statuses will display the following information:

  • The scenario name.
  • The number of visual checks performed in the scenario.
  • The number of failed visual checks in the scenario.

Each scenario under the Passed status will display the following information:

  • The scenario name.
  • The number of visual checks performed in the scenario.

The 'Run Trends' widget displays the trend of number of visual checks by status across the test runs that are displayed in the run history table.

Spark Visual Run Trends Widget

Hovering over a specific run will display a breakdown of visual checks by status for that run.

Run History Table​

The 'Run History' table displays summary information on previously completed visual regression test runs.

Spark Visual Run History

Clicking on a run will update the currently displayed dashboard with the historic test run information.

Selecting the 'Next' buttons will update the run history table with the next most recent test runs. This will also update the data displayed in the run trends widget.

The information displayed includes:

  • The ID of the test run in Halo.
  • The number of visual checks performed in the test run.
  • The number of visual regressions in the test run.
  • How long since data was last received by Halo for the test run.

Configure in Spark​

To complete a visual regression test run in Spark, set 'enabled' to true and set 'source' to be local in visual_testing.yml.

Configure in Flare​

To complete a visual regression test run in Flare, select Visual Test Integration and then Local on the Configure screen.

Flare Configuration for Visual Test