Skip to main content

View Results in Halo

The Test Evolve Spark Functional test run cards and run views will update with the latest data from your test run every five seconds.

Run Card​

When a label is assigned to a node and a Spark Functional test run with that label has completed, a run card with a summary of the latest data for that run is displayed on that node.

Spark Functional Run Card

The information displayed includes:

  • The label associated with the functional test run.
  • The current pass percentage status of the test run.
  • The test types included in the test run.
    • Browser
    • Mobile App
    • API
    • Desktop App
  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned
  • How long since the last test result was received by Halo.

Run View​

Clicking on a functional run card will take you to a detailed view of your functional test run data, known as a run view.

Latest Run Widget​

The 'Latest Run' widget displays information on the composition of your functional test run with statistics and summary results.

Spark Functional Latest Run Widget

The information displayed includes:

  • The current pass percentage status of the test run.
  • The label associated with the functional test run.
  • The number or passed and failed scenarios.
  • The progress percentage of the test run.
  • The current time taken.
  • The average time for each scenario to complete.
  • The run properties, such as browser type, version and test environment.
  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned
  • How long since the last test result was received by Halo.

Features Widget​

The 'Features' widget displays the current pass percentage for each feature in the test run.

Spark Functional Features Widget

Features with the lowest pass percentage are elevated to the top of the list of features so that it is clear which areas of the system under test have scenarios that are failing.

Features with the same pass percentage are then ordered alphabetically.

Clicking on a feature name will take you to that feature in the Test Run Report.

The 'Run Trends' widget displays the trend of functional test statuses across the test runs that are displayed in the run history table.

Spark Functional Run Trends Widget

Hovering over a specific run will display a breakdown of the test statuses for that run.

Run History Table​

The 'Run History' table displays summary information on previously completed functional test runs.

Spark Functional Run History

Clicking on a run will update the currently displayed dashboard with the historic test run information.

Selecting the 'Next' button will update the run history table with the next most recent test runs. This will also update the data displayed in the run trends widget.

The information displayed includes:

  • The ID of the test run in Halo.
  • The pass percentage status of the test run.
  • The test types included in the test run.
    • Browser
    • Mobile App
    • API
    • Desktop App
  • A subset of run properties.
    • Operating System
    • Desktop or Mobile
    • Browser
  • The duration of the test run.
  • How long since data was last received by Halo for the test run.

Configure in Spark​

A test run will be considered to be 'functional' if 'enabled' is not set to true in audits.yml or visual_testing.yml.

Configure in Flare​

To complete a functional test run in Flare, select Functional Test on the Configure screen.

Flare Configuration for Functional Test