Skip to main content

View Results in Halo

The Test Evolve Spark Audit test run view will update with the latest data from your test run every five seconds.

Run Card​

When a label is assigned to a node and a Spark Audit test run with that label has completed, a run card with a summary of the latest data for that run is displayed on that node.

Spark Audit Run Card

The information displayed includes:

  • The label associated with the audit test run.
  • The current pass percentage status of the test run.
  • The lowest score for the following categories in the test run
    • Performance
    • Accessibility
    • Best Practices
    • SEO
  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned
  • How long since the last test result was received by Halo.

Run View​

Latest Scenarios Widget​

The 'Latest Scenarios' widget displays the audit scenario test statuses for the test run.

Spark Audit Latest Scenarios Widget

The information displayed includes:

  • A breakdown of scenarios by status.
  • The number of checks completed in the test run.
  • The completion status of the test run.
    • In Progress
    • Test Complete
    • Abandoned

Latest Scores Widget​

The 'Latest Scores' widget displays a summary of the lowest scores for each category from all Lighthouse checks in the test run.

Spark Audit Latest Scores Widget

The information displayed also includes:

  • A description of the thresholds used in the display of the scores.
  • How long since the last test result was received by Halo.

Scenarios Widget​

The 'Scenarios' widget displays completed scenarios in the test run broken down by status.

Spark Audit Scenarios Widget

The statuses are defined as follows:

  • Failed - Scenario checks have returned Lighthouse recommendations
  • Error - Some scenario checks may not have been completed due to an exception or functional failure
  • Passed - Scenario checks have not returned any Lighthouse recommendations
  • Skipped - No Lighthouse checks were performed

Each scenario under the Failed and Error statuses will display the following information:

  • The scenario name
  • The number of Lighthouse checks performed in the scenario.
  • A breakdown of recommendations by category - Performance, Accessibility, Best Practices and SEO.

Each scenario under the Passed status will display the following information:

  • The scenario name
  • The number of Lighthouse checks performed in the Scenario.

The 'Run Trends' widget displays the trend of scores by category across the test runs that are displayed in the run history table.

Spark Audit Run Trends Widget

Hovering over a specific run will display a breakdown of scores by category for that run.

Run History Table​

The 'Run History' table displays summary information on previously completed audit test runs.

Spark Audit Run History

Clicking on a run will update the currently displayed dashboard with the historic test run information.

Selecting the 'Next' button will update the run history table with the next most recent test runs. This will also update the data displayed in the run trends widget.

The information displayed includes:

  • The ID of the test run in Halo.
  • A breakdown of scores by category.
  • How long since data was last received by Halo for the test run.

Test Run Report​

When a user selects a scenario from the Run View Scenarios widget, they will be taken to the lower level 'Test Run Report'.

Spark Audit Test Run Report Check Container

The information displayed includes:

  • The features, scenarios and steps from which lighthouse audits were executed.
  • A summary table of checks that were made within each step.
  • Scores by category for each check performed in each step.
  • A 'label' and url for each check in each step.

When a user selects a check from the Run Report Step summary table, a detail container will open for a full explanation of the issues discovered.

Spark Audit Test Run Report Check Expanded

For each Lighthouse check, the information displayed includes:

  • Performance metrics, opportunities and diagnostics.
  • Grouped Accessibility violations, Best Practices opportunities and SEO opportunities.
  • Expandable sections to show detail of the opportunities.
  • Links to further documentation that can be of assistance in resolving the identified issues.

Configure in Spark​

To complete a lighthouse audit test run in Spark, set 'enabled' to true and set 'source' to be lighthouse in audits.yml.

Configure in Flare​

To complete an audit test run in Flare, select Audits and then Lighthouse on the Configure screen.

Flare Configuration for Audit Test