View Results in Halo
The Test Evolve Spark Audit test run view will update with the latest data from your test run every five seconds.
Run Card
When a label is assigned to a node and a Spark Audit test run with that label has completed, a run card with a summary of the latest data for that run is displayed on that node.
The information displayed includes:
- The label associated with the audit test run.
- The current pass percentage status of the test run.
- The lowest score for the following categories in the test run
- Performance
- Accessibility
- Best Practices
- SEO
- The completion status of the test run.
- In Progress
- Test Complete
- Abandoned
- How long since the last test result was received by Halo.
Run View
Latest Scenarios Widget
The 'Latest Scenarios' widget displays the audit scenario test statuses for the test run.
The information displayed includes:
- A breakdown of scenarios by status.
- The number of checks completed in the test run.
- The completion status of the test run.
- In Progress
- Test Complete
- Abandoned
Latest Scores Widget
The 'Latest Scores' widget displays a summary of the lowest scores for each category from all Lighthouse checks in the test run.
The information displayed also includes:
- A description of the thresholds used in the display of the scores.
- How long since the last test result was received by Halo.
Scenarios Widget
The 'Scenarios' widget displays completed scenarios in the test run broken down by status.
The statuses are defined as follows:
- Failed - Scenario checks have returned Lighthouse recommendations
- Error - Some scenario checks may not have been completed due to an exception or functional failure
- Passed - Scenario checks have not returned any Lighthouse recommendations
- Skipped - No Lighthouse checks were performed
Each scenario under the Failed and Error statuses will display the following information:
- The scenario name
- The number of Lighthouse checks performed in the scenario.
- A breakdown of recommendations by category - Performance, Accessibility, Best Practices and SEO.
Each scenario under the Passed status will display the following information:
- The scenario name
- The number of Lighthouse checks performed in the Scenario.
Run Trends Widget
The 'Run Trends' widget displays the trend of scores by category across the test runs that are displayed in the run history table.
Hovering over a specific run will display a breakdown of scores by category for that run.
Run History Table
The 'Run History' table displays summary information on previously completed audit test runs.
Clicking on a run will update the currently displayed dashboard with the historic test run information.
Selecting the 'Next' button will update the run history table with the next most recent test runs. This will also update the data displayed in the run trends widget.
The information displayed includes:
- The ID of the test run in Halo.
- A breakdown of scores by category.
- How long since data was last received by Halo for the test run.
Test Run Report
When a user selects a scenario from the Run View Scenarios widget, they will be taken to the lower level 'Test Run Report'.
The information displayed includes:
- The features, scenarios and steps from which lighthouse audits were executed.
- A summary table of checks that were made within each step.
- Scores by category for each check performed in each step.
- A 'label' and url for each check in each step.
When a user selects a check from the Run Report Step summary table, a detail container will open for a full explanation of the issues discovered.
For each Lighthouse check, the information displayed includes:
- Performance metrics, opportunities and diagnostics.
- Grouped Accessibility violations, Best Practices opportunities and SEO opportunities.
- Expandable sections to show detail of the opportunities.
- Links to further documentation that can be of assistance in resolving the identified issues.
Configure in Spark
To complete a lighthouse audit test run in Spark, set 'enabled' to true
and set 'source' to be lighthouse
in audits.yml.
Configure in Flare
To complete an audit test run in Flare, select Audits
and then Lighthouse
on the Configure screen.