Savings Breakdown: Tests Tab Enhancements
Last updated
Was this helpful?
Last updated
Was this helpful?
Was this helpful?
We're excited to roll out significant enhancements to the SeaLights "Tests" tab, which you can find on the Test Optimization - Savings Breakdown page. These updates are designed to give you a clearer, more actionable understanding of your test execution data, focusing on improving visibility into test performance, simplifying TIA insights, and streamlining your overall experience.
We've introduced new columns and refined existing ones to provide more granular and intuitive test information.
A brand-new "Duration" column has been added to the "Tests" table, offering precise insights into how long individual tests take to run.
Executed Tests: Shows the total execution duration for passed or failed tests.
Failed Tests: Displays the actual duration of the test run up to the point of failure.
Skipped Tests: Indicated by a dash (-), meaning no execution occurred.
Sortable: Easily sort tests by their duration to identify long-running or quick tests.
To make Test Impact Analysis (TIA) recommendations easier to understand, we've replaced the confusing "Run/Skipped" column with two distinct columns:
"TIA Recommendation": Indicates whether TIA recommended the test to be Run or Skip based on your policy.
"Actual Execution": Shows the actual execution status of the test as reported by the test runner (Ran or Skipped).
Both new columns are sortable, allowing you to quickly analyze TIA's impact and actual test behavior.
The "Run #" column has been renamed to "Iteration" for improved clarity and consistency.
The charts area has been completely redesigned to feature intuitive metric cards, providing quick, at-a-glance summaries.
The previous "Ran / Skipped", "Recommendation Reasons", and "Test Results" charts have been replaced by the metric cards:
Recommendation card: Displays the amount of tests recommended to run, including a horizontal bar chart visualizing recommended tests out of all tests.
A help icon provides an overlay with a list of Recommendation Reasons (e.g., Impacted Tests, Previously Failed, New Tests...) and their percentages.
Actual Execution card: Shows two distinct metrics: "Ran Tests" (count) and "Skipped Tests" (count).
Test Results card: Features a horizontal bar chart showing the percentage of Passed Tests (green) and Failed Tests (red).
We've made several UX improvements to enhance navigation and customization.
The old "Ran/Skipped" filter has been replaced by two new, precise filters: "TIA Recommendation" and "Actual Execution". These new options are also available in the "Manage Columns" menu, allowing you to show or hide the new columns as needed.
The "Tests" tab label is now cleaner, simply displaying "Tests" without the count of tests (e.g., "Tests (1234)" is now just "Tests").
Consolidated Download: We've replaced the two existing download buttons with a single "Download" button, which provides a dropdown menu for "Download Test Execution" and "Download Test Recommendations."