STEP 2: Take a Quality Snapshot

Typically, this step is done by QA Manager/Architect or Engineering Manager.

Before implementing the Over Time Quality Improvement in your organization, it's crucial to evaluate the quality of your software.

1. Get a snapshot of your current quality by looking at the Test Gaps over the past few weeks or months.

2. Examine the number of Untested Code Changes using the Test Gaps Report. This report highlights the methods within your codebase that have not been adequately tested.

By analyzing the number of Untested Code Changes, you gain a crucial understanding of your current quality baseline. This knowledge empowers you to prioritize critical areas and address them strategically in your Over Time Quality Improvement journey.

Remember: This initial snapshot is just the beginning! As you implement changes and improve your testing practices, it's essential to take regular snapshots to track your progress and ensure continuous quality enhancement.

---

Review The Test Gaps Analysis Report

How to Generate / Edit the Report

What does the time range in the report represent?

The time range in the report captures all the builds that have been reported to SeaLights within that specified range. It's important to note that the time range does not directly correspond to when the tests were executed. This means that tests can be executed outside of the specified time range, yet their coverage will still be included in the report. The time range serves as a reference point for aggregating the relevant builds and their associated test coverage data, providing a comprehensive view of your testing efforts.

Watch the video to quickly understand the key data in the report, providing you with an overview of your current status.

With your SeaLights report in hand, dive into the crucial "Overall Coverage Gap" metric. This percentage reveals the areas your tests haven't reached, indicating potential risks. Remember, it represents the missing pieces, not the total coverage.

In addition, take note of the total number of untested methods. If this number is significant, exceeding, for example, 300, consider it a red flag. It's time to prioritize!

We'll guide you through effective prioritization in the next step. For now, focus on identifying these gaps - they're the starting point for your quality improvement journey with SeaLights.

This snapshot of your code quality will serve as a starting point for your quality improvement journey with SeaLights, empowering you to incrementally achieve your quality goals over time. Understanding the quality figures will help you take targeted actions to address the gaps effectively.