LogoLogo
Product
  • Knowledge Base
  • What's New
  • Guides
  • Welcome!
  • Intro to SeaLights
    • What is SeaLights
      • Glossary
      • Working in Conjunction with Your Quality / Coverage Tools
        • SeaLights vs SonarQube
        • SeaLights vs JaCoCo
    • Technical Overview
      • Test Stage Cycle
    • FAQ
  • User Story Coverage
    • Getting Started
    • User Story Challenges & Solution
      • Typical Implementation
      • The Challenges
      • The Solution
    • User Story Coverage Report Overview
      • Release Go / No Go Report
        • How to Generate / Edit the Report
      • User Story Quality Overview
        • How to Generate the User Story View
      • User Story Coverage Analysis
        • How to Generate the Analysis View
      • Uncovered Methods View
        • How to Generate the View
      • Customization
      • Integration
    • Use Cases by Persona
      • Managers
        • Informed Go/No Go Decisions Making
        • Effective Resources Prioritization
        • Overall Progress Monitoring
      • Developers
        • Code Quality Ownership
        • Seamless Collaboration with QA
        • Code Review Facilitator
      • QA Engineers
        • Test Execution Progress Monitoring
        • Testing Effort Prioritization
        • Testing Strategy Planing
    • Technical Overview
      • User Story Coverage Mechanism
      • Technical Architecture
      • Deployment Guide
        • US1_getResults.sh
        • US2_createReport.sh
        • US_UpdateConfluence.sh
  • Test Optimization
    • Getting Started
    • Test Execution Challenges & Solution
      • The Challenges
      • Test Optimization Solution
      • Test Optimization Main Advantages
    • Test Optimization Overview
      • Automated Test Optimization
      • Manual Test Optimization
      • Test Optimization for Pull Request
      • Test Selection Policies
        • Full Run Policy
        • No Code Changes Policy
        • Common Code Policy
        • Fastest Path to 100% Coverage Policy
      • Integrations
    • Use Cases by Persona
      • Managers
        • Fast Delivery
        • Resource Optimization
        • Thorough Testing in Tight Schedule
      • Developers
        • Exploring Only Relevant Test Failures
        • Faster Feedback Loop
        • Shift Left Testing
      • QA Engineers & Manual Testers
        • Faster & Focused Manual Testing
        • Optimizing Test Suite
        • Having Stable Product for Testing
    • Technical Overview
      • Test Optimization Mechanism
        • Associating Code With Tests
          • Statistical modeling
          • One-to-One Mapping
          • Calibration
        • Detecting Modified Code
        • Generating Test Recommendations
      • Technical Architecture
      • Deployment Guide
  • Quality Improvement
    • Getting Started
    • Challenges & Approach Comparison
      • The Challenges
      • Quality Improvement Approaches
      • Choosing the Right Approach
    • Quality Improvement Solution Overview
      • Test Gaps Analysis Report
        • How to Generate / Edit the Report
      • Coverage Trend Report
        • How to Generate / Edit the Report
      • Proof of Testing Report
        • How to Generate / Edit the Report
      • Release Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize Code Areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Threshold
        • STEP 5: Analyze Test Gaps
        • STEP 6: Write Tests
        • Step 7: Make a Go / No Go Decision Based on Quality Gate
        • STEP 8: Measure Defect Escape Rate
      • Over Time Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize code areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Goal
        • STEP 5: Set timeline
        • STEP 6: Write tests
        • STEP 7: Monitor progress
        • STEP 8: Measure Defect Escape Rate
    • Use Cases by Persona
      • Managers
        • Effective Prioritization & Budget Allocation
        • Tracking Progress & Measuring Impact
        • Data-Driven Release Decisions
        • Transparency & Communication
      • Developers
        • Mastering Code Coverage
        • Seamless Collaboration with QA
        • Code Quality Ownership
      • QA Engineers
        • Prioritizing Test Efforts
        • Contributing to Release Informed Decisions
        • Seamless Collaboration with Developers
        • Evaluating Testing Strategy
    • Technical Overview
      • Solution Mechanism
      • Technical Architecture
      • Deployment Guide
  • Features
    • Coverage Dashboard
    • Coverage Report
    • Test Gaps Report
      • Code Changes Calculation
        • Hidden Changes Detection
    • Test Optimization - Savings Breakdown
      • TIA Configuration
    • Settings
      • Token Access & Management
      • Quality Gates
Powered by GitBook
On this page
  • Navigating the Hierarchy
  • Understanding Coverage Data
  • Filtering for Focused Analysis
  • Coverage Modes
  • Downloading the Report for Further Exploration
  • Ignored Methods

Was this helpful?

  1. Features

Coverage Report

PreviousCoverage DashboardNextTest Gaps Report

Last updated 10 months ago

Was this helpful?

New Coverage Report Design Available!

We've redesigned the Coverage Report to be more intuitive and user-friendly, while still offering all the features you know and love.

The Coverage Report empowers you to analyze your code coverage in meticulous detail. It provides a hierarchical view, encompassing your entire codebase structure, from the application level down to individual methods. This comprehensive report enables you to identify areas requiring additional testing focus and tailor your testing strategy accordingly.

Navigating the Hierarchy

The Coverage Report displays the app, branch, and build you selected for analysis. It then presents a hierarchical breakdown of your codebase, including:

  • Application Level: This is the highest level in the hierarchy, representing your entire application.

  • File Level: Delve deeper to see individual files within your application.

  • Method Level: This is the most granular level, allowing you to examine the coverage of each method within a file.

Understanding Coverage Data

At each level within the hierarchy, the Coverage Report displays aggregated coverage data. This data reflects the overall contribution of all executed test stages to the coverage at that specific level.

  • Overall Coverage: This value represents the percentage of methods within the current level that have been exercised by at least one test stage in the selected build.

  • Method-Level Coverage Details: By drilling down to a specific method within the report, you'll gain insights into how each test stage has interacted with that method. This detailed view indicates whether the method was covered by each individual test stage and the overall status across all test stages (covered / uncovered).

Filtering for Focused Analysis

The Coverage Report offers filtering capabilities to tailor your analysis to specific needs. You can choose to focus on a particular set of test stages, enabling you to:

  • Exclude Unit Tests: By excluding unit tests from the filter, you can obtain a more comprehensive picture of your integration and higher-level testing effectiveness. This filtered "relative coverage" provides valuable insights into areas beyond basic unit-level testing.

Coverage Modes

The report allows you to visualize coverage data in two distinct modes:

  • Overall Coverage: This mode presents the coverage data for all methods within your chosen app/branch/build, regardless of code modifications.

  • Code Changes Coverage: This mode focuses specifically on methods that have been modified since a designated "Reference Build." This allows you to prioritize testing efforts on recently changed sections of your codebase.

Downloading the Report for Further Exploration

The Coverage Report provides the option to download the data as a CSV file. This downloadable file offers flexibility for further analysis and manipulation using external tools. You can leverage this CSV file for tasks such as:

  • Identifying Critical Methods: Flag methods that require additional testing focus.

  • Adding Comments: Annotate specific methods within the CSV file to enhance collaboration and knowledge sharing within your development team.

  • Advanced Filtering: Utilize the capabilities of spreadsheet software to apply advanced filtering criteria and uncover deeper insights from the coverage data.

Ignored Methods

By default, the Coverage Report excludes methods marked as "ignored" within your codebase configuration. However, you have the option to include these ignored methods if needed for a more comprehensive analysis.

🎉
Coverage Dashboard
Code Hierarchy
Selecting Test Stages to Include in the Report
Switching between Coverage Modes