LogoLogo
Product
  • Knowledge Base
  • What's New
  • Guides
  • Welcome!
  • Intro to SeaLights
    • What is SeaLights
      • Glossary
      • Working in Conjunction with Your Quality / Coverage Tools
        • SeaLights vs SonarQube
        • SeaLights vs JaCoCo
    • Technical Overview
      • Test Stage Cycle
    • FAQ
  • User Story Coverage
    • Getting Started
    • User Story Challenges & Solution
      • Typical Implementation
      • The Challenges
      • The Solution
    • User Story Coverage Report Overview
      • Release Go / No Go Report
        • How to Generate / Edit the Report
      • User Story Quality Overview
        • How to Generate the User Story View
      • User Story Coverage Analysis
        • How to Generate the Analysis View
      • Uncovered Methods View
        • How to Generate the View
      • Customization
      • Integration
    • Use Cases by Persona
      • Managers
        • Informed Go/No Go Decisions Making
        • Effective Resources Prioritization
        • Overall Progress Monitoring
      • Developers
        • Code Quality Ownership
        • Seamless Collaboration with QA
        • Code Review Facilitator
      • QA Engineers
        • Test Execution Progress Monitoring
        • Testing Effort Prioritization
        • Testing Strategy Planing
    • Technical Overview
      • User Story Coverage Mechanism
      • Technical Architecture
      • Deployment Guide
        • US1_getResults.sh
        • US2_createReport.sh
        • US_UpdateConfluence.sh
  • Test Optimization
    • Getting Started
    • Test Execution Challenges & Solution
      • The Challenges
      • Test Optimization Solution
      • Test Optimization Main Advantages
    • Test Optimization Overview
      • Automated Test Optimization
      • Manual Test Optimization
      • Test Optimization for Pull Request
      • Test Selection Policies
        • Full Run Policy
        • No Code Changes Policy
        • Common Code Policy
        • Fastest Path to 100% Coverage Policy
      • Integrations
    • Use Cases by Persona
      • Managers
        • Fast Delivery
        • Resource Optimization
        • Thorough Testing in Tight Schedule
      • Developers
        • Exploring Only Relevant Test Failures
        • Faster Feedback Loop
        • Shift Left Testing
      • QA Engineers & Manual Testers
        • Faster & Focused Manual Testing
        • Optimizing Test Suite
        • Having Stable Product for Testing
    • Technical Overview
      • Test Optimization Mechanism
        • Associating Code With Tests
          • Statistical modeling
          • One-to-One Mapping
          • Calibration
        • Detecting Modified Code
        • Generating Test Recommendations
      • Technical Architecture
      • Deployment Guide
  • Quality Improvement
    • Getting Started
    • Challenges & Approach Comparison
      • The Challenges
      • Quality Improvement Approaches
      • Choosing the Right Approach
    • Quality Improvement Solution Overview
      • Test Gaps Analysis Report
        • How to Generate / Edit the Report
      • Coverage Trend Report
        • How to Generate / Edit the Report
      • Proof of Testing Report
        • How to Generate / Edit the Report
      • Release Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize Code Areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Threshold
        • STEP 5: Analyze Test Gaps
        • STEP 6: Write Tests
        • Step 7: Make a Go / No Go Decision Based on Quality Gate
        • STEP 8: Measure Defect Escape Rate
      • Over Time Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize code areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Goal
        • STEP 5: Set timeline
        • STEP 6: Write tests
        • STEP 7: Monitor progress
        • STEP 8: Measure Defect Escape Rate
    • Use Cases by Persona
      • Managers
        • Effective Prioritization & Budget Allocation
        • Tracking Progress & Measuring Impact
        • Data-Driven Release Decisions
        • Transparency & Communication
      • Developers
        • Mastering Code Coverage
        • Seamless Collaboration with QA
        • Code Quality Ownership
      • QA Engineers
        • Prioritizing Test Efforts
        • Contributing to Release Informed Decisions
        • Seamless Collaboration with Developers
        • Evaluating Testing Strategy
    • Technical Overview
      • Solution Mechanism
      • Technical Architecture
      • Deployment Guide
  • Features
    • Coverage Dashboard
    • Coverage Report
    • Test Gaps Report
      • Code Changes Calculation
        • Hidden Changes Detection
    • Test Optimization - Savings Breakdown
      • TIA Configuration
    • Settings
      • Token Access & Management
      • Quality Gates
Powered by GitBook
On this page

Was this helpful?

  1. Intro to SeaLights
  2. What is SeaLights

Glossary

PreviousWhat is SeaLightsNextWorking in Conjunction with Your Quality / Coverage Tools

Last updated 7 months ago

Was this helpful?

This glossary defines key terms used within SeaLights to enhance your understanding of its functionalities.

Product

A collection of application components, encompassing various architectures like microservices, web applications, or monolithic backends.

Test Stage / Test Cycle

A group of tests organized to achieve specific testing objectives, often broader in scope than individual tests. Examples include regression, end-to-end, and manual tests. These stages can represent a single test type or combine multiple types executed in the same phase (e.g., nightly testing might involve both component and integration tests).

Overall (Code) Coverage

Percentage of methods tested by at least one test stage.

Modified (Code) Coverage / Code Changes Coverage

Percentage of modified methods tested by at least one test stage.

Overall Coverage Gap

Percentage of untested methods (100% - Overall Coverage).

Modified Coverage Gap

Percentage of untested modified methods (100% - Modified Coverage).

Quality Gate

Predefined quality criteria that determine if a build meets your standards. Three parameters influence the gate status:

  • New/Modified Code Coverage: Percentage of newly introduced or modified methods covered by tests.

  • Overall Code Coverage: Percentage of all methods covered by tests.

  • Failed Tests: Total number of failed tests in the current build.

Quality Risk

A modified method not covered by any test stage.

Test Gaps
  • Overall Methods: A method not covered by any test stage.

  • Modified Methods: A modified method not covered by any test stage (= Quality Risk).

Test Recommendations

As part of the Test Optimization feature, SeaLights suggests which tests to execute based on historical test runs and their correlation with current code changes.

Referenced Build

The baseline build used to calculate modified code coverage, quality risks, and quality gates. It impacts:

  1. Modified Coverage

  2. Quality Risks

  3. Quality Gates

  4. Test Recommendations

Agent

An on-premises executable provided by SeaLights, specific to a technology.

Contributors

Developers who pushed code changes to a Git-based version control system.

Environment

A set of machines or containers hosting your System Under Test (SUT).

LabID

Identifiers that allow SeaLights to connect data collected from multiple agents across various application components and test runners, consolidating them within the platform.

By understanding these terms, you can effectively navigate SeaLights and utilize its features to optimize your testing processes.