LogoLogo
Product
  • Knowledge Base
  • What's New
  • Guides
  • User Story Coverage
    • Getting Started
    • User Story Challenges & Solution
      • Typical Implementation
      • The Challenges
      • The Solution
    • User Story Coverage Report Overview
      • Release Go / No Go Report
        • How to Generate / Edit the Report
      • User Story Quality Overview
        • How to Generate the User Story View
      • User Story Coverage Analysis
        • How to Generate the Analysis View
      • Uncovered Methods View
        • How to Generate the View
      • Customization
      • Integration
    • Use Cases by Persona
      • Managers
        • Informed Go/No Go Decisions Making
        • Effective Resources Prioritization
        • Overall Progress Monitoring
      • Developers
        • Code Quality Ownership
        • Seamless Collaboration with QA
        • Code Review Facilitator
      • QA Engineers
        • Test Execution Progress Monitoring
        • Testing Effort Prioritization
        • Testing Strategy Planing
    • Technical Overview
      • User Story Coverage Mechanism
      • Technical Architecture
      • Deployment Guide
        • US1_getResults.sh
        • US2_createReport.sh
        • US_UpdateConfluence.sh
  • Test Optimization
    • Getting Started
    • Test Execution Challenges & Solution
      • The Challenges
      • Test Optimization Solution
      • Test Optimization Main Advantages
    • Test Optimization Overview
      • Automated Test Optimization
      • Manual Test Optimization
      • Test Optimization for Pull Request
      • Test Selection Policies
        • Full Run Policy
        • No Code Changes Policy
        • Common Code Policy
        • Fastest Path to 100% Coverage Policy
      • Integrations
    • Use Cases by Persona
      • Managers
        • Fast Delivery
        • Resource Optimization
        • Thorough Testing in Tight Schedule
      • Developers
        • Exploring Only Relevant Test Failures
        • Faster Feedback Loop
        • Shift Left Testing
      • QA Engineers & Manual Testers
        • Faster & Focused Manual Testing
        • Optimizing Test Suite
        • Having Stable Product for Testing
    • Technical Overview
      • Test Optimization Mechanism
        • Associating Code With Tests
          • Statistical modeling
          • One-to-One Mapping
          • Calibration
        • Detecting Modified Code
        • Generating Test Recommendations
      • Technical Architecture
      • Deployment Guide
  • Quality Improvement
    • Getting Started
    • Challenges & Approach Comparison
      • The Challenges
      • Quality Improvement Approaches
      • Choosing the Right Approach
    • Quality Improvement Solution Overview
      • Test Gaps Analysis Report
        • How to Generate / Edit the Report
      • Coverage Trend Report
        • How to Generate / Edit the Report
      • Proof of Testing Report
        • How to Generate / Edit the Report
      • Release Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize Code Areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Threshold
        • STEP 5: Analyze Test Gaps
        • STEP 6: Write Tests
        • Step 7: Make a Go / No Go Decision Based on Quality Gate
        • STEP 8: Measure Defect Escape Rate
      • Over Time Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize code areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Goal
        • STEP 5: Set timeline
        • STEP 6: Write tests
        • STEP 7: Monitor progress
        • STEP 8: Measure Defect Escape Rate
    • Use Cases by Persona
      • Managers
        • Effective Prioritization & Budget Allocation
        • Tracking Progress & Measuring Impact
        • Data-Driven Release Decisions
        • Transparency & Communication
      • Developers
        • Mastering Code Coverage
        • Seamless Collaboration with QA
        • Code Quality Ownership
      • QA Engineers
        • Prioritizing Test Efforts
        • Contributing to Release Informed Decisions
        • Seamless Collaboration with Developers
        • Evaluating Testing Strategy
    • Technical Overview
      • Solution Mechanism
      • Technical Architecture
      • Deployment Guide
  • Value Proposition
    • Overview
    • Quality Use Cases
      • Go/No Go Decisions
      • Quality Improvement & Test Gaps
      • Governance & Quality Gates
      • Compliance & Proof of Testing
    • Test Optimization Use Cases
      • Reduce Costs & Infrastructure
      • Shorten Release Cycles
      • Reduce Troubleshooting
Powered by GitBook
On this page

Was this helpful?

  1. Test Optimization
  2. Use Cases by Persona
  3. QA Engineers & Manual Testers

Optimizing Test Suite

Test optimization empowers QA engineers and manual testers by providing improved test suite management through the "code to test list" feature. This feature enables testers to:

  • Understand test-to-code relationships: Gain clear insights into which tests are linked to specific code sections. This knowledge helps identify whether tests are still relevant to the current codebase and functionality.

  • Make informed decisions: Based on the code-to-test list, testers can assess whether individual tests require:

    • Adjustment: If code changes have altered functionalities or impacted areas previously covered by a test, the test might need adjustments to remain relevant.

    • Removal: If code sections associated with a test are no longer part of the codebase or have been drastically modified, the test might be obsolete and can be removed for optimal test suite efficiency.

  • Maintain optimal test coverage: By analyzing the code-to-test list and strategically adjusting or removing tests, testers can ensure their test suite stays relevant, up-to-date, and effective in covering critical functionalities.


Step-by-Step Tutorial

1. Utilize the "Code to Test List" Feature
  • On Test Optimization summary page, select the relevant app and date range.

  • Click on the relevant test stage you want to review.

  • Go to Builds, select the build with the code changes you want to explore and click Code to Test Mapping

  • Utilize the "code to test list" feature to identify all tests linked to those specific code changes.

  • Download as CSV file, for easier investigation.

2. Evaluate Test Relevance

For each listed test, carefully analyze its functionality and assess its continued relevance to the modified code sections.

3. Make Informed Decisions

Based on your analysis, determine whether each test:

  • Needs adjustment: If the test needs modification to reflect the code changes, document the necessary adjustments and work with developers to implement them.

  • Can be removed: If the test is deemed irrelevant due to code changes or functionality removal, initiate the process for its removal from the test suite, ensuring proper documentation and stakeholder communication.

4. Maintain Test Suite Documentation

Update your test suite documentation to reflect any adjustments or removals made based on the analysis of the code-to-test list.

By leveraging the "code to test list" feature, test optimization empowers testers to become proactive in managing their test suite, ultimately contributing to efficient, relevant, and high-quality testing processes.

PreviousFaster & Focused Manual TestingNextHaving Stable Product for Testing

Was this helpful?