LogoLogo
Product
  • Knowledge Base
  • What's New
  • Guides
  • User Story Coverage
    • Getting Started
    • User Story Challenges & Solution
      • Typical Implementation
      • The Challenges
      • The Solution
    • User Story Coverage Report Overview
      • Release Go / No Go Report
        • How to Generate / Edit the Report
      • User Story Quality Overview
        • How to Generate the User Story View
      • User Story Coverage Analysis
        • How to Generate the Analysis View
      • Uncovered Methods View
        • How to Generate the View
      • Customization
      • Integration
    • Use Cases by Persona
      • Managers
        • Informed Go/No Go Decisions Making
        • Effective Resources Prioritization
        • Overall Progress Monitoring
      • Developers
        • Code Quality Ownership
        • Seamless Collaboration with QA
        • Code Review Facilitator
      • QA Engineers
        • Test Execution Progress Monitoring
        • Testing Effort Prioritization
        • Testing Strategy Planing
    • Technical Overview
      • User Story Coverage Mechanism
      • Technical Architecture
      • Deployment Guide
        • US1_getResults.sh
        • US2_createReport.sh
        • US_UpdateConfluence.sh
  • Test Optimization
    • Getting Started
    • Test Execution Challenges & Solution
      • The Challenges
      • Test Optimization Solution
      • Test Optimization Main Advantages
    • Test Optimization Overview
      • Automated Test Optimization
      • Manual Test Optimization
      • Test Optimization for Pull Request
      • Test Selection Policies
        • Full Run Policy
        • No Code Changes Policy
        • Common Code Policy
        • Fastest Path to 100% Coverage Policy
      • Integrations
    • Use Cases by Persona
      • Managers
        • Fast Delivery
        • Resource Optimization
        • Thorough Testing in Tight Schedule
      • Developers
        • Exploring Only Relevant Test Failures
        • Faster Feedback Loop
        • Shift Left Testing
      • QA Engineers & Manual Testers
        • Faster & Focused Manual Testing
        • Optimizing Test Suite
        • Having Stable Product for Testing
    • Technical Overview
      • Test Optimization Mechanism
        • Associating Code With Tests
          • Statistical modeling
          • One-to-One Mapping
          • Calibration
        • Detecting Modified Code
        • Generating Test Recommendations
      • Technical Architecture
      • Deployment Guide
  • Quality Improvement
    • Getting Started
    • Challenges & Approach Comparison
      • The Challenges
      • Quality Improvement Approaches
      • Choosing the Right Approach
    • Quality Improvement Solution Overview
      • Test Gaps Analysis Report
        • How to Generate / Edit the Report
      • Coverage Trend Report
        • How to Generate / Edit the Report
      • Proof of Testing Report
        • How to Generate / Edit the Report
      • Release Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize Code Areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Threshold
        • STEP 5: Analyze Test Gaps
        • STEP 6: Write Tests
        • Step 7: Make a Go / No Go Decision Based on Quality Gate
        • STEP 8: Measure Defect Escape Rate
      • Over Time Quality Improvement Guide
        • STEP 1: Deploy SeaLights
        • STEP 2: Take a Quality Snapshot
        • STEP 3: Prioritize code areas
          • Add Code Labels
          • Ignore Irrelevant Code
          • Perform a Deep CSV Analysis
        • STEP 4: Set Baseline & Goal
        • STEP 5: Set timeline
        • STEP 6: Write tests
        • STEP 7: Monitor progress
        • STEP 8: Measure Defect Escape Rate
    • Use Cases by Persona
      • Managers
        • Effective Prioritization & Budget Allocation
        • Tracking Progress & Measuring Impact
        • Data-Driven Release Decisions
        • Transparency & Communication
      • Developers
        • Mastering Code Coverage
        • Seamless Collaboration with QA
        • Code Quality Ownership
      • QA Engineers
        • Prioritizing Test Efforts
        • Contributing to Release Informed Decisions
        • Seamless Collaboration with Developers
        • Evaluating Testing Strategy
    • Technical Overview
      • Solution Mechanism
      • Technical Architecture
      • Deployment Guide
  • Value Proposition
    • Overview
    • Quality Use Cases
      • Go/No Go Decisions
      • Quality Improvement & Test Gaps
      • Governance & Quality Gates
      • Compliance & Proof of Testing
    • Test Optimization Use Cases
      • Reduce Costs & Infrastructure
      • Shorten Release Cycles
      • Reduce Troubleshooting
Powered by GitBook
On this page

Was this helpful?

  1. User Story Coverage
  2. Use Cases by Persona
  3. QA Engineers

Test Execution Progress Monitoring

PreviousQA EngineersNextTesting Effort Prioritization

Was this helpful?

Transform into a proactive testing champion with the User Story Coverage Report. Monitor and analyze test execution progress, identifying roadblocks early and advocating for comprehensive testing throughout the development cycle. Ensure no area lags behind schedule or coverage targets.


Step-by-Step Tutorial

1. Access User Story's Coverage
  • Open the releveant user story view in Jira and navigate to the "Coverage" tab. Note: If the tab is missing, the user story deployment isn't complete. Refer to theDeployment Guide for further details.

2. Gauge Overall & Specific Test Type Coverage
  • Check the "Modified Coverage" and "Non-Unit Tests Coverage" indicators.

    • Green overall? Great! But proceed if testing hasn't completed, or critical features are involved.

    • Orange or red overall?: Investigate further!

  • Examine individual test types: Identify areas needing attention based on organizational standards.

3. Deep Dive into Uncovered Methods
  • Use the "Uncovered Methods Report" to quickly review untested methods.

  • Pro Tip: Even with green overall coverage, crucial methods might lack testing. Review critically.

4. Identify & Address Gaps
  • Start with the Uncovered Modified Methods.

    • Review the methods completely lacking tests.

    • Estimate missing scenarios: Consider what testing might be missing.

  • Continue with the specific test types lists.

    • Review untested methods within each test type. Pay close attention to orange (unit test only) and red (no test) methods.

    • Estimate missing scenarios: Consider what testing might be missing.

    • Leverage parent subtask context: If a method's purpose is unclear, refer to its parent subtask for broader context and understanding. This will help you formulate more relevant test scenarios.

5. Collaborate & Take Action
  • Discuss with developers to understand method functionality and criticality.

  • Collaborate to decide which test type is appropriate for the uncovered method.

  • Prioritize: Address critical gaps first, ensuring comprehensive testing throughout the development cycle.

Remember: This framework serves as a foundation. Adapt it to your specific organizational needs, testing strategies, development cycles, and resource availability.