FAQ

General

What is SeaLights?

SeaLights is a continuous quality optimization platform that empowers organizations to improve software quality by offering insights into test coverage across the entire development lifecycle. It goes beyond just providing coverage metrics, but also helps optimize testing efforts by recommending which tests to run based on code changes. This allows teams to focus their testing resources efficiently and deliver high-quality software faster.

How does SeaLights work?

SeaLights utilizes two lightweight agents: a Build Scanner and a Test Listener. The Build Scanner analyzes code changes to create an intelligent map of your codebase. The Test Listener tracks test execution and identifies which tests cover specific code areas. This data is then combined and analyzed to provide actionable insights, such as overall and modified code coverage, test gaps, and recommendations for test optimization.

How does SeaLights integrate with SonarQube?

While not directly integrating, SeaLights and SonarQube can work together seamlessly. SeaLights focuses on test optimization across various test types, while SonarQube focuses on static code analysis. They provide complementary insights, offering a holistic view of software quality. Read more: Working in Conjunction with Your Quality / Coverage Tools

Coverage

Why does SeaLights provide method-level coverage and not line-level coverage?

SeaLights focuses on method-level coverage because it offers a better representation of testable units and aligns with common testing practices. Line-level coverage can be misleading due to factors like dead code and comments.

SeaLights supports unit test coverage. Isn't it the same coverage as SonarQube or JaCoCo provide?

SeaLights offers broader coverage than just unit tests. It can analyze coverage across various types of tests, including integration, API, manual, and more, providing a more comprehensive picture of your testing strategy. Read More: Working in Conjunction with Your Quality / Coverage Tools

Test Optimization

How does SeaLights optimize testing?

SeaLights analyzes code changes and identifies which tests have been impacted by those changes. It then recommends skipping tests that haven't been affected, saving time and resources. This allows teams to focus their testing efforts on areas with the highest potential for introducing defects.

What are the benefits of test optimization?

• Reduced Test Execution Time: By running only necessary tests, SeaLights can significantly decrease test execution time, allowing for faster feedback and release cycles.

• Improved Resource Efficiency: By optimizing test runs, SeaLights reduces the hardware, software and manual resources required for testing, freeing up valuable resources for other tasks.

• Increased Test Effectiveness: By focusing on tests relevant to code changes, SeaLights helps ensure that testing efforts are focused on the areas most likely to contain errors, leading to higher-quality software.

Security and Architecture

Does SeaLights access our source code?

No, SeaLights does not access your source code. It works by analyzing binary code and artifacts, uploading only metadata to its secure cloud platform. The listener running on-premise interacts with your CI and test environments only through secure uphold connections.

Do you support microservices and monolithic architectures?

Yes, SeaLights supports both microservices and monolithic architectures. It can track code changes and test execution across your entire application, including integration build groups that combine multiple microservices. SeaLights then maps this information and recommends tests based on the impacted areas.