This feature is available only to customers who have provided consent to the usage of SnowFlake database. To learn more please contact Customer Success. |
|---|
Below you’ll find answers to the questions we get asked the most about Quality Analytics.
| Expand |
|---|
| title | Why can't I see the Quality Analytics tab in my SeaLights dashboard? |
|---|
|
In order to benefit from the Quality Analytics feature, you must first provide consent to the usage of SnowFlake database. Please contact Customer Success in order to get more information and advance the process. |
| Expand |
|---|
| title | I created a report, but it is empty. Why can't I see any data on my charts? |
|---|
|
There might be a few reasons for that: When you are viewing a coverage trend report with 'All Builds' and an interval longer or equal to the date range (e.g 1 month interval on date range of 3 weeks). When you are viewing a group coverage trend report with an interval longer or equal to the date range (e.g 1 month interval on date range of 3 weeks). When you are viewing a coverage trend report with 'Reference Builds' and there is only one build selected. When no builds were found in the selected date range.
|
| Expand |
|---|
| title | Is it possible that some interval points on the charts have no data? |
|---|
|
Yes, when no builds were found for a specific interval point, these interval points will be presented in the x-axis but will be skipped on the chart line (chart line will become a dotted line).
Same goes when looking at the Modified Coverage chart, in group trend report and in covergae coverage trend report (whether on ‘All Builds' mode or 'Reference Builds’ mode), and there were no code changes on one interval / reference build. |
...
| Expand |
|---|
| title | Is the coverage calculated like in the TGA report? |
|---|
|
On coverage trend report > 'Reference Builds’ mode the calculation is similar to the Dashboard calculation, when comparing between two builds. On coverage trend report > ‘All Builds' mode, and on group coverage report, the calculation of each one of the intervals is similar to the TGA calculation. The main difference is that the quality analytics reports include multiple intervals.  |
| Expand |
|---|
| title | Does deselection deselecting a test stage in a trend report remove its coverage from the aggregated coverage? |
|---|
|
Yes. Deselecting a test stage in a trend report removes the test stage line from the chart and deducts the test stage data from the aggregated coverage line. |
| Expand |
|---|
| title | Why are there are drops in the overall coverage? |
|---|
|
If you are using the TIA tool when running your test suites, you should expect drops in the overall coverage whenever TIA was ON and recommended running only a subset of your tests. The drops mean that your coverage was temporarily lower than usual. |
| Expand |
|---|
| title | How do I define a reference build? |
|---|
|
You can easily set a build as a reference build on the Dashboard. When hovering over any of the builds in the list, a flag icon appears on the right side. Clicking this icon will set the build to be a reference build. Or you can use our APIs to do it automatically. |