This feature is available only to customers who have provided consent to the usage of SnowFlake databases. To learn more please contact Customer Success. |
|---|
The Group Coverage Trend Report is the second report type available under Quality Analytics. It displays multiple apps code coverage over time.
Generating A Report
From the Quality Analytics main page / reports list, click on the “Create new report” button. Generating a report is as simple as selecting the apps and branches you are interested in. Each app has its own color that is used in the charts.
You have different options to view the data:
Date Range
The popular options available are: Last month, Last 2 months, Last 3 months, Last 6 months, Last year.
If none of the above is what you need, you can always select a custom date range. We recommend a minimum of 4 weeks.
Interval
You can select in which intervals you would like to aggregate the data. Options are: 1 week, 2 weeks, 3 weeks, 4 weeks, 1 month.
Understanding The Data
The report includes two charts: Modified Coverage and Overall Coverage.
Both charts display an aggregated coverage on top of the specific apps coverage and include:
Y-axis: Coverage % (0-100%)
X-axis: Time, according to the filter selection and intervals
Intervals
When selecting any of the interval options (1 week, 2 weeks, 3 weeks, 4 weeks, or 1 month) any point in the X-axis and in the chart line represents an interval. Interval X takes all code changes from the last build in interval X-1, and takes all coverage from all related test stages that were reported in all builds within interval X. (e.g. Interval of 1 month: coverage in July means all code changes since last build on June and their coverage from all test stages executions reported on builds within July).
Modified Coverage Chart
Modified coverage is the coverage of your code changes. Why is it important to track it? Your quality risks are code changes you haven’t tested. The higher the coverage, the lower the chances for escaping defects. You want to see high coverage overtime, to reduce risks. High modified coverage overtime is an indication for a good quality culture. It means that any new or modified code is tested.
Overall Coverage Chart
Overall coverage is the coverage of your entire code. You should track the overall coverage to make sure that overtime your trend is positive, mainly by covering new and modified code. You might see drops in cases you had major code changes with no coverage.
Advanced Report Features
Drill-Down To A Specific App Coverage Trend Report
When reviewing the data included in a group trend report, you might need to drill down to a certain app level in order to examine which test stages contributed to its coverage. In order to quickly view the wanted report click on the “Open report” button from the right legend panel.
Number Of Methods
When examining your group coverage trend, seeing the data in the right context is important. To that end we have added an option to visualize the scope of the change in the modified chart and the scope of the apps that are examined in the overall chart. To add the methods bar to your charts, click on the “Chart elements” and toggle on the “Number of methods” option.
Automatic Insights
We provide automatic insights in order to help you identify quality risks. Our first insight alerts when large modification took place in a certain app, but was not covered in testing properly. When these incidents are captured, an “INSIGHTS” button will appear near the chart and will include an indication of the number of found insights. When hovering over the chart, a matching indication will be displayed for the relevant interval / build. Clicking on the “INSIGHTS” button, all insights details will appear above the chart, as can be seen in the image below.
Sharing The Report
After generating a report you can use the share button to copy the report URL to you clipboard or to publish the report as a public report that will be available to all users.
Using the copied URL, other users will be able to view and work with a draft report that includes the same configuration as the report you were sharing.
When publishing a report as a public report, all users will be able to view that report from their reports list view. It’s a great way to share the report with others in your organization.
Got questions? Visit our Quality Analytics FAQ page.