ISTQB CT-TAE – Certified Tester Test Automation Engineer — Question 7

The Test Automation Manager has asked you to provide a solution for collecting metrics from the TAS that measures code coverage every time the automated regression test pack is run. The metrics must be trend based to ensure that the scope of the regression test pack continues to reflect enhancements made to the SUT - coverage must not drop and should ideally increase. The solution must be as automated as possible to avoid unnecessary manual overheads and errors.
Which of the following approaches would BEST meet these requirements?

Answer options

• A. Test automation cannot measure code coverage for the SUT, only the code for the automation tools and scripts. The automated test cases would need to be run manually with a code coverage and reporting tool running in the background.
• B. The automated testware would record overall code coverage for each run and add the figure to a new row in a pre-formatted Excel spreadsheet. You would then present the spreadsheet to stakeholders so they could look for changes in coverage.
• C. The automated testware would record overall code coverage for each run, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis bar chart for you to distribute to stakeholders.
• D. The automated testware would record the pass/fail rate of each regression test case, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis success rate bar chart and emails it to stakeholders.

Correct answer: C

Explanation

Option C is correct because it not only records the code coverage for each run but also automates the process of updating a trend analysis chart, which meets the requirements for automation and trend-based metrics. Option A is incorrect as it states that test automation cannot measure code coverage for the SUT, and Option B lacks the automation of a visual trend analysis, while Option D focuses on pass/fail rates instead of code coverage.