ISTQB_Managing the Product_2.1 Test Metrics_TM-2.1.2 (K2) Explain how to control test progress using test metrics

 

Concept Description Example
Test Monitoring Activity of collecting and evaluating test data to assess progress and exit criteria fulfillment. Daily status reports showing % of test cases executed and passed.
Test Control Corrective actions based on test monitoring. Used to guide testing back on track. Adding resources if tests fall behind schedule; adjusting priorities based on critical bug found.
Test Completion Final wrap-up activities post-testing, including lessons learned, testware archiving, metrics review. Conducting a retrospective after an iteration and documenting improvements.
Exit Criteria Specific conditions derived from test objectives that must be met to declare testing complete. “95% test coverage achieved” or “all critical defects closed”.
Metrics Used Progress, budget adherence, test case execution rate, defect density, requirement coverage, risk coverage. 70% test cases passed, 90% budget consumed, defect density = 3 defects/KLOC.
When Applied Throughout the project life cycle: after each test level, iteration, release, or project closure. After UAT phase, before release, in sprint retrospectives.


Monitoring, Control & Completion
├── Test Monitoring
│   ├── Collect test progress data
│   ├── Track exit criteria
│   └── Analyze status & effectiveness
├── Test Control
│   ├── React to risks or delays
│   ├── Adjust priorities/schedule
│   ├── Add/remove resources
│   └── Re-evaluate criteria
└── Test Completion
    ├── Final reports
    ├── Lessons learned
    ├── Archive test ware
    └── Metrics evaluation


Q1 (K2):
You are managing the system test phase. 85% of the tests are executed, but many medium severity defects are still open. Exit criteria say "All high and medium severity defects must be closed." What should you do?
A. Close the test phase
B. Continue testing until all tests are executed
C. Apply test control to address defect closure
D. Ignore the defects if they are not critical

Answer: C


Q2 (K3):
The test environment was delivered 5 days late, affecting your execution timeline. What’s a valid control action?
A. Reduce test coverage
B. Add test resources or extend the schedule
C. Postpone defect fixing
D. Skip regression testing

Answer: B


Q3 (K3):
Your exit criteria includes “Defect leakage should be below 5%.” After release, users report 20 defects out of 300 tested scenarios. 12 of these were missed by QA. How should you respond?
A. Close the project; metrics are irrelevant
B. Revise the criteria retroactively
C. Use the data for test improvement analysis
D. Blame development team

Answer: C
🧠 Calculation Tip: 12/300 = 4% leakage < 5% ✅


Q4 (K2):
Which of the following is a valid monitoring metric?
A. Effort variance
B. % test cases passed
C. % rework due to defects
D. Lessons learned from post-mortem

Answer: B


Q5 (K3):
In an Agile sprint, testing falls behind due to an unexpected tool crash. The team reassigns some Dev members to help testers. This is an example of:
A. Monitoring
B. Planning
C. Control action
D. Retrospective

Answer: C



Question 1 (K2):

What is the purpose of test completion activities?
A. Allocate test cases to testers
B. Finalize automation scripts
C. Gather lessons learned, summarize metrics, archive assets
D. Define new requirements for next release
Answer: C


Question 2 (K3):

You’re leading testing for a regulatory product. A delay in regulatory approval postponed one of your critical environments. As a test manager, what control measure is most appropriate?
A. Skip performance testing
B. Run manual tests only
C. Update the test schedule and align test dependencies
D. Restart the test cycle

Answer: C


Question 3 (K4):

Scenario: Your project exit criteria define 98% test case execution and all P1 defects fixed. Metrics show 96% executed and one P1 defect is deferred due to complexity. Management insists on release. What is the best approach?
A. Release as per schedule
B. Escalate to stakeholders and recommend delay
C. Re-define exit criteria quickly
D. Mark defect as P2 to match exit condition

Answer: B
🧠 Rationale: Ethical and risk-aware decision making (K4 level)


Question 4 (K3):

A critical test environment is down due to hardware failure. Monitoring report shows only 40% of regression tests are complete. What control action is least effective?
A. Report status with red flag
B. Assign additional testers
C. Wait for the environment to be fixed
D. Shift some tests to a backup environment

Answer: C


Question 5 (K2):

Which one is a test control activity?
A. Generating test logs
B. Monitoring defect trends
C. Adjusting test scope
D. Archiving test cases

Answer: C


Question 6 (K3):

You’ve collected all completion metrics and are closing a release. What should you not forget?
A. Delete all old test cases
B. Share final test summary
C. Document lessons learned
D. Archive testware

Answer: A


Question 7 (K4):

Scenario: An iteration goal was 100% regression coverage, but monitoring reports only show 75% due to delays. How should you approach control?
A. Cancel the release
B. Revise the test goal to 75%
C. Review test priorities and cover high-risk areas first
D. Request deadline extension without explanation

Answer: C


Question 8 (K2):

Which metric shows progress against the schedule?
A. Code coverage
B. Test case execution rate
C. Defect leakage
D. Test summary report

Answer: B


Question 9 (K3):

The team meets exit criteria, but customer wants more security tests added last minute. What is your best action?
A. Reject the request
B. Update scope and revisit control metrics
C. Delay UAT by a week
D. Pass testing to developers

Answer: B


Question 10 (K4):

Scenario: A project failed due to late identification of performance issues. What test completion activity could have prevented recurrence?
A. Shorter iterations
B. More user stories
C. Performance test early, and include lessons in retrospective
D. Remove performance testing from scope

Answer: C


No comments:

Post a Comment

Lets Start...............

Cypress

Syllabus Q & A Set -1 Q & A Set -2