ISTQB_TEST MANAGEMENT_1.5 Improving the Test Process_1.5.3 Analytical-Based Test Process Improvement Approach

 

Topic	Explanation
Approach Type	Analytical – based on project/team-specific data
Data Types	- Quantitative (metrics, defect counts, trends)- Qualitative (discussed in Section 1.5.4 – Retrospectives)
Main Goal	Identify problems based on actual data and derive specific improvements
Can Be Combined With	Model-based approach (to enhance reliability of results and provide additional insight)
Focus	Effectiveness, efficiency, predictability of test process
Popular Techniques	- Root Cause Analysis- Measures, Metrics, Indicators- GQM (Goal-Question-Metric)
Root Cause Analysis	Identifies underlying causes of defects using Ishikawa (fishbone) diagrams and defect clustering
GQM Framework	- Goal: What to improve?- Question: What to ask to assess the goal?- Metric: What to measure to answer the question?
Key Attributes Measured	- Effectiveness (e.g., defect detection rate)- Efficiency (e.g., test cases executed/time)- Predictability (e.g., variance)

Analytical-Based Test Process Improvement│├── Based on Project Data│   ├── Quantitative (metrics, defects)│   └── Qualitative (via retrospectives - next section)│├── Key Techniques│   ├── Root Cause Analysis│   │   ├── Defect Clustering│   │   └── Ishikawa (Fishbone) Diagrams│   ├── Metrics & Indicators│   │   ├── Effectiveness│   │   ├── Efficiency│   │   └── Predictability│   └── GQM Approach│       ├── Goal → What to improve│       ├── Question → From stakeholders’ view│       └── Metric → Data to answer questions│└── Used for    ├── Identifying process weaknesses    ├── Defining measurable improvements    └── Supporting decisions with data

Q1. A test manager notices repeated defects from different modules. They use a fishbone diagram to analyze causes. Which technique are they applying?
A. Metrics-based analysis
B. GQM approach
C. Root Cause Analysis
D. Risk-based testing
✅ Answer: C

---

Q2. What is the key difference between model-based and analytical-based test process improvement?
A. Model-based relies on team feedback, analytical doesn’t
B. Analytical uses internal data; model-based uses external best practices
C. Model-based is Agile-only
D. Analytical doesn’t require data collection
✅ Answer: B

---

Q3. Which approach is most useful when a manager wants to know how well the test process performs in terms of efficiency?
A. GQM
B. Defect taxonomies
C. Static review
D. Exploratory testing
✅ Answer: A

---

Q4. Which aspect of testing would most likely be improved by analyzing defect root causes?
A. Regression cycle duration
B. Test coverage expansion
C. Prevention of recurring bugs
D. Load testing scripts
✅ Answer: C

---

Q5. In the GQM method, which step comes after defining a goal?
A. Select metrics
B. Visualize defects
C. Ask questions related to the goal
D. Conduct brainstorming
✅ Answer: C

Q1. What is the primary objective of analytical-based test process improvement?
A. Align with CMMI
B. Reduce test tool costs
C. Identify process issues using internal project data
D. Compare to external testing maturity benchmarks
✅ Answer: C

---

Q2. Which technique uses a fishbone diagram to determine underlying test problems?
A. Metrics analysis
B. Regression testing
C. Root cause analysis
D. Exploratory review
✅ Answer: C

---

Q3. What type of data is mostly used in analytical-based improvement?
A. Only qualitative
B. Quantitative metrics and defect logs
C. Industry best practices
D. External test results
✅ Answer: B

---

Q4. In the GQM framework, what role does the "Question" play?
A. Chooses the test cases
B. Explains process risks
C. Translates the goal into measurable terms
D. Eliminates subjective feedback
✅ Answer: C

---

Q5. Which metric would best indicate the efficiency of a test process?
A. Number of test policies
B. Test cases executed per hour
C. Number of test team members
D. Size of the requirements document
✅ Answer: B

---

Q6. A team defines the goal of reducing late defect leakage. They ask, “Where are late defects being introduced?” and measure defect origin. This is:
A. TPI NEXT
B. Exploratory testing
C. GQM
D. Checkpoint modeling
✅ Answer: C

---

Q7. Which attribute is not directly measured by analytical approaches like GQM?
A. Predictability
B. Effectiveness
C. Efficiency
D. Motivation
✅ Answer: D

---

Q8. What benefit does combining model-based and analytical-based approaches provide?
A. Simpler automation
B. Replaces need for retrospectives
C. Data validation and comprehensive insight
D. Eliminates the need for stakeholder input
✅ Answer: C

---

Q9. What would be the first step in a root cause analysis of defect data?
A. Deploy a tool
B. Group defects into clusters
C. Review code coverage
D. Compare to benchmarks
✅ Answer: B

---

Q10. Which of these is true about metrics, measures, and indicators in analytical testing improvement?
A. They replace the need for GQM
B. They are subjective interpretations
C. They help assess effectiveness, efficiency, and predictability
D. They are used only in Agile
✅ Answer: C