TMMi
TMMi
Test Maturity Model Integration
1. Overview of TMMi: A Quality Framework That Diagnoses and Improves Test Process Maturity Across 5 Levels
flowchart LR
A["Ad hoc testing<br/>no standards or documentation<br/>quality is unpredictable"] --"5-level maturity<br/>systematic improvement"--> B["Standardize, measure,<br/>and optimize the test process"] --"Detect defects early<br/>reduce cost of quality"--> C["Achieve<br/>reliable SW quality"]
style A fill:#FFEBEE,stroke:#D32F2F,color:#000
style B fill:#E3F2FD,stroke:#1976D2,color:#000
style C fill:#E8F5E9,stroke:#388E3C,color:#000
Definition: A test-specific maturity model developed by the TMMi Foundation based on CMMI, which structures the software testing process into 5 maturity levels and, at each level, a set of Process Areas (PAs), providing a framework for diagnosing an organization’s current testing capability and presenting a staged improvement roadmap.
Characteristics: (Staged maturity) Adopts CMMI’s staged representation — sequential maturity growth from Level 1 to Level 5. (Comprehensive coverage) Structurally covers the entire scope of test policy, strategy, planning, design, execution, measurement, and optimization. (Linked to standards) Complementary to ISO 29119 (the software testing standard) and ISTQB.
2. Core Structure of TMMi
a. The 5-Level Maturity Model Structure
flowchart LR
L1["Level 1<br/>Initial<br/>Ad hoc & chaotic<br/>success depends on individuals"]
L2["Level 2<br/>Managed<br/>Test policy & planning<br/>project-level management"]
L3["Level 3<br/>Defined<br/>Organization-standard<br/>test process established"]
L4["Level 4<br/>Measured<br/>Quantitative measurement & control<br/>predictable quality"]
L5["Level 5<br/>Optimizing<br/>Continuous process improvement<br/>innovative test techniques"]
L1 --> L2 --> L3 --> L4 --> L5
style L1 fill:#f5f5f5,stroke:#ccc,color:#555
style L2 fill:#FFF3E0,stroke:#F57C00,color:#000
style L3 fill:#E3F2FD,stroke:#1976D2,color:#000
style L4 fill:#F3E5F5,stroke:#7B1FA2,color:#000
style L5 fill:#1E3A5F,stroke:#1E3A5F,color:#fff
Process Areas (PA) and Achievement Criteria by Level
| Level | Name | Process Areas | Key Achievement Criteria |
|---|---|---|---|
| Level 1 | Initial | None (no specific PA) | Testing is performed on an ad hoc basis |
| Level 2 | Managed | Test policy & strategy, test planning, test monitoring & control, test design & execution, test environment | Test plans are established and executed per project |
| Level 3 | Defined | Organization test process, test training program, organization test asset management, peer reviews | An organization-wide standard test process is defined and applied |
| Level 4 | Measured | Test measurement, product quality evaluation, advanced reviews | Quantitative quality management based on test KPIs |
| Level 5 | Optimizing | Defect prevention, quality control optimization, test process optimization | Continuous innovation and automation of the test process |
b. Applying Test Process Improvement
flowchart TD
subgraph R1[""]
direction LR
A1["Assessment<br/>Diagnose the current test<br/>process level based on TMMi<br/>gap analysis, derive improvement tasks"]
A2["Set target level<br/>Reflect organizational strategy<br/>staged PA achievement targets<br/>determine priorities"]
end
subgraph R2[""]
direction LR
A3["Execute improvement<br/>Define processes per PA<br/>build tools & templates<br/>run a pilot"]
A4["Measure & verify<br/>Track test KPIs<br/>verify improvement effect<br/>certify level-up"]
end
style A1 fill:#E3F2FD,stroke:#1976D2,color:#000
style A2 fill:#F3E5F5,stroke:#7B1FA2,color:#000
style A3 fill:#FFF3E0,stroke:#F57C00,color:#000
style A4 fill:#E8F5E9,stroke:#388E3C,color:#000
style R1 fill:none,stroke:none
style R2 fill:none,stroke:none
Core TMMi Level 2 Test Processes (a Practical Starting Point)
| Process Area | Key Activities | Output |
|---|---|---|
| Test policy & strategy | Define the organization’s overall test direction, principles, and approach | Test policy document, test strategy document |
| Test planning | Plan scope, schedule, resources, risk, and exit criteria | Master Test Plan (MTP) |
| Test monitoring & control | Track progress, take corrective action on deviations | Test progress report, defect report |
| Test design & execution | Design, execute, and record results of test cases | Test cases, test result reports |
| Test environment | Build, maintain, and manage the test environment | Environment configuration plan, environment status report |
CMMI vs. TMMi Comparison
| Comparison | CMMI | TMMi |
|---|---|---|
| Focus | Maturity of the overall SW development process | Maturity specific to the test process |
| Number of levels | 5 levels (Level 1–5) | 5 levels (Level 1–5) |
| Process areas | 22 PAs (entire development) | 16 PAs (test-specific) |
| Target audience | The entire development organization | The test team / QA organization |
| Relationship | It is recommended to pursue TMMi levels alongside CMMI once Level 2 or higher is achieved |
3. Expected Benefits and Application of TMMi
| Category | Expected Benefits | Application and Practical Use |
|---|---|---|
| Quality visibility | Measures test process maturity quantitatively and objectively | Track the trend of test capability through an annual TMMi self-assessment |
| Early defect detection | Standardized testing improves the rate of defects found early in development | Standardize test planning and review processes by achieving Level 2 |
| Linked to DevOps | Achieve Level 4–5 capability through automated, CI/CD-integrated testing | Link test automation adoption to the TMMi Level 5 optimization goal |
| Use in procurement & audits | Used as supporting evidence of test maturity for public/financial projects | Reflect TMMi assessment results in software quality audit reports |