Sponsors

Microsoft


TechWell

We have 2932 guests and 2 members online

Home CM Journal Articles Testing Maturity Model (TMM) Certification

Testing Maturity Model (TMM) Certification

E-mail
Written by Ilene Burnstein   
Saturday, 30 November 2002 16:00
The Testing Maturity Model (TMM) defines and utilizes fundamental concepts of managed, measured, monitored, and effective for testing process maturity. The TMM was developed by Ilene Burnstein, Taratip Suwannasart, and C.R. Carlson, Illinois Institute of Technology in response to behavioral characteristics of immature and mature software organizations.

Within a mature test process, "managed" in its broadest sense includes planning, staffing, directing, controlling, and organization of test components.  In addition, a mature testing process is applied on an institution-wide basis, supported by management, and an integral component of the organizational culture.

TMM defines and utilizes fundamental concepts of managed, measured, monitored, and effective for testing process maturity. Within a mature test process, "managed" in its broadest sense includes planning, staffing, directing, controlling, and organization of test components.  In addition, a mature testing process is applied on an institution-wide basis, supported by management, and an integral component of the organizational culture.

TMM software quality and management solutions integrates the similar principles promoted by leading research and development centers including the Software Engineer Institute (SEI) CMM (Capability Maturity Model). These organizations provide measured improvements that enforce the adoption of standard process and models, management practices, standard terminology and quality metrics with associated benchmarks. 

"By adapting proven process models, organizations will dramatically improve their level of quality that must be associated with successful software application projects" said MST Lab CEO Linda S Miller. "TMM provides our customers with a comprehensive set of quality solutions, giving them a competitive edge to innovate more efficiently, reduce time to market, satisfy customers needs and enable their development staff to focus on their core missions."

In August 2002, Capital One, Richmond Virginia was awarded the first TMM Level 5 Certification by MST Lab, an independent TMM assessor.  Prior to Capital One’s onsite assessment, questionnaires were provided and completed by five members of Capital One test team. The onsite assessment consisted of individual interviews of TMM implementation participants, attending software team meetings and examination of TMM documents and reports.  The objective of the assessment was to determine the TMM maturity level based on goals and sub goals within each five levels of the TMM-AM (assessment model). 

TMM Model This five level model enables organizations to migrate their immature QA and software test teams into a mature proven process. The model defines team members’ activities, tasks and responsibilities (ATR) within each level of maturity.  Standard documents are managed, controlled, resources are identified and data is collected for measurement and metrics utilizing automated tools.

Synopsis of the TMM

1) Initial - The software acquisition process is characterized as ad hoc, and occasionally even chaotic. Few processes are defined and success depends on individual effort. For an organization to mature beyond the initial level, it must install basic management and test controls to instill self-discipline.

2) Repeatable - Basic software test goals and subgoals are developed and processes are established to plan all aspects of software testing including, management of software requirements, tracking project and team performance, project cost, schedules and successful transition of software. Management and test teams react to circumstances as they arise. The necessary process discipline is in place to repeat successes on all future projects. For an organization to mature beyond the level of self-discipline, it must use well-defined processes as a foundation for improvement.

3) Defined - The organization’s software and test process is documented, standardized, approved and supported.  Risk management is integrated into all aspects and the organization provides training for each member of test team. For an organization to mature beyond the level of defined processes, it must base decisions on quantitative measures of its processes and products so that objectivity can be attained.

4) Quantitative - Detailed measures of the software processes and products are defined and documented. The software processes, products, and services are quantitatively and qualitatively understood and controlled.

5) Optimizing - Continuous process improvement is empowered by feedback based on the process and innovative ideas and technologies. Ultimately an organization recognizes that continual improvement and change is necessary to remain compliant.

TMM Maturity Levels

As organizations establish and improve their software quality processes, they progress through five levels of maturity. Each level provides a layer in the foundation for continuous process improvement this is comprised of goals and sub-goals that stabilizes components of the software quality and testing process. Achieving each level of the maturity model institutionalizes a unique component within the process, resulting in a quality process throughout the organization.

Level I-Initial (Not Applicable)Level II- Phase Definition
  • Develop testing and debugging goals
  • Initiate test planning process
  • Institutionalize basic test techniques and methods
Level III- Integration
  • Establish software test organization
  • Technical training program
  • Integrate testing process throughout software development life-cycle
  • Initiate risk management process
  • Control and monitor test process
Level IV- Management and Measurement
  • Establish organization-wide review programs
  • Establish test measurement program
  • Software quality evaluation
Level V – Optimization/Defect Prevention and Quality Control
  • Application of processing data for defect prevention
  • Quality Control
  • Test Process Optimization
TMM-AM Components
1.Questionnaire
  • Instructions
  • Respondents background
  • Organization background
  • Maturity goals and sub goals related to the following topics.
2. Test Tools

3. Test methods/trends

4. Training

5. Support

6. Resources

7. Risks

8. Metrics

The TMM-AM questionnaires are organized in the order of each maturity level goals and sub goals. They are divided into five common features in order to ensure implementation and institutionalization of each maturity goal is effective, repeatable and re-usable. The five common features consist of the following performance:
  • Commitment
  • Ability
  • Activities, tasks and responsibilities
  • Measurement and analysis
  • Implementation


Ilene Burnstein
holds a doctorate from Illinois Institute of Technology, an associate professor of computer science at Illinois Institute of Technology  and co-director of the Center for Software Engineering.

Taratip Suwanassart holds a doctorate in computer science from Illinois Institute of Technology.

C.R. Carlson holds a doctorate from the University of Iowa. He is a professor and chairman of the computer science department at Illinois Institute of Technology.

Linda Miller holds a degree in computer science and is CEO and founder of MST Lab, located in St. Louis, MO. You can reach Linda Miller by email at
millerls@ix.netcom.com

Trackback(0)

Comments (0)add comment


Write comment

You must be logged in to post a comment. Please register if you do not have an account yet.

busy
Last Updated on Wednesday, 26 July 2006 04:30
 
509 Bandwidth Limit Exceeded

Bandwidth Limit Exceeded

The server is temporarily unable to service your request due to the site owner reaching his/her bandwidth limit. Please try again later.