Difference between revisions of "Quality Management"

From SEBoK
Jump to navigation Jump to search
m (Text replacement - "SEBoK v. 2.9, released 20 November 2023" to "SEBoK v. 2.10, released 06 May 2024")
 
(84 intermediate revisions by 9 users not shown)
Line 1: Line 1:
Whether a systems engineer delivers a product, a service, or an enterprise, the deliverable should meet the needs of the customer and be fit for use.  Such a deliverable is said to be of high quality.  The process to assure high quality is called quality management.
+
-----
 +
'''''Lead Authors:''''' ''Quong Wang, Massood Towhidnejad, David Olwell'', '''''Contributing Authors:''''' ''Dick Fairley, Garry Roedler''
 +
-----
 +
Whether a systems engineer delivers a product, a service, or an enterprise, the deliverable should meet the needs of the customer and be fit for use.  Such a deliverable is said to be of high {{Term|Quality (glossary)|quality}}.  The process to assure high quality is called quality management.
  
 
== Overview ==
 
== Overview ==
Over the past 80 years, a ''quality movement'' has emerged to enable organizations to produce high quality deliverables.  This movement has gone though four stages, each discussed below. First, '''acceptance sampling''' was developed to apply statistical tests to decide whether or not to accept a lot of material based on a random sample of its content. Second, '''statistical process control''' was developed to determine if production processes were stable. Instead of necessarily measuring products, processes were measured. Processes that departed from a state of statistical control were far more likely to develop low quality deliverables. Third, '''design for quality''' focused on designing processes that were robust against causes of variation, reducing the likelihood that a process would go out of control, and accordingly reducing the monitoring requirements. Fourth, '''six sigma''' methods applied the tools and power of statistical thinking to improve other aspects of the organization.
+
Over the past 80 years, a ''quality movement'' has emerged to enable organizations to produce high quality deliverables.  This movement has gone through four stages:  
 +
# '''Acceptance Sampling''' was developed to apply statistical tests to assist in the decision of whether or not to accept a lot of material based on a random sample of its content.
 +
# '''{{Term|Statistical Process Control (glossary)|Statistical Process Control}}''' (SPC) was developed to determine if production processes were stable. Instead of necessarily measuring products, processes are measured instead. Processes that departed from a state of statistical control were far more likely to develop low quality deliverables.  
 +
#'''Design for Quality''' focused on designing processes that were robust against causes of variation, reducing the likelihood that a process would go out of control, and accordingly reducing the monitoring requirements.
 +
# '''Six sigma''' methods are applied the tools and power of statistical thinking to improve other aspects of the organization.
  
 
== Definitions ==
 
== Definitions ==
 
 
[http://asq.org/glossary/index.html The American Society for Quality] provides the following definitions:
 
[http://asq.org/glossary/index.html The American Society for Quality] provides the following definitions:
  
[[Quality (glossary)]] is a subjective term for which each person or sector has its own definition. In technical usage, quality can have two meanings:
+
* {{Term|Acceptance Sampling (glossary)|Acceptance Sampling}} involves the inspection of a sample to decide whether to accept the entire lot. There are two types of sampling:  
 
+
** In attributes sampling, the presence or absence of a characteristic is noted in each of the units inspected.  
# The characteristics of a product or service that bear on its ability to satisfy stated or implied needs.
+
** In variables sampling, the numerical magnitude of a characteristic is measured and recorded for each inspected unit. This involves reference to a continuous scale of some kind.
# A product or service free of deficiencies. According to Joseph Juran, quality means “fitness for use.” According to Philip Crosby, it means "conformance to requirements."
+
* SPC is the application of statistical techniques to control a process. It is often used interchangeably with the term “statistical quality control.”
 
+
*{{Term|Quality (glossary)|Quality}} is a subjective term for which each person or sector has its own definition. In technical usage, quality can have two meanings:
[[Acceptance Sampling (glossary)]] involves the inspection of a sample to decide whether to accept the entire lot. There are two types of sampling:  
+
** The characteristics of a product or service that bear on its ability to satisfy stated or implied needs.
 
+
** A product or service free of deficiencies. According to Joseph Juran, quality means “fitness for use.” According to Philip Crosby, it means "conformance to requirements."
# In attributes sampling, the presence or absence of a characteristic is noted in each of the units inspected.  
+
* {{Term|Six Sigma (glossary)|Six Sigma}} is a method that provides organizations with tools to improve the capability of their business processes. This increase in performance and decrease in process variation leads to defect reduction and improvement in profits, employee morale, and quality of products or services. Six Sigma quality is a term generally used to indicate a process is well controlled (±6 s from the centerline in a control chart).
# In variables sampling, the numerical magnitude of a characteristic is measured and recorded for each inspected unit; this involves reference to a continuous scale of some kind.
 
 
 
[[Statistical Process Control (glossary)|Statistical Process Control (SPC) (glossary)]] is the application of statistical techniques to control a process; often used interchangeably with the term “statistical quality control.”
 
 
 
[[Six Sigma (glossary) ]] is a method that provides organizations tools to improve the capability of their business processes. This increase in performance and decrease in process variation lead to defect reduction and improvement in profits, employee morale, and quality of products or services. Six Sigma quality is a term generally used to indicate a process is well controlled (±6 s from the centerline in a control chart).
 
  
 
=='''Quality Attributes'''==
 
=='''Quality Attributes'''==
 
+
Quality attributes, also known as quality factors, quality characteristics, or {{Term|Non-Functional Requirements (glossary)|non-functional requirements}}, are a set of system functional and non-functional requirements that are used to evaluate the system performance. There are a large number of system quality attributes identified in the literature (e.g. MSDN 2010, Barbacci et al. 1995). Depending on the type of the system being considered, some of these attributes are more prominent than others. Ideally, a system would be optimized for all the quality attributes that are important to the stakeholders, but this is an impossible task. Therefore, it is important to conduct a trade-off analysis to identify the relationship between the attributes and establish whether a change in one attribute would positively or negatively affect any other attributes.  An example of such trade-off is shown in Table 1 below. (See SEBoK discussion on [[Systems Engineering and Specialty Engineering|specialty engineering]] for additional information on quality attributes.)
Quality attributes, also known as quality factors or quality characteristics, are a set of system’s functional and non-functional requirements that are used to evaluate the system performance. There are a large number of system quality attributes that you can find within the literature (http://en.wikipedia.org/wiki/List_of_system_quality_attributes). Of course, depending on the type of the system you deal with, some of these attributes are more prominent than others. Ideally, you would want to optimize for all the quality attributes that are important to the system, but this is an impossible task. Therefore, it is important to conduct a trade off analysis to identify the relationship between the attributes, and whether a change in one attributes would affect positively or negatively any other attribute.  An example of such trade off is shown in Table 1 below.
 
  
 
<center>
 
<center>
 
{|
 
{|
|+ '''Table 1. Attribute Trade off (Table Developed for BKCASE)'''
+
|+ '''Table 1. Attribute Trade Off.''' (SEBoK Original)
 
|-
 
|-
 
!
 
!
!   Flexibility   
+
!Flexibility   
!   Maintainability   
+
!Maintainability   
!   Reliability   
+
!Reliability   
 
|-
 
|-
|Flexibility
+
|'''Flexibility'''
|
 
|
 
"+"
 
 
|
 
|
"-"
+
!'''+'''
 +
!'''-'''
 
|-
 
|-
|Maintainability
+
|'''Maintainability'''
|
+
!'''+'''
"+"
 
|
 
 
|
 
|
"+"
+
!'''+'''
 
|-
 
|-
|Reliability
+
|'''Reliability'''
|
+
!'''-'''
"-"
+
!'''+'''
|
 
"+"
 
 
|
 
|
 
|}
 
|}
 
</center>
 
</center>
  
Finding the right set of quality attributes is the first step in quality control and management. In order to acheive high quality, quality has to be measured, monitored, managed, and improved on. Therefore, in order to increase the overall system quality, you should be able to:
+
Finding the right set of quality attributes is the first step in quality control and management. In order to achieve high quality, quality must be measured, monitored, managed, and improved on. Therefore, in order to increase the overall system quality, it is necessary to:
 
+
* identify and prioritize the quality attributes
*Identify the quality attributes
+
* identify the metrics that can be used for these attributes
*Prioritize these attributes
+
* measure and monitor the attributes
*Identify the metrics that can be used for these attributes
+
* validate the measurements
*Measure and monitor the attributes
+
* analyze the result of those measurements
*Validate the measurements
+
* establish processes and procedures that result in improved system quality, based on the analysis.
*Analyze the result of those measurements
 
*Based on the analysis, establish processes and procedures that result in improved system quality
 
 
 
=== Quality attributes for products ===
 
Quality attributes for products focus on the conformance to the specifications for the product; frequently these are manufacturing specifications.  Examples include physical characteristics (length, weight, finish, capacity, etc.) being inside a given tolerance range.  The physical characteristics can be related to the function of the product, or to aesthetic qualities. 
 
 
 
A single product may have a vector of quality attributes of high dimension, and an associated region in which the vector is expected to be. Often the quality is summarized by saying the item is in compliance (if the vector is in the acceptable region) or defective if the vector is outside the acceptable region. Defective or non-defective status is then used as an indicator variable.
 
  
=== Quality attributes for services ===
+
=== Quality Attributes for Products ===
 +
Quality attributes for a {{Term|Product (glossary)|product}} focus on the conformance to the specifications for the product; frequently these are manufacturing specifications.  Examples include physical characteristics (length, weight, finish, capacity, etc.) being inside a given tolerance range.  The physical characteristics can be related to the function of the product or to aesthetic qualities. 
  
Throughout the SEBoK, a majority of the discussion concentrates around the products. However, quality of services also plays a major role in the customer satisfaction, which is the measurement of the overall system quality. Services can be divided to two major categories, primary and secondary. For example, the city public transportation system, the United States postal service, or the medical services provided by the hospital are all examples of the primary services. On the other hand, the services that provide help to the customer, in order to assemble a BBQ grill is an example of secondary services, which are typically referred to as the customer service. Identifying the appropriate quality attributes is the key step in the quality management for services. Some examples of service quality attributes include: affordability, availability, dependability, efficiency, predictability, reliability, responsiveness, safety, security, usability, etc. Again, depending on the type of the service, some of these attributes are more prominent than the others.
+
A single product may have a vector of quality attributes of high dimension as well as an associated region in which the vector is expected to be. Often the quality is summarized by saying the item is "in compliance" (if the vector is in the acceptable region) or "defective" (if the vector is outside the acceptable region).  
  
For example, in the case of services that are provided by the hospital, one may be more interested in the availability, reliability, and responsiveness than potentially the security (typically hospitals are assumed to be safe) and the affordability (typically insurance covers the majority of the cost).  Of course, if the patient does not have a good insurance coverage, then the importance of affordability will increase (de Knoning, 2006).
+
=== Quality Attributes for Services ===
 +
Quality of {{Term|Service (glossary)|services}} plays a major role in customer satisfaction, which is the measurement of the overall system quality. Services can be divided into two major categories: primary and secondary. The city public transportation system, the U.S. postal service, or the medical services provided by a hospital are all examples of primary services. Services that provide help to a customer are secondary services, which are typically referred to as a ''customer service''. Identifying the appropriate quality attributes is critical in the quality management of services. Some examples of service quality attributes include: affordability, availability, dependability, efficiency, predictability, reliability, responsiveness, safety, security, usability, etc. Again, depending on the type of the service, some of these attributes are more prominent than the others.
  
=== Quality attributes for enterprises ===
+
For example, in the case of services that are provided by the hospital, one may potentially be more interested in the availability, reliability, and responsiveness than the security (typically hospitals are assumed to be safe) and the affordability (typically insurance covers the majority of the cost).  Of course, if the patient does not have a good insurance coverage, then the importance of affordability will increase (de Knoning, 2006).
  
An enterprise typically refers to a large complex set of interconnected entities that includes people, technologies, processes, financial, and physical elements. It is obvious that a typical enterprise has a number of internal and external stakeholders, and as a result there are a large number of quality attributes that will define its quality. Identifying the right set of attributes is typically more challenging in such a complex system. An example of an enterprise is the air traffic management system that is mainly responsible for the safe and efficient operation of the civil aviation within a country or collection of countries. There are a large number of stakeholders that are concerned about the overall quality of the system, some example of these stakeholders and some of the primary quality attributes that they are concerned with are identified in Table 2.
+
=== Quality Attributes for Enterprises ===
 +
An {{Term|Enterprise (glossary)|enterprise}} typically refers to a large, complex set of interconnected entities that includes people, technologies, processes, financial, and physical elements. Clearly, a typical enterprise has a number of internal and external stakeholders, and as a result there are a large number of quality attributes that will define its quality. Identifying the right set of attributes is typically more challenging in such a complex system. An example of an enterprise is the air traffic management system that is mainly responsible for the safe and efficient operation of the civil aviation within a country or collection of countries. There are many stakeholders that are concerned about the overall quality of the system, some example of these stakeholders and some of the primary quality attributes that they are concerned with are identified in Table 2.
  
 
<center>
 
<center>
 
{|
 
{|
|+ '''Table 2. Enterprise Stakeholders and their Quality Attributes (Table Developed for BKCASE)'''
+
|+ '''Table 2. Enterprise Stakeholders and their Quality Attributes.''' (SEBoK Original)
 
|-
 
|-
 
!Stakeholders
 
!Stakeholders
Line 91: Line 81:
 
|-
 
|-
 
|Passengers
 
|Passengers
| safety, affordability, reliability, etc.
+
| Safety, affordability, and reliability
 
|-
 
|-
 
|Airlines
 
|Airlines
| adaptability, efficiency, profitability, etc.
+
| Adaptability, efficiency, and profitability
 
|-
 
|-
|Air traffic controller
+
|Air Traffic Controller
| safety, reliability, usability, etc.
+
| Safety, reliability, and usability
 
|-
 
|-
|Hardware & software developers
+
|Hardware & Software Developers
| reliability, fault tolerance, maintainability, etc.
+
| Reliability, fault tolerance, and maintainability
 
|-
 
|-
|Government/regulatory agency
+
|Government/Regulatory Agency
| safety, reliability, affordability, etc.
+
| Safety, reliability, affordability, etc.
 
|-
 
|-
 
|}
 
|}
 
</center>
 
</center>
  
=== Measuring quality attributes===
+
=== Measuring Quality Attributes===
As previously mentioned, you cannot achieve quality if you cannot measure. The [[Acronyms|Measurement System Analysis (MSA)]] (Wheeler and Lynday 1989) is a set of measuring instruments that provide an adequate capability for the team to conduct appropriate measurements in order to monitor and control quality. The MSA is a collection of:
+
Quality cannot be achieved if it cannot be measured. The Measurement System Analysis (MSA) (Wheeler and Lynday 1989) is a set of measuring instruments that provide an adequate capability for a team to conduct appropriate measurements in order to monitor and control quality. The MSA is a collection of:
 
 
*Tools: measuring instruments, calibration, etc.
 
 
 
*Processes: testing and measuring methods, set of specifications, etc.
 
 
 
*Procedures: policies and procedures and methodologies that are defined by the company and/or regulatory agency.
 
 
 
*People: personnel (managers, testers, analysis, etc.) who are involved in the measurement activities.
 
 
 
*Environment: both environmental setting and physical setting that best simulate the operational environment and/or the best setting to get the most accurate measurements
 
  
Once the quality attributes are identified and prioritized, then the [[Acronyms|MSA]] will help in the monitoring and controling the oversll system quality.
+
* '''Tools''' - measuring instruments, calibration, etc.
 +
* '''Processes''' - testing and measuring methods, set of specifications, etc.
 +
* '''Procedures''' - policies and procedures and methodologies that are defined by the company and/or regulatory agency
 +
* '''People''' - personnel (managers, testers, analysis, etc.) who are involved in the measurement activities
 +
* '''Environment''' - both environmental setting and physical setting that best simulate the operational environment and/or the best setting to get the most accurate measurements
  
Additional details about measurement are presented in the measurement section.
+
Once the quality attributes are identified and prioritized, then the MSA supports the monitor and control of overall system quality.
  
== Quality management strategies ==
+
Additional details about measurement are presented in the [[Measurement|measurement]] article.
  
 +
== Quality Management Strategies ==
  
 
=== Acceptance Sampling ===
 
=== Acceptance Sampling ===
In [[Acceptance Sampling (glossary)|acceptance sampling]] a lot of products is presented for delivery. The consumer samples from the lot.  Each member of the sample is then either categorized as acceptable or unacceptable based on some attribute (attribute sampling) or measured against one or more metrics (variable sampling). Based on the measurements, an inference is made as to whether the lot meets the customer requirements.
+
In {{Term|Acceptance Sampling (glossary)|acceptance sampling}} many examples of a product are presented for delivery. The consumer samples from the lot and each member of the sample is then categorized as either ''acceptable'' or ''unacceptable'' based on an attribute (attribute sampling) or measured against one or more metrics (variable sampling). Based on the measurements, an inference is made as to whether the lot meets the customer requirements.
  
There are four possible outcomes of the sampling of a lot.
+
There are four possible outcomes of the sampling of a lot, as shown in Table 3.
  
 
<center>
 
<center>
 
{|
 
{|
|+ '''Table 3. Truth Table - Outcomes of acceptance sampling (Table Developed for BKCASE)'''
+
|+ '''Table 3. Truth Table - Outcomes of Acceptance Sampling.''' (SEBoK Original)
 
|-
 
|-
 
!
 
!
!'''Lot meets requirement'''
+
!'''Lot Meets Requirement'''
!'''Lot fails requirement'''
+
!'''Lot Fails Requirement'''
 
|-
 
|-
| '''Sample passes test'''
+
| '''Sample Passes Test'''
 
| No error
 
| No error
 
| Consumer risk
 
| Consumer risk
 
|-
 
|-
| '''Sample fails test'''
+
| '''Sample Fails Test'''
 
| Producer risk
 
| Producer risk
 
| No error
 
| No error
Line 151: Line 136:
 
</center>
 
</center>
  
A sample acceptance plan balances the risk of error between the producer and consumer. Detailed ANSI/ISO/ASQ standards describe how this allocation is performed (ANSI/ISO/ASQ A3534-2-1993: Statistics—Vocabulary and Symbols—Statistical Quality Control).
+
A sample acceptance plan balances the risk of error between the producer and consumer. Detailed ANSI/ISO/ASQ standards describe how this allocation is performed (ANSI/ISO/ASQ A3534-2-1993: ''Statistics—Vocabulary and Symbols—Statistical Quality Control'').
  
 
=== Statistical Process Control ===
 
=== Statistical Process Control ===
[[Statistical Process Control (glossary)|Statistical process control (SPC)]] is a method that was invented by Walter A. Shewhart (1931), which adopts statistical thinking to monitor and control the behaviors and performances of a process. It means using statistical analysis techniques as tools in appropriate ways to estimate the variation in the performance of a process, to investigate the causes of this variation, and to recognize from the data when the process is not performing as it should (Mary et al. 2006, 441). By performance here, what is meant is ‘how well the process is done.
+
SPC is a method that was invented by Walter A. Shewhart (1931) that adopts statistical thinking to monitor and control the behaviors and performances of a process. It involves using statistical analysis techniques as tools in appropriate ways, such as providing an estimate of the variation in the performance of a process, investigating the causes of this variation, and offering the engineer the means to recognize when the process is not performing as it should based on the data. (Mary et al. 2006, 441). In this context, ''performance'' is measured by how well the process is performed.
  
 
The theory of quality management emphasizes managing processes by fact and maintaining systematic improvement. All product developments are a series of interconnected processes that have variation in their results. Understanding variation with SPC technology can help the process executors understand the facts of their processes and find the improvement opportunities from a systematic view.  
 
The theory of quality management emphasizes managing processes by fact and maintaining systematic improvement. All product developments are a series of interconnected processes that have variation in their results. Understanding variation with SPC technology can help the process executors understand the facts of their processes and find the improvement opportunities from a systematic view.  
  
The key tools in [[Acronyms|SPC]] are control charts. The control chart is also called the Shewhart 3-sigma chart. It consists of 3 limit lines; the center line, which is the mean of statistical samples, the upper and lower control limit lines, which are calculated by mean and standard deviation of statistical samples. The observed data points or their statistic value (mean as process behaves) are drawn in the chart with time or other sequence orders. Upper and lower control limits indicate the threshold at which the process output will be considered as ‘unlikely.
+
Control charts are common tools in SPC. The control chart is also called the Shewhart 3-sigma chart. It consists of 3 limit lines: the center line, which is the mean of statistical samples, and the upper and lower control limit lines, which are calculated using the mean and standard deviation of statistical samples. The observed data points or their statistical values are drawn in the chart with time or other sequence orders. Upper and lower control limits indicate the thresholds at which the process output will be considered as ''unlikely''. There are two sources of process variation. One is common cause variation, which is due to inherent interaction among process components. Another is assignable cause, which is due to events that are not part of the normal process. SPC stresses bringing a process into a state of statistical control, where only common cause variation exists, and keeping it in control. A control chart is used to distinguish between variation in a process resulting from common causes and assignable causes.  
 
 
There are two sources of process variation. One is common cause variation, which is due to inherent interaction among process components. Another is assignable cause, which is due to events that are not part of the normal process. SPC stresses bringing a process into a state of statistical control, where only common cause variation exists, and keeping it in control. A control chart is used to distinguish between variation in a process resulting from common causes and assignable causes.
 
 
 
If the process is in control, and if standard assumptions are met, more than 99.73% points will plot within the control limit. Any points outside the limits, or that appear in some systematic patterns, imply a new source of variation would be introduced. A new variation means increased quality cost.
 
 
 
The control limits of control are based on understanding the history of the process. It is also called the natural bound of the process. It presents a graphic display of process stability or instability over time, controls the current process, and predicts the future of the process.
 
  
More advanced control charts exist.  Cumulative Sum Charts detect small, persistent step change model departures.  Moving average charts, with different possible weighting schemes, also detect persistent changes (Hawkins and Olwell 1996).
+
If the process is in control, and if standard assumptions are met, points will demonstrate a normal distribution around the control limit. Any points outside either of the limits, or in systematic patterns, imply a new source of variation would be introduced. A new variation means increased quality cost. Additional types of control charts exist, including: cumulative sum charts that detect small, persistent step change model departures and moving average charts, which use different possible weighting schemes to detect persistent changes (Hawkins and Olwell 1996).
  
 
=== Design for Quality ===
 
=== Design for Quality ===
 
+
Variation in the inputs to a process usually results in variation in the outputs.  Processes can be designed, however, to be robust against variation in the inputs. Response surface experimental design and analysis is the statistical technique that is used to assist in determining the sensitivity of the process to variations in the input.  Such an approach was pioneered by Taguchi.
Variation in the inputs to a process usually results in variation in the outputs.  Processes can be designed, however, to be robust against variation in the inputs.
 
 
 
Response surface experimental design and analysis is the statistical technique used to assist in determining the sensitivity of the process to variations in the input.  Such an approach was pioneered by Taguchi.
 
  
 
=== Six Sigma ===
 
=== Six Sigma ===
  
Six sigma methodology is a set of tools to improve the quality of business processes; in particular, to improve performance and reduce variation.
+
Six sigma methodology (Pyzdek and Keller, 2009) is a set of tools to improve the quality of business processes; in particular, to improve performance and reduce variation. Six sigma methods were pioneered by Motorola and came into wide acceptance after they were championed by General Electric.
 
 
Six sigma methods were pioneered by Motorola and came into wide acceptance after they were championed by General Electric.
 
 
 
Problems are addressed by six sigma projects.  These projects follow a five stage process: 
 
# Define the problem, the stakeholders, and the goals
 
# Measure key aspects and collect relevant data
 
# Analyze the data to determine cause-effect relationships
 
# Improve the current process / Design a new process
 
# Control the future state / Verify the design
 
 
 
These steps are known as DMAIC for existing processes and DMADV for new processes.
 
  
An extensive body of literature exists on six sigma.
+
Problems resulting in variation are addressed by six sigma projects, which follow a five-stage process: 
 +
# '''Define''' the problem, the stakeholders, and the goals.
 +
# '''Measure''' key aspects and collect relevant data.
 +
# '''Analyze''' the data to determine cause-effect relationships.
 +
# '''Improve''' the current process or '''design''' a new process.
 +
# '''Control''' the future state or '''verify''' the design.
  
A variant of six sigma is called lean six sigma wherein the emphasis is on improving or maintaining quality while driving out waste.
+
These steps are known as '''DMAIC''' for existing processes and '''DMADV''' for new processes. A variant of six sigma is called lean six sigma wherein the emphasis is on improving or maintaining quality while driving out waste.
  
 
===Standards===
 
===Standards===
Primary standards for quality management are maintained by ISO, principally the [http://www.iso.org/iso/iso_catalogue/management_and_leadership_standards/quality_management.htm IS0 9000 series]. The ISO standards provide requirements for the quality management systems of a wide range of enterprises, without specifying how the standards are to be met, and have world-wide acceptance.  The key requirement is that the system must be audited.
+
Primary standards for quality management are maintained by ISO, principally the [http://www.iso.org/iso/iso_catalogue/management_and_leadership_standards/quality_management.htm IS0 9000 series]. The ISO standards provide requirements for the quality management systems of a wide range of enterprises, without specifying how the standards are to be met.  The key requirement is that the system must be audited. ISO standards have world-wide acceptance. 
  
In the United States, the Malcolm Baldridge National Quality Award presents up to three awards in six categories:  manufacturing, service company, small business, education, healthcare, and nonprofit. The [http://www.nist.gov/baldrige/publications/criteria.cfm Baldridge Criteria] have become de facto standards for assessing the quality performance of organizations.
+
In the United States, the Malcolm Baldridge National Quality Award presents up to three awards in six categories:  manufacturing, service company, small business, education, health care, and nonprofit. The [http://www.nist.gov/baldrige/publications/criteria.cfm Baldridge Criteria] have become de facto standards for assessing the quality performance of organizations.
  
 
==References==
 
==References==
  
===Citations===
+
===Works Cited===
Chrissis, M.B., M. Konrad, and S. Shrum. 2006. ''CMMI Guidelines for Process Integration and Product Improvement,''. 2nd ed. Boston, MA, USA: Addison Wesley. (ISBN 0321279670).
+
Barbacci, M., M.H. Klein, T.A. Longstaff, and C.B. Weinstock. 1995. ''Quality Attributes.'' Pittsburgh, PA, USA: Software Engineering Institute/Carnegie Melon University. CMU/SEI-95-TR-021.
 +
 
 +
Chrissis, M.B., M. Konrad, and S. Shrum. 2006. ''[[CMMI for Development: Guidelines for Process Integration and Product Improvement‬]],'' 2nd ed. Boston, MA, USA: Addison Wesley.  
  
Evans, J. & W. Lindsay. 2010. ''Managing for Quality and Performance Excellence.'' Florence, KY, USA: Cengage Southwestern. (ISBN 0324783205)
+
Evans, J. and W. Lindsay. 2010. ''[[Managing for Quality and Performance Excellence]].'' Florence, KY, USA: Cengage Southwestern.
  
Juran, J.M. 1992. ''Juran on Quality by Design: The New Steps for Planning Quality into Goods and Services.'' New York, NY, USA: The Free Press. (ISBN 0029166837)
+
Juran, J.M. 1992. ''[[Juran on Quality by Design]]: The New Steps for Planning Quality into Goods and Services.'' New York, NY, USA: The Free Press.
  
Koning, H. de, et al. 2006. "Lean Six Sigma in Healthcare."  ''Journal for Healthcare Quality'' 28 (2) pp 4-11.   
+
Koning, H. de, J.P.S. Verver, J. van den Heuvel, S. Bisgaard, R.J.M.M. Does. 2006. "Lean Six Sigma in Healthcare."  ''Journal for Healthcare Quality.'' 28(2) pp 4-11.   
 +
MSDN. 2010. "Chapter 16: Quality Attributes," in ''Microsoft Application Architecture Guide'', 2nd Edition. Microsoft Software Developer Network, Microsoft Corporation. Accessed August 31, 2012. Available online at http://msdn.microsoft.com/en-us/library/ff650706.
  
Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. ''Improving Quality through Planned Experimentation.''  New York, NY, USA: McGraw-Hill. (ISBN 0-07-042673-2)
+
Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. ''[[Quality Improvement through Planned Experimentation]].''  New York, NY, USA: McGraw-Hill.  
  
Pyzdek, T. and P.A. Keller. 2009. ''The Six Sigma Handbook.'' 3rd ed. New York, NY: McGraw-Hill. (ISBN 0071623388)
+
Pyzdek, T. and P.A. Keller. 2009. ''[[The Six Sigma Handbook]],'' 3rd ed. New York, NY: McGraw-Hill.
  
Shewhart, W.A. 1931. ''Economic Control of Manufactured Product''.  New York, NY, USA: Van Nostrand.
+
Shewhart, W.A. 1931. ''Economic Control of Manufactured Product''.  New York, NY, USA: Van Nostrand.
  
Wheeler, D.J. and R.W. Lyday. 1989. ''Evaluating the Measurement Process,'' 2nd ed. Knoxville, TN, USA: SPC Press. (ISBN 9780945320067 ISBN 094532006X)
+
Wheeler, D.J. and R.W. Lyday. 1989. ''[[Evaluating the Measurement Process]],'' 2nd ed. Knoxville, TN, USA: SPC Press.
  
 
===Primary References===
 
===Primary References===
  
Chrissis, M.B., M. Konrad, and S. Shrum. 2006. ''CMMI Guidelines for Process Integration and Product Improvement.'' 2nd ed. Boston, MA, USA: Addison Wesley. (ISBN 0321279670).
+
Chrissis, M.B, M. Konrad, S. Shrum. 2011. ''[[CMMI for Development: Guidelines for Process Integration and Product Improvement‬]]'', 3rd ed. Boston, MA, USA: Addison-Wesley Professional.
  
Evans, J. & W. Lindsay. 2010. ''Managing for Quality and Performance Excellence.'' Florence, KY, USA: Cengage Southwestern. (ISBN 0324783205)
+
Evans, J. and W. Lindsay. 2010. ''[[Managing for Quality and Performance Excellence]].'' Florence, KY, USA: Cengage Southwestern.  
  
Juran, J.M. 1992. ''Juran on Quality by Design: The New Steps for Planning Quality into Goods and Services.'' New York, NY, USA: The Free Press. (ISBN 0029166837)
+
Juran, J.M. 1992. ''[[Juran on Quality by Design]]: The New Steps for Planning Quality into Goods and Services.'' New York, NY, USA: The Free Press.
  
Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. ''Improving Quality through Planned Experimentation.'' New York, NY, USA: McGraw-Hill. (ISBN 0-07-042673-2)
+
Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. ''[[Quality Improvement through Planned Experimentation]].'' New York, NY, USA: McGraw-Hill.
  
Pyzdek, T. and P.A. Keller. 2009. ''The Six Sigma Handbook.'' 3rd ed. New York, NY: McGraw-Hill. (ISBN 0071623388)
+
Pyzdek, T. and P.A. Keller. 2009. ''[[The Six Sigma Handbook]],'' 3rd ed. New York, NY, USA: McGraw-Hill.  
  
Wheeler, D.J. and R.W. Lyday. 1989. ''Evaluating the Measurement Process.'' 2nd ed. Knoxville, TN, USA: SPC Press. (ISBN 9780945320067 ISBN 094532006X)
+
Wheeler, D.J. and R.W. Lyday. 1989. ''[[Evaluating the Measurement Process]],'' 2nd ed. Knoxville, TN, USA: SPC Press.
  
 
===Additional References===
 
===Additional References===
 
Hawkins, D. and D.H. Olwell. 1996. ''Cumulative Sum Charts and Charting for Quality Improvement''.  New York, NY, USA: Springer.   
 
Hawkins, D. and D.H. Olwell. 1996. ''Cumulative Sum Charts and Charting for Quality Improvement''.  New York, NY, USA: Springer.   
  
Shewhart, W.A.  1931.  ''Economic Control of Manufactured Product''.  New York, NY, USA: Van Nostrand.
 
 
----
 
----
<center>[[Information Management|<- Previous Article]] | [[Systems Engineering Management|Parent Article]] | [[Product and Service Life Management|Next Article ->]]</center>
+
<center>[[Information Management|< Previous Article]] | [[Systems Engineering Management|Parent Article]] | [[Measurement|Next Article >]]</center>
 +
 
 +
<center>'''SEBoK v. 2.10, released 06 May 2024'''</center>
 +
 
 
[[Category: Part 3]][[Category:Topic]]
 
[[Category: Part 3]][[Category:Topic]]
 +
[[Category:Systems Engineering Management]]

Latest revision as of 22:58, 2 May 2024


Lead Authors: Quong Wang, Massood Towhidnejad, David Olwell, Contributing Authors: Dick Fairley, Garry Roedler


Whether a systems engineer delivers a product, a service, or an enterprise, the deliverable should meet the needs of the customer and be fit for use. Such a deliverable is said to be of high qualityquality. The process to assure high quality is called quality management.

Overview

Over the past 80 years, a quality movement has emerged to enable organizations to produce high quality deliverables. This movement has gone through four stages:

  1. Acceptance Sampling was developed to apply statistical tests to assist in the decision of whether or not to accept a lot of material based on a random sample of its content.
  2. Statistical Process ControlStatistical Process Control (SPC) was developed to determine if production processes were stable. Instead of necessarily measuring products, processes are measured instead. Processes that departed from a state of statistical control were far more likely to develop low quality deliverables.
  3. Design for Quality focused on designing processes that were robust against causes of variation, reducing the likelihood that a process would go out of control, and accordingly reducing the monitoring requirements.
  4. Six sigma methods are applied the tools and power of statistical thinking to improve other aspects of the organization.

Definitions

The American Society for Quality provides the following definitions:

  • Acceptance SamplingAcceptance Sampling involves the inspection of a sample to decide whether to accept the entire lot. There are two types of sampling:
    • In attributes sampling, the presence or absence of a characteristic is noted in each of the units inspected.
    • In variables sampling, the numerical magnitude of a characteristic is measured and recorded for each inspected unit. This involves reference to a continuous scale of some kind.
  • SPC is the application of statistical techniques to control a process. It is often used interchangeably with the term “statistical quality control.”
  • QualityQuality is a subjective term for which each person or sector has its own definition. In technical usage, quality can have two meanings:
    • The characteristics of a product or service that bear on its ability to satisfy stated or implied needs.
    • A product or service free of deficiencies. According to Joseph Juran, quality means “fitness for use.” According to Philip Crosby, it means "conformance to requirements."
  • Six SigmaSix Sigma is a method that provides organizations with tools to improve the capability of their business processes. This increase in performance and decrease in process variation leads to defect reduction and improvement in profits, employee morale, and quality of products or services. Six Sigma quality is a term generally used to indicate a process is well controlled (±6 s from the centerline in a control chart).

Quality Attributes

Quality attributes, also known as quality factors, quality characteristics, or non-functional requirementsnon-functional requirements, are a set of system functional and non-functional requirements that are used to evaluate the system performance. There are a large number of system quality attributes identified in the literature (e.g. MSDN 2010, Barbacci et al. 1995). Depending on the type of the system being considered, some of these attributes are more prominent than others. Ideally, a system would be optimized for all the quality attributes that are important to the stakeholders, but this is an impossible task. Therefore, it is important to conduct a trade-off analysis to identify the relationship between the attributes and establish whether a change in one attribute would positively or negatively affect any other attributes. An example of such trade-off is shown in Table 1 below. (See SEBoK discussion on specialty engineering for additional information on quality attributes.)

Table 1. Attribute Trade Off. (SEBoK Original)
Flexibility Maintainability Reliability
Flexibility + -
Maintainability + +
Reliability - +

Finding the right set of quality attributes is the first step in quality control and management. In order to achieve high quality, quality must be measured, monitored, managed, and improved on. Therefore, in order to increase the overall system quality, it is necessary to:

  • identify and prioritize the quality attributes
  • identify the metrics that can be used for these attributes
  • measure and monitor the attributes
  • validate the measurements
  • analyze the result of those measurements
  • establish processes and procedures that result in improved system quality, based on the analysis.

Quality Attributes for Products

Quality attributes for a productproduct focus on the conformance to the specifications for the product; frequently these are manufacturing specifications. Examples include physical characteristics (length, weight, finish, capacity, etc.) being inside a given tolerance range. The physical characteristics can be related to the function of the product or to aesthetic qualities.

A single product may have a vector of quality attributes of high dimension as well as an associated region in which the vector is expected to be. Often the quality is summarized by saying the item is "in compliance" (if the vector is in the acceptable region) or "defective" (if the vector is outside the acceptable region).

Quality Attributes for Services

Quality of servicesservices plays a major role in customer satisfaction, which is the measurement of the overall system quality. Services can be divided into two major categories: primary and secondary. The city public transportation system, the U.S. postal service, or the medical services provided by a hospital are all examples of primary services. Services that provide help to a customer are secondary services, which are typically referred to as a customer service. Identifying the appropriate quality attributes is critical in the quality management of services. Some examples of service quality attributes include: affordability, availability, dependability, efficiency, predictability, reliability, responsiveness, safety, security, usability, etc. Again, depending on the type of the service, some of these attributes are more prominent than the others.

For example, in the case of services that are provided by the hospital, one may potentially be more interested in the availability, reliability, and responsiveness than the security (typically hospitals are assumed to be safe) and the affordability (typically insurance covers the majority of the cost). Of course, if the patient does not have a good insurance coverage, then the importance of affordability will increase (de Knoning, 2006).

Quality Attributes for Enterprises

An enterpriseenterprise typically refers to a large, complex set of interconnected entities that includes people, technologies, processes, financial, and physical elements. Clearly, a typical enterprise has a number of internal and external stakeholders, and as a result there are a large number of quality attributes that will define its quality. Identifying the right set of attributes is typically more challenging in such a complex system. An example of an enterprise is the air traffic management system that is mainly responsible for the safe and efficient operation of the civil aviation within a country or collection of countries. There are many stakeholders that are concerned about the overall quality of the system, some example of these stakeholders and some of the primary quality attributes that they are concerned with are identified in Table 2.

Table 2. Enterprise Stakeholders and their Quality Attributes. (SEBoK Original)
Stakeholders Primary Quality Attributes
Passengers Safety, affordability, and reliability
Airlines Adaptability, efficiency, and profitability
Air Traffic Controller Safety, reliability, and usability
Hardware & Software Developers Reliability, fault tolerance, and maintainability
Government/Regulatory Agency Safety, reliability, affordability, etc.

Measuring Quality Attributes

Quality cannot be achieved if it cannot be measured. The Measurement System Analysis (MSA) (Wheeler and Lynday 1989) is a set of measuring instruments that provide an adequate capability for a team to conduct appropriate measurements in order to monitor and control quality. The MSA is a collection of:

  • Tools - measuring instruments, calibration, etc.
  • Processes - testing and measuring methods, set of specifications, etc.
  • Procedures - policies and procedures and methodologies that are defined by the company and/or regulatory agency
  • People - personnel (managers, testers, analysis, etc.) who are involved in the measurement activities
  • Environment - both environmental setting and physical setting that best simulate the operational environment and/or the best setting to get the most accurate measurements

Once the quality attributes are identified and prioritized, then the MSA supports the monitor and control of overall system quality.

Additional details about measurement are presented in the measurement article.

Quality Management Strategies

Acceptance Sampling

In acceptance samplingacceptance sampling many examples of a product are presented for delivery. The consumer samples from the lot and each member of the sample is then categorized as either acceptable or unacceptable based on an attribute (attribute sampling) or measured against one or more metrics (variable sampling). Based on the measurements, an inference is made as to whether the lot meets the customer requirements.

There are four possible outcomes of the sampling of a lot, as shown in Table 3.

Table 3. Truth Table - Outcomes of Acceptance Sampling. (SEBoK Original)
Lot Meets Requirement Lot Fails Requirement
Sample Passes Test No error Consumer risk
Sample Fails Test Producer risk No error

A sample acceptance plan balances the risk of error between the producer and consumer. Detailed ANSI/ISO/ASQ standards describe how this allocation is performed (ANSI/ISO/ASQ A3534-2-1993: Statistics—Vocabulary and Symbols—Statistical Quality Control).

Statistical Process Control

SPC is a method that was invented by Walter A. Shewhart (1931) that adopts statistical thinking to monitor and control the behaviors and performances of a process. It involves using statistical analysis techniques as tools in appropriate ways, such as providing an estimate of the variation in the performance of a process, investigating the causes of this variation, and offering the engineer the means to recognize when the process is not performing as it should based on the data. (Mary et al. 2006, 441). In this context, performance is measured by how well the process is performed.

The theory of quality management emphasizes managing processes by fact and maintaining systematic improvement. All product developments are a series of interconnected processes that have variation in their results. Understanding variation with SPC technology can help the process executors understand the facts of their processes and find the improvement opportunities from a systematic view.

Control charts are common tools in SPC. The control chart is also called the Shewhart 3-sigma chart. It consists of 3 limit lines: the center line, which is the mean of statistical samples, and the upper and lower control limit lines, which are calculated using the mean and standard deviation of statistical samples. The observed data points or their statistical values are drawn in the chart with time or other sequence orders. Upper and lower control limits indicate the thresholds at which the process output will be considered as unlikely. There are two sources of process variation. One is common cause variation, which is due to inherent interaction among process components. Another is assignable cause, which is due to events that are not part of the normal process. SPC stresses bringing a process into a state of statistical control, where only common cause variation exists, and keeping it in control. A control chart is used to distinguish between variation in a process resulting from common causes and assignable causes.

If the process is in control, and if standard assumptions are met, points will demonstrate a normal distribution around the control limit. Any points outside either of the limits, or in systematic patterns, imply a new source of variation would be introduced. A new variation means increased quality cost. Additional types of control charts exist, including: cumulative sum charts that detect small, persistent step change model departures and moving average charts, which use different possible weighting schemes to detect persistent changes (Hawkins and Olwell 1996).

Design for Quality

Variation in the inputs to a process usually results in variation in the outputs. Processes can be designed, however, to be robust against variation in the inputs. Response surface experimental design and analysis is the statistical technique that is used to assist in determining the sensitivity of the process to variations in the input. Such an approach was pioneered by Taguchi.

Six Sigma

Six sigma methodology (Pyzdek and Keller, 2009) is a set of tools to improve the quality of business processes; in particular, to improve performance and reduce variation. Six sigma methods were pioneered by Motorola and came into wide acceptance after they were championed by General Electric.

Problems resulting in variation are addressed by six sigma projects, which follow a five-stage process:

  1. Define the problem, the stakeholders, and the goals.
  2. Measure key aspects and collect relevant data.
  3. Analyze the data to determine cause-effect relationships.
  4. Improve the current process or design a new process.
  5. Control the future state or verify the design.

These steps are known as DMAIC for existing processes and DMADV for new processes. A variant of six sigma is called lean six sigma wherein the emphasis is on improving or maintaining quality while driving out waste.

Standards

Primary standards for quality management are maintained by ISO, principally the IS0 9000 series. The ISO standards provide requirements for the quality management systems of a wide range of enterprises, without specifying how the standards are to be met. The key requirement is that the system must be audited. ISO standards have world-wide acceptance.

In the United States, the Malcolm Baldridge National Quality Award presents up to three awards in six categories: manufacturing, service company, small business, education, health care, and nonprofit. The Baldridge Criteria have become de facto standards for assessing the quality performance of organizations.

References

Works Cited

Barbacci, M., M.H. Klein, T.A. Longstaff, and C.B. Weinstock. 1995. Quality Attributes. Pittsburgh, PA, USA: Software Engineering Institute/Carnegie Melon University. CMU/SEI-95-TR-021.

Chrissis, M.B., M. Konrad, and S. Shrum. 2006. CMMI for Development: Guidelines for Process Integration and Product Improvement‬, 2nd ed. Boston, MA, USA: Addison Wesley.

Evans, J. and W. Lindsay. 2010. Managing for Quality and Performance Excellence. Florence, KY, USA: Cengage Southwestern.

Juran, J.M. 1992. Juran on Quality by Design: The New Steps for Planning Quality into Goods and Services. New York, NY, USA: The Free Press.

Koning, H. de, J.P.S. Verver, J. van den Heuvel, S. Bisgaard, R.J.M.M. Does. 2006. "Lean Six Sigma in Healthcare." Journal for Healthcare Quality. 28(2) pp 4-11. MSDN. 2010. "Chapter 16: Quality Attributes," in Microsoft Application Architecture Guide, 2nd Edition. Microsoft Software Developer Network, Microsoft Corporation. Accessed August 31, 2012. Available online at http://msdn.microsoft.com/en-us/library/ff650706.

Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. Quality Improvement through Planned Experimentation. New York, NY, USA: McGraw-Hill.

Pyzdek, T. and P.A. Keller. 2009. The Six Sigma Handbook, 3rd ed. New York, NY: McGraw-Hill.

Shewhart, W.A. 1931. Economic Control of Manufactured Product. New York, NY, USA: Van Nostrand.

Wheeler, D.J. and R.W. Lyday. 1989. Evaluating the Measurement Process, 2nd ed. Knoxville, TN, USA: SPC Press.

Primary References

Chrissis, M.B, M. Konrad, S. Shrum. 2011. ‪CMMI for Development: Guidelines for Process Integration and Product Improvement‬, 3rd ed. Boston, MA, USA: Addison-Wesley Professional.‬

Evans, J. and W. Lindsay. 2010. Managing for Quality and Performance Excellence. Florence, KY, USA: Cengage Southwestern.

Juran, J.M. 1992. Juran on Quality by Design: The New Steps for Planning Quality into Goods and Services. New York, NY, USA: The Free Press.

Moen, R.D., T.W. Nolan, and L.P. Provost. 1991. Quality Improvement through Planned Experimentation. New York, NY, USA: McGraw-Hill.

Pyzdek, T. and P.A. Keller. 2009. The Six Sigma Handbook, 3rd ed. New York, NY, USA: McGraw-Hill.

Wheeler, D.J. and R.W. Lyday. 1989. Evaluating the Measurement Process, 2nd ed. Knoxville, TN, USA: SPC Press.

Additional References

Hawkins, D. and D.H. Olwell. 1996. Cumulative Sum Charts and Charting for Quality Improvement. New York, NY, USA: Springer.


< Previous Article | Parent Article | Next Article >
SEBoK v. 2.10, released 06 May 2024