Difference between revisions of "Why Model?"

From SEBoK
Jump to navigation Jump to search
m (Text replacement - "<center>'''SEBoK v. 2.0, released 1 June 2019'''</center>" to "<center>'''SEBoK v. 2.1, released 31 October 2019'''</center>")
(24 intermediate revisions by 8 users not shown)
Line 1: Line 1:
[[System (glossary) | System]] [[Model (glossary)| models]] can be used for many [[Purpose (glossary) | purposes]]. This topic highlights some of those purposes, and provides indicators of an effective model, in the context of [[Model-Based Systems Engineering (MBSE) (glossary) | model-based systems engineering]] (MBSE).
+
----
 +
'''''Lead Author:''''' ''Sanford Friedenthal'', '''''Contributing Authors:''''' ''Dov Dori, Yaniv Mordecai''
 +
----
 +
{{Term|System (glossary)|System}} {{Term|Model (glossary)|models}} can be used for many {{Term|Purpose (glossary)|purposes}}. This topic highlights some of those purposes, and provides indicators of an effective model, in the context of {{Term|Model-Based Systems Engineering (MBSE) (glossary)|model-based systems engineering}} (MBSE).
  
 
==Purpose of a Model==
 
==Purpose of a Model==
Models are representations that can aid in defining, analyzing, and communicating a set of [[Concept (glossary) | concepts]]. System models are specifically developed to support analysis, specification, [[Design (glossary) | design]], [[Verification (glossary) | verification]], and [[Validation (glossary) | validation]] of a system, as well as to communicate certain information. One of the first [[Principle (glossary) | principles]] of modeling is to clearly define the purpose of the model. Some of the purposes that models can serve throughout the system [[Life Cycle (glossary) | life cycle]] are
+
Models are representations that can aid in defining, analyzing, and communicating a set of {{Term|Concept (glossary)|concepts}}. System models are specifically developed to support analysis, specification, {{Term|Design (glossary)|design}}, {{Term|Verification (glossary)|verification}}, and {{Term|Validation (glossary)|validation}} of a system, as well as to communicate certain information. One of the first {{Term|Principle (glossary)|principles}} of modeling is to clearly define the purpose of the model. Some of the purposes that models can serve throughout the system {{Term|Life Cycle (glossary)|life cycle}} are
*'''Characterizing an existing system:''' Many existing systems may be poorly documented, and modeling the system can provide a concise way to capture the existing system design. This information can then be used to facilitate maintaining the system or to assess the system with the goal of improving it. This is analogous to creating an [[Architecture (glossary) | architectural]] model of an old building with overlays for electrical, plumbing, and [[Structure (glossary) | structure]] before proceeding to upgrade it to new standards to withstand earthquakes.
+
*'''Characterizing an existing system:''' Many existing systems are poorly documented, and modeling the system can provide a concise way to capture the existing system design. This information can then be used to facilitate maintaining the system or to assess the system with the goal of improving it. This is analogous to creating an {{Term|Architecture (glossary)|architectural}} model of an old building with overlays for electrical, plumbing, and {{Term|Structure (glossary)|structure}} before proceeding to upgrade it to new standards to withstand earthquakes.
*'''[[Mission (glossary) | Mission]] and system [[Concept (glossary) | concept]] formulation and evaluation:''' Models can be applied early in the system life cycle to synthesize and evaluate alternative mission and system concepts. This includes clearly and unambiguously defining the system's mission and the [[Value (glossary) | value]] it is expected to deliver to its beneficiaries. Models can be used to explore a trade-space by modeling alternative system designs and assessing the impact of critical system parameters such as weight, speed, accuracy, [[Reliability (glossary) | reliability]], and [[Cost (glossary) | cost]] on the overall measures of merit. In addition to [[Boundary (glossary) | bounding]] the system design parameters, models can also be used to validate that the system [[Requirement (glossary) | requirements]] meet [[Stakeholder (glossary) | stakeholder]] needs before proceeding with later [[Life Cycle (glossary) | life cycle]] activities such as synthesizing the detailed system design.  
+
*'''{{Term|Mission (glossary)|Mission}} and system {{Term|Concept (glossary)|concept}} formulation and evaluation:''' Models can be applied early in the system life cycle to synthesize and evaluate alternative mission and system concepts. This includes clearly and unambiguously defining the system's mission and the {{Term|Value (glossary)|value}} it is expected to deliver to its beneficiaries. Models can be used to explore a trade-space by modeling alternative system designs and assessing the impact of critical system parameters such as weight, speed, accuracy, {{Term|Reliability (glossary)|reliability}}, and {{Term|Cost (glossary)|cost}} on the overall measures of merit. In addition to {{Term|Boundary (glossary)|bounding}} the system design parameters, models can also be used to validate that the system {{Term|Requirement (glossary)|requirements}} meet {{Term|Stakeholder (glossary)|stakeholder}} needs before proceeding with later {{Term|Life Cycle (glossary)|life cycle}} activities such as synthesizing the detailed system design.  
*'''System design synthesis and requirements flowdown:''' Models can be used to support architecting system solutions, as well as flow mission and system requirements down to system [[Component (glossary) | components]]. Different models may be required to address different aspects of the system design and respond to the broad range of system requirements. This may include models that specify [[Function (glossary) | functional]], [[Interface (glossary) | interface]], performance, and physical requirements, as well as other [[Non-Functional Requirements (glossary) |non-functional requirements]] such as reliability, [[Maintainability (glossary) | maintainability]], [[Safety (glossary) | safety]], and [[Security (glossary) | security]].   
+
*'''System design synthesis and requirements flowdown:''' Models can be used to support architecting system solutions, as well as flow mission and system requirements down to system {{Term|Component (glossary)|components}}. Different models may be required to address different aspects of the system design and respond to the broad range of system requirements. This may include models that specify {{Term|Function (glossary)|functional}}, {{Term|Interface (glossary)|interface}}, performance, and physical requirements, as well as other {{Term|Non-Functional Requirements (glossary)|non-functional requirements}} such as reliability, {{Term|Maintainability (glossary)|maintainability}}, {{Term|Safety (glossary)|safety}}, and {{Term|Security (glossary)|security}}.   
*'''Support for system integration and verification:''' Models can be used to support [[Integration (glossary) | integration]] of the hardware and software components into a system, as well as to support verification that the system satisfies its requirements. This often involves integrating lower level hardware and software design models with system-level design models that verify system requirements are satisfied. System integration and verification may also include replacing selected hardware and design models with actual hardware and [[Software (glossary) | software]] [[Product (glossary) | products]] in order to incrementally verify that system requirements are satisfied. This is referred to as [[Hardware-in-the-Loop Testing (glossary) | hardware-in-the-loop testing]] and [[Software-in-the-Loop Testing (glossary)|software-in-the-loop testing ]]. Models can also be used to define the [[Test Cases (glossary) | test cases (glossary)]] and other aspects of the test [[Program (glossary) | program]] to assist in test planning and execution.
+
*'''Support for system integration and verification:''' Models can be used to support {{Term|Integration (glossary)|integration}} of the hardware and software components into a system, as well as to support verification that the system satisfies its requirements. This often involves integrating lower level hardware and software design models with system-level design models which verify that system requirements are satisfied. System integration and verification may also include replacing selected hardware and design models with actual hardware and {{Term|Software (glossary)|software}} {{Term|Product (glossary)|products}} in order to incrementally verify that system requirements are satisfied. This is referred to as {{Term|Hardware-in-the-Loop Testing (glossary)|hardware-in-the-loop testing}} and {{Term|Software-in-the-Loop Testing (glossary)|software-in-the-loop testing}}. Models can also be used to define the {{Term|Test Cases (glossary)|test cases (glossary)}} and other aspects of the test {{Term|Program (glossary)|program}} to assist in test planning and execution.
*'''Support for training:''' Models can be used to simulate various aspects of the system to help train users to interact with the system. Users may be operators, maintainers, or potentially other stakeholders. Models may be a basis for developing a [[Simulator (glossary) | simulator (glossary)]] of the system with varying degrees of fidelity to represent user interaction in different usage scenarios.
+
*'''Support for training:''' Models can be used to simulate various aspects of the system to help train users to interact with the system. Users may be operators, maintainers, or other stakeholders. Models may be a basis for developing a {{Term|Simulator (glossary)|simulator (glossary)}} of the system with varying degrees of fidelity to represent user interaction in different usage scenarios.
*'''Knowledge capture and system design evolution:''' Models can provide an effective means for capturing knowledge about the system and retaining it as part of the organizational knowledge. This knowledge, which can be reused and evolved, provides a basis for supporting the evolution of the system, such as changing system requirements in the face of emerging, relevant technologies, new applications, and new [[Customer (glossary) | customers]]. Models can also enable the capture of families of products.
+
*'''Knowledge capture and system design evolution:''' Models can provide an effective means for capturing knowledge about the system and retaining it as part of organizational knowledge. This knowledge, which can be reused and evolved, provides a basis for supporting the evolution of the system, such as changing system requirements in the face of emerging, relevant technologies, new applications, and new {{Term|Customer (glossary)|customers}}. Models can also enable the capture of families of products.
  
 
==Indicators of an Effective Model==
 
==Indicators of an Effective Model==
When modeling is done well, a model's [[Purpose (glossary) | purposes are clear and well-defined. The value of a model can be assessed in terms of how effectively it supports those purposes. The following three topics, [[Types of Models]], [[System Modeling Concepts]], and [[Modeling Standards]] describe indicators of an effective model (Friedenthal, Moore, and Steiner 2009).
+
When modeling is done well, a model’s {{Term|Purpose (glossary)|purposes}} are clear and well-defined. The value of a model can be assessed in terms of how effectively it supports those purposes. The remainder of this section and the topics [[Types of Models]], [[System Modeling Concepts]], and [[Modeling Standards]] describe indicators of an effective model (Friedenthal, Moore, and Steiner 2012).
  
 
===Model Scope===
 
===Model Scope===
The model must be [[Scope (glossary) | scoped]] to address its intended purpose. In particular, the types of models and associated modeling languages selected must support the specific needs desired to be met. For example, suppose models are constructed to support an aircraft's development. A system architecture model may describe the interconnection among the airplane parts, a trajectory analysis model may analyze the airplane trajectory, and a fault tree analysis model may assess potential causes of airplane [[Failure (glossary) | failure]].
+
The model must be {{Term|Scope (glossary)|scoped}} to address its intended purpose. In particular, the types of models and associated modeling languages selected must support the specific needs to be met. For example, suppose models are constructed to support an aircraft’s development. A system architecture model may describe the interconnection among the airplane parts, a trajectory analysis model may analyze the airplane trajectory, and a fault tree analysis model may assess potential causes of airplane {{Term|Failure (glossary)|failure}}.
  
For each type of model, the appropriate breadth, depth, and fidelity should be determined to address the model's intended purpose. The model breadth reflects the system requirements coverage in terms of the degree to which the model must address the functional, interface, performance, and physical requirements, as well as other non-functional requirements, such as reliability, maintainability, and safety. For an airplane functional model, the model breadth may be required to address some or all of the functional requirements to power up, takeoff, fly, land, power down, and maintain the aircraft's [[Environment (glossary) | environment]].
+
For each type of model, the appropriate breadth, depth, and fidelity should be determined to address the model’s intended purpose. The model breadth reflects the system requirements coverage in terms of the degree to which the model must address the functional, interface, performance, and physical requirements, as well as other non-functional requirements, such as reliability, maintainability, and safety. For an airplane functional model, the model breadth may be required to address some or all of the functional requirements to power up, takeoff, fly, land, power down, and maintain the aircraft’s {{Term|Environment (glossary)|environment}}.
  
The model's depth indicates the coverage of system decomposition from the system [[Context (glossary) | context]] down to the system [[Component (glossary) | components]]. For the airplane example, a model's scope may require it to define the system context; ranging from the aircraft, the control tower, and the physical environment; down to the navigation subsystem and its components; such as the inertial measurement unit; and perhaps down to lower-level parts of the inertial measurement unit.
+
The model’s depth indicates the coverage of system decomposition from the system {{Term|Context (glossary)|context}} down to the system {{Term|Component (glossary)|components}}. For the airplane example, a model’s scope may require it to define the system context, ranging from the aircraft, the control tower, and the physical environment, down to the navigation subsystem and its components, such as the inertial measurement unit; and, perhaps down to lower-level parts of the inertial measurement unit.
 
   
 
   
The model's fidelity indicates the level of detail the model must represent for any given part of the model. For example, a model that specifies the system interfaces may be fairly abstract and represent only the logical information content; such as aircraft status data, or it may be much more detailed to support higher fidelity information; such as the encoding of a message in terms of bits, bytes, and signal characteristics. Fidelity can also refer to the precision of a computational model, such as the time step required for a simulation.
+
The model’s fidelity indicates the level of detail the model must represent for any given part of the model. For example, a model that specifies the system interfaces may be fairly abstract and represent only the logical information content, such as aircraft status data; or, it may be much more detailed to support higher fidelity information, such as the encoding of a message in terms of bits, bytes, and signal characteristics. Fidelity can also refer to the precision of a computational model, such as the time step required for a simulation.
  
 
===Indicators of Model Quality===
 
===Indicators of Model Quality===
The [[Quality (glossary) | quality]] of a model should not be confused with the quality of the design that the model represents. For example, one may have a high-quality, computer-aided design model of a chair that accurately represents the design of the chair, yet the design itself may be flawed such that when one sits in the chair, it falls apart. A high quality model should provide a sufficient representation to assist the design team in assessing the quality of the design and uncovering design issues.
+
The {{Term|Quality (glossary)|quality}} of a model should not be confused with the quality of the design that the model represents. For example, one may have a high-quality, computer-aided design model of a chair that accurately represents the design of the chair, yet the design itself may be flawed such that when one sits in the chair, it falls apart. A high quality model should provide a representation sufficient to assist the design team in assessing the quality of the design and uncovering design issues.
  
 
Model quality is often assessed in terms of the adherence of the model to modeling guidelines and the degree to which the model addresses its intended purpose. Typical examples of modeling guidelines include naming conventions, application of appropriate model annotations, proper use of modeling constructs, and applying model reuse considerations. Specific guidelines are different for different types of models. For example, the guidelines for developing a geometric model using a computer-aided design tool may include conventions for defining coordinate systems, dimensioning, and tolerances.
 
Model quality is often assessed in terms of the adherence of the model to modeling guidelines and the degree to which the model addresses its intended purpose. Typical examples of modeling guidelines include naming conventions, application of appropriate model annotations, proper use of modeling constructs, and applying model reuse considerations. Specific guidelines are different for different types of models. For example, the guidelines for developing a geometric model using a computer-aided design tool may include conventions for defining coordinate systems, dimensioning, and tolerances.
  
 
===Model-based Metrics===
 
===Model-based Metrics===
Models can provide a wealth of information that can be used for both technical and management [[Metric (glossary) | metrics]] to assess the modeling effort, and, in some cases, the overall [[Systems Engineering (glossary) | systems engineering]] effort. Different types of models will provide different types of information. In general, models can provide information that enables one to
+
Models can provide a wealth of information that can be used for both technical and management {{Term|Metric (glossary)|metrics}} to assess the modeling effort, and, in some cases, the overall {{Term|Systems Engineering (glossary)|systems engineering}} (SE) effort. Different types of models provide different types of information. In general, models provide information that enables one to
  
 
*assess progress;
 
*assess progress;
 
*estimate effort and cost;
 
*estimate effort and cost;
*assess technical quality and [[Risk (glossary) |risk]]; and
+
*assess technical quality and {{Term|Risk (glossary)|risk}}; and
 
*assess model quality.
 
*assess model quality.
  
The models can be used to capture metrics that are similar to those captured in a traditional document-based approach to systems engineering, but potentially with more precision due to the more accurate nature of models when compared to documents. Traditional systems engineering metrics are described in ''[[Metrics Guidebook for Integrated Systems and Product Development]]'' (Wilbur 2005).
+
Models can capture metrics similar to those captured in a traditional document-based approach to systems engineering, but potentially with more precision given the more accurate nature of models compared to documents. Traditional systems engineering metrics are described in ''[[Metrics Guidebook for Integrated Systems and Product Development]]'' (Wilbur 2005).
  
A model's progress can be assessed in terms of the completeness of the modeling effort relative to the defined scope of the model. Models may also be used to assess progress in terms of the extent to which the requirements have been satisfied by the design or verified through testing. When augmented with productivity metrics, the model can be used to estimate the cost of performing the required systems engineering effort to deliver the system.
+
A model’s progress can be assessed in terms of the completeness of the modeling effort relative to the defined scope of the model. Models may also be used to assess progress in terms of the extent to which the requirements have been satisfied by the design or verified through testing. When augmented with productivity metrics, the model can be used to estimate the cost of performing the required systems engineering effort to deliver the system.
  
Models can be used to identify critical system parameters and assess technical risks in terms of any uncertainty that lies in those parameters. The models can also be used to provide additional metrics that are associated with its purpose. For example, when the model's purpose is to support mission and system concept formulation and evaluation, then a key metric may be the number of alternative concepts that are explored over a specified period of time.
+
Models can be used to identify critical system parameters and assess technical risks in terms of any uncertainty that lies in those parameters. The models can also be used to provide additional metrics that are associated with its purpose. For example, when the model’s purpose is to support mission and system concept formulation and evaluation, then a key metric may be the number of alternative concepts that are explored over a specified period of time.
  
 
==References==  
 
==References==  
  
 
===Works Cited===
 
===Works Cited===
Friedenthal, S., A. Moore, and R. Steiner. 2009. "Chapter 2" in ''[[A Practical Guide to SysML: The Systems Modeling Language]]''. Needham, MA, USA: OMG Press.
+
Friedenthal, S., A. Moore, R. Steiner, and M. Kaufman. 2012. ''[[A Practical Guide to SysML: The Systems Modeling Language]]'', 2nd Edition. Needham, MA, USA: OMG Press.
  
Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005.  ''[[Metrics Guidebook for Integrated Systems and Product Development]]''.  Seattle, WA, USA:  International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01.  Available at http://www.incose.org/ProductsPubs/products/metricsguidebook.asp.
+
Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005.  ''[[Metrics Guidebook for Integrated Systems and Product Development]]''.  Seattle, WA, USA:  International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01.
  
 
===Primary References===
 
===Primary References===
Friedenthal, S., A. Moore, and R. Steiner. 2009. "Chapter 2" in ''[[A Practical Guide to SysML: The Systems Modeling Language]]''. Needham, MA, USA: OMG Press.
+
Friedenthal, S., A. Moore, R. Steiner, and M. Kaufman. 2012. ''[[A Practical Guide to SysML: The Systems Modeling Language]]'', 2nd Edition. Needham, MA, USA: OMG Press.
  
Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005.  ''[[Metrics Guidebook for Integrated Systems and Product Development]]''.  Seattle, WA, USA:  International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01.  Available at http://www.incose.org/ProductsPubs/products/metricsguidebook.asp.
+
Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005.  ''[[Metrics Guidebook for Integrated Systems and Product Development]]''.  Seattle, WA, USA:  International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01.  Accessed April 13 at https://www.incose.org/ProductsPublications/techpublications/GuideMetrics
  
 
===Additional References===
 
===Additional References===
Line 59: Line 62:
 
<center>[[What is a Model?|< Previous Article]] | [[Representing Systems with Models|Parent Article]] | [[Types of Models|Next Article >]]</center>
 
<center>[[What is a Model?|< Previous Article]] | [[Representing Systems with Models|Parent Article]] | [[Types of Models|Next Article >]]</center>
  
 
+
<center>'''SEBoK v. 2.1, released 31 October 2019'''</center>
 
 
  
 
[[Category:Part 2]][[Category:Topic]][[Category:Representing Systems with Models]]
 
[[Category:Part 2]][[Category:Topic]][[Category:Representing Systems with Models]]
{{DISQUS}}
 

Revision as of 09:04, 28 October 2019


Lead Author: Sanford Friedenthal, Contributing Authors: Dov Dori, Yaniv Mordecai


SystemSystem modelsmodels can be used for many purposespurposes. This topic highlights some of those purposes, and provides indicators of an effective model, in the context of model-based systems engineeringmodel-based systems engineering (MBSE).

Purpose of a Model

Models are representations that can aid in defining, analyzing, and communicating a set of conceptsconcepts. System models are specifically developed to support analysis, specification, designdesign, verificationverification, and validationvalidation of a system, as well as to communicate certain information. One of the first principlesprinciples of modeling is to clearly define the purpose of the model. Some of the purposes that models can serve throughout the system life cyclelife cycle are

  • Characterizing an existing system: Many existing systems are poorly documented, and modeling the system can provide a concise way to capture the existing system design. This information can then be used to facilitate maintaining the system or to assess the system with the goal of improving it. This is analogous to creating an architecturalarchitectural model of an old building with overlays for electrical, plumbing, and structurestructure before proceeding to upgrade it to new standards to withstand earthquakes.
  • MissionMission and system conceptconcept formulation and evaluation: Models can be applied early in the system life cycle to synthesize and evaluate alternative mission and system concepts. This includes clearly and unambiguously defining the system's mission and the valuevalue it is expected to deliver to its beneficiaries. Models can be used to explore a trade-space by modeling alternative system designs and assessing the impact of critical system parameters such as weight, speed, accuracy, reliabilityreliability, and costcost on the overall measures of merit. In addition to boundingbounding the system design parameters, models can also be used to validate that the system requirementsrequirements meet stakeholderstakeholder needs before proceeding with later life cyclelife cycle activities such as synthesizing the detailed system design.
  • System design synthesis and requirements flowdown: Models can be used to support architecting system solutions, as well as flow mission and system requirements down to system componentscomponents. Different models may be required to address different aspects of the system design and respond to the broad range of system requirements. This may include models that specify functionalfunctional, interfaceinterface, performance, and physical requirements, as well as other non-functional requirementsnon-functional requirements such as reliability, maintainabilitymaintainability, safetysafety, and securitysecurity.
  • Support for system integration and verification: Models can be used to support integrationintegration of the hardware and software components into a system, as well as to support verification that the system satisfies its requirements. This often involves integrating lower level hardware and software design models with system-level design models which verify that system requirements are satisfied. System integration and verification may also include replacing selected hardware and design models with actual hardware and softwaresoftware productsproducts in order to incrementally verify that system requirements are satisfied. This is referred to as hardware-in-the-loop testinghardware-in-the-loop testing and software-in-the-loop testingsoftware-in-the-loop testing. Models can also be used to define the test cases (glossary)test cases (glossary) and other aspects of the test programprogram to assist in test planning and execution.
  • Support for training: Models can be used to simulate various aspects of the system to help train users to interact with the system. Users may be operators, maintainers, or other stakeholders. Models may be a basis for developing a simulator (glossary)simulator (glossary) of the system with varying degrees of fidelity to represent user interaction in different usage scenarios.
  • Knowledge capture and system design evolution: Models can provide an effective means for capturing knowledge about the system and retaining it as part of organizational knowledge. This knowledge, which can be reused and evolved, provides a basis for supporting the evolution of the system, such as changing system requirements in the face of emerging, relevant technologies, new applications, and new customerscustomers. Models can also enable the capture of families of products.

Indicators of an Effective Model

When modeling is done well, a model’s purposespurposes are clear and well-defined. The value of a model can be assessed in terms of how effectively it supports those purposes. The remainder of this section and the topics Types of Models, System Modeling Concepts, and Modeling Standards describe indicators of an effective model (Friedenthal, Moore, and Steiner 2012).

Model Scope

The model must be scopedscoped to address its intended purpose. In particular, the types of models and associated modeling languages selected must support the specific needs to be met. For example, suppose models are constructed to support an aircraft’s development. A system architecture model may describe the interconnection among the airplane parts, a trajectory analysis model may analyze the airplane trajectory, and a fault tree analysis model may assess potential causes of airplane failurefailure.

For each type of model, the appropriate breadth, depth, and fidelity should be determined to address the model’s intended purpose. The model breadth reflects the system requirements coverage in terms of the degree to which the model must address the functional, interface, performance, and physical requirements, as well as other non-functional requirements, such as reliability, maintainability, and safety. For an airplane functional model, the model breadth may be required to address some or all of the functional requirements to power up, takeoff, fly, land, power down, and maintain the aircraft’s environmentenvironment.

The model’s depth indicates the coverage of system decomposition from the system contextcontext down to the system componentscomponents. For the airplane example, a model’s scope may require it to define the system context, ranging from the aircraft, the control tower, and the physical environment, down to the navigation subsystem and its components, such as the inertial measurement unit; and, perhaps down to lower-level parts of the inertial measurement unit.

The model’s fidelity indicates the level of detail the model must represent for any given part of the model. For example, a model that specifies the system interfaces may be fairly abstract and represent only the logical information content, such as aircraft status data; or, it may be much more detailed to support higher fidelity information, such as the encoding of a message in terms of bits, bytes, and signal characteristics. Fidelity can also refer to the precision of a computational model, such as the time step required for a simulation.

Indicators of Model Quality

The qualityquality of a model should not be confused with the quality of the design that the model represents. For example, one may have a high-quality, computer-aided design model of a chair that accurately represents the design of the chair, yet the design itself may be flawed such that when one sits in the chair, it falls apart. A high quality model should provide a representation sufficient to assist the design team in assessing the quality of the design and uncovering design issues.

Model quality is often assessed in terms of the adherence of the model to modeling guidelines and the degree to which the model addresses its intended purpose. Typical examples of modeling guidelines include naming conventions, application of appropriate model annotations, proper use of modeling constructs, and applying model reuse considerations. Specific guidelines are different for different types of models. For example, the guidelines for developing a geometric model using a computer-aided design tool may include conventions for defining coordinate systems, dimensioning, and tolerances.

Model-based Metrics

Models can provide a wealth of information that can be used for both technical and management metricsmetrics to assess the modeling effort, and, in some cases, the overall systems engineeringsystems engineering (SE) effort. Different types of models provide different types of information. In general, models provide information that enables one to

  • assess progress;
  • estimate effort and cost;
  • assess technical quality and riskrisk; and
  • assess model quality.

Models can capture metrics similar to those captured in a traditional document-based approach to systems engineering, but potentially with more precision given the more accurate nature of models compared to documents. Traditional systems engineering metrics are described in Metrics Guidebook for Integrated Systems and Product Development (Wilbur 2005).

A model’s progress can be assessed in terms of the completeness of the modeling effort relative to the defined scope of the model. Models may also be used to assess progress in terms of the extent to which the requirements have been satisfied by the design or verified through testing. When augmented with productivity metrics, the model can be used to estimate the cost of performing the required systems engineering effort to deliver the system.

Models can be used to identify critical system parameters and assess technical risks in terms of any uncertainty that lies in those parameters. The models can also be used to provide additional metrics that are associated with its purpose. For example, when the model’s purpose is to support mission and system concept formulation and evaluation, then a key metric may be the number of alternative concepts that are explored over a specified period of time.

References

Works Cited

Friedenthal, S., A. Moore, R. Steiner, and M. Kaufman. 2012. A Practical Guide to SysML: The Systems Modeling Language, 2nd Edition. Needham, MA, USA: OMG Press.

Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005. Metrics Guidebook for Integrated Systems and Product Development. Seattle, WA, USA: International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01.

Primary References

Friedenthal, S., A. Moore, R. Steiner, and M. Kaufman. 2012. A Practical Guide to SysML: The Systems Modeling Language, 2nd Edition. Needham, MA, USA: OMG Press.

Wilbur, A., G. Towers, T. Sherman, D. Yasukawa, and S. Shreve. 2005. Metrics Guidebook for Integrated Systems and Product Development. Seattle, WA, USA: International Council on Systems Engineering (INCOSE). INCOSE-TP-1995-002-01. Accessed April 13 at https://www.incose.org/ProductsPublications/techpublications/GuideMetrics

Additional References

None.


< Previous Article | Parent Article | Next Article >
SEBoK v. 2.1, released 31 October 2019