Difference between revisions of "Emergence"

From SEBoK
Jump to navigation Jump to search
m (Text replacement - "SEBoK v. 2.9, released 20 November 2023" to "SEBoK v. 2.10, released 06 May 2024")
 
(51 intermediate revisions by 9 users not shown)
Line 1: Line 1:
This topic forms part of the [[Systems Fundamentals]] Knowledge Area. It gives the background to some of the ways in which [[Emergence (glossary) | emergence]] has been described, as well as an indication of current thinking on what it is and how it influences [[Systems Engineering (glossary) | systems engineering]] (SE) practice. It will discuss how these ideas relate to the general definitions of [[System (glossary)|systems]] given in [[What is a System?]]; in particular, how they relate to different [[Engineered System (glossary)|engineered system]] contexts. This topic is closely related to the [[Complexity|complexity]] topic that precedes it.
+
----
 +
'''''Lead Author:''''' ''Rick Adcock'', '''''Contributing Authors:''''' ''Scott Jackson, Dick Fairley, Janet Singer, Duane Hybertson''
 +
----
 +
This topic forms part of the [[Systems Science]] knowledge area (KA). It gives the background to some of the ways in which {{Term|Emergence (glossary)|emergence}} has been described, as well as an indication of current thinking on what it is and how it influences {{Term|Systems Engineering (glossary)|systems engineering}} (SE) practice. It will discuss how these ideas relate to the general definitions of {{Term|System (glossary)|systems}} given in [[What is a System?]]; in particular, how they relate to different {{Term|Engineered System (glossary)|engineered system}} contexts. This topic is closely related to the [[Complexity|complexity]] topic that precedes it.
  
Emergence is a consequence of the fundamental system [[Concept (glossary) | concepts]] of [[Holism (glossary)|holism]] and interaction (Hitchins 2007, p. 27).  System wholes have [[Behavior (glossary)|behaviors]] and properties arising from the organization of their [[Element (glossary) | elements]] and their relationships, which only become apparent when the system is placed in different [[Environment (glossary) | environments]].
+
Emergence is a consequence of the fundamental system {{Term|Concept (glossary)|concepts}} of {{Term|Holism (glossary)|holism}} and interaction (Hitchins 2007, 27).  System wholes have {{Term|Behavior (glossary)|behaviors}} and properties arising from the organization of their {{Term|Element (glossary)|elements}} and their relationships, which only become apparent when the system is placed in different {{Term|Environment (glossary)|environments}}.
  
 
Questions that arise from this definition include: What kinds of systems exhibit different kinds of emergence and under what conditions? Can emergence be predicted, and is it beneficial or detrimental to a system? How do we deal with emergence in the development and use of engineered systems? Can it be planned for? How?  
 
Questions that arise from this definition include: What kinds of systems exhibit different kinds of emergence and under what conditions? Can emergence be predicted, and is it beneficial or detrimental to a system? How do we deal with emergence in the development and use of engineered systems? Can it be planned for? How?  
  
There are many varied and even conflicting views on emergence. This topic presents the prevailing views and provides references for others.
+
There are many varied and occasionally conflicting views on emergence. This topic presents the prevailing views and provides references for others.
  
 
==Overview of Emergence==
 
==Overview of Emergence==
Emergent system [[Behavior (glossary)|behavior]] can be viewed as a consequence of the interactions and relationships between [[System Element (glossary)|system elements]] rather than the behavior of individual elements. It emerges from a combination of the behavior and properties of the system elements and the systems structure or allowable interactions between the elements, and may be triggered or influenced by a stimulus from the systems environment.  Checkland, for example, defines [[Emergence (glossary)|emergence]] as “the principle that entities exhibit properties which are meaningful only when attributed to the whole, not to its parts.(Checkland 1999, p. 314).  
+
As defined by Checkland, {{Term|Emergence (glossary)|emergence}} is “the principle that entities exhibit properties which are meaningful only when attributed to the whole, not to its parts.” (Checkland 1999, 314). Emergent system {{Term|Behavior (glossary)|behavior}} can be viewed as a consequence of the interactions and relationships between {{Term|System Element (glossary)|system elements}} rather than the behavior of individual elements. It emerges from a combination of the behavior and properties of the system elements and the systems structure or allowable interactions between the elements, and may be triggered or influenced by a stimulus from the systems environment.   
 +
 
 +
Emergence is common in nature. The pungent gas ammonia results from the chemical combination of two odorless gases, hydrogen and nitrogen. As individual parts, feathers, beaks, wings, and gullets do not have the ability to overcome gravity; however, when properly connected in a bird, they create the emergent behavior of flight. What we refer to as “self-awareness” results from the combined effect of the interconnected and interacting neurons that make up the brain (Hitchins 2007, 7).  
  
Emergence is common in nature. The pungent gas ammonia results from the chemical combination of two odorless gases, hydrogen and nitrogen. As individual parts, feathers, beaks, wings, and gullets do not have the ability to overcome gravity. Properly connected in a bird, they create the emergent behavior of flight. The emergent behavior “self-awareness” results from the combined effect of the interconnected and interacting neurons that make up the brain (Hitchins 2007, p. 7).  
+
Hitchins also notes that technological systems exhibit emergence. We can observe a number of levels of outcome which arise from interaction between elements in an {{Term|Engineered System (glossary)|engineered system}} context. At a simple level, some system outcomes or {{Term|Attribute (glossary)|attributes}} have a fairly simple and well defined mapping to their {{Term|Element (glossary)|elements}}; for example, center of gravity or top speed of a vehicle result from a combination of element properties and how they are combined.  Other behaviors can be associated with these simple outcomes, but their value emerges in {{Term|Complex (glossary)|complex}} and less predictable ways across a system. The single lap performance of a vehicle around a track is related to center of gravity and speed; however, it is also affected by driver skill, external conditions, component ware, etc. Getting the 'best' performance from a vehicle can only be achieved by a combination of good design and feedback from real laps under race conditions.  
  
Hitchins also notes that technological systems exhibit emergence. We can observe a number of levels of outcome which arise from interaction between elements in an [[Engineered System (glossary)|engineered system]] context.  At a simple level, some system outcomes or [[Attribute (glossary) | attributes]] have a fairly simple and well defined mapping to their [[Element (glossary) | elements]]; for example, center of gravity or top speed of a vehicle result from a combination of element properties and how they are combined.  Other behaviors can be associated with these simple outcomes, but their value emerges in [[Complex (glossary) | complex]] and less predictable ways across a system. For example, the single lap performance of a vehicle around a track is related to center of gravity and speed; however, it is also affected by driver skill, external conditions, component ware, etc.  Getting the 'best' performance from a vehicle can only be achieved by a combination of good design and feedback from real laps under race conditions. There are also outcomes which are less tangible and which come as a surprise to system developers and [[User (glossary) | users]]. How does lap time translate into a winning motor racing team? Why is a sports car more desirable to many than other vehicles with performances that are as good or better?   
+
There are also outcomes which are less tangible and which come as a surprise to both system developers and {{Term|User (glossary)|users}}. How does lap time translate into a winning motor racing team? Why is a sports car more desirable to many than other vehicles with performances that are as good or better?   
  
Thus, emergence can always be observed at the highest level of system. However, Hitchins ((2007, p.7) also points out that to the extent that the systems elements themselves can be considered as systems, they also exhibit emergence. Page (2009) refers to emergence as a “macro-level property.” Ryan (2007) contends that emergence is coupled to [[Scope (glossary) | scope]] rather than system hierarchical levels. In Ryan’s terms, scope has to do with spatial dimensions (how system elements are related to each other) rather than hierarchical levels.
+
Emergence can always be observed at the highest level of system. However, Hitchins (2007, 7) also points out that to the extent that the systems elements themselves can be considered as systems, they also exhibit emergence. Page (2009) refers to emergence as a “macro-level property.” Ryan (2007) contends that emergence is coupled to {{Term|Scope (glossary)|scope}} rather than system hierarchical levels. In Ryan’s terms, scope has to do with spatial dimensions (how system elements are related to each other) rather than hierarchical levels.
  
 
Abbott (2006) does not disagree with the general definition of emergence as discussed above. However, he takes issue with the notion that emergence operates outside the bounds of classical physics. He says that “such higher-level entities…can always be reduced to primitive physical forces.”
 
Abbott (2006) does not disagree with the general definition of emergence as discussed above. However, he takes issue with the notion that emergence operates outside the bounds of classical physics. He says that “such higher-level entities…can always be reduced to primitive physical forces.”
Line 22: Line 27:
 
==Types of Emergence==
 
==Types of Emergence==
  
A variety of definitions of types of emergence exists. See Emmeche et al.(1997), Chroust (2003) and O’Connor and Wong (2006) for specific details of some of the variants. Page (2009) describes three types of emergence: "simple", "weak", and "strong".  
+
A variety of definitions of types of emergence exists. See Emmeche et al. (1997), Chroust (2003) and O’Connor and Wong (2006) for specific details of some of the variants. Page (2009) describes three types of emergence: "simple", "weak", and "strong".
 +
 
 +
According to Page, '''simple emergence''' is generated by the combination of element properties and relationships and occurs in non-complex or “ordered”  systems (see [[Complexity]]) (2009). To achieve the emergent property of “controlled flight” we cannot consider only the wings, or the control system, or the propulsion system. All three must be considered, as well as the way these three are interconnected-with each other, as well as with all the other parts of the aircraft. Page suggests that simple emergence is the only type of emergence that can be predicted. This view of emergence is also referred to as {{Term|Synergy (glossary)|synergy}} (Hitchins 2009).
  
According to Page, '''Simple Emergence''' is generated by the combination of element properties and relationships and occurs in non-complex or “ordered”  systems (see [[Complexity]]) (2009). To achieve the emergent property of “controlled flight”, we cannot consider only the wings, or the control system, or the propulsion system. All three (plus all the other parts of an aircraft) and how they are interconnected must be considered. Page suggests that simple emergence is the only type of emergence that can be predicted. This view of emergence is also referred to as [[Synergy (glossary)|synergy]] (Hitchins 2009).
+
Page describes '''weak emergence''' as expected emergence which is desired (or at least allowed for) in the system {{Term|Structure (glossary)|structure}} (2009). However, since weak emergence is a product of a complex system, the actual level of emergence cannot be predicted just from knowledge of the characteristics of the individual system {{Term|Component (glossary)|components}}.
  
Page uses the term '''Weak Emergence''' to describe emergence which is expected and either desired or at least allowed for in the system [[Structure (glossary) |structure]] (2009). However, since weak emergence is a product of a complex system, the actual level of emergence cannot be predicted just from knowledge of the characteristics of the individual system [[Component (glossary) |components]].
+
The term '''strong emergence''' is used to describe unexpected emergence; that is, emergence not observed until the system is simulated or tested or, more alarmingly, until the system encounters in operation a situation that was not anticipated during design and development.  
  
The term '''Strong Emergence''' is used to describe unexpected emergence (Page, 2009). That is, emergence not observed until the system is simulated or tested-or, more alarmingly, until the system encounters in operation a situation that was not anticipated during design and development. Strong emergence may be evident in failures or shutdowns. For example, the US-Canada Blackout of 2003 as described by the US-Canada Power System Outage Task Force (2004) was a case of cascading shutdown that resulted from the [[Design (glossary) | design]] of the system. Even though there was no equipment failure, the shutdown was systemic. As Hitchins (2007, p. 15) points out, this example shows that emergent properties are not always beneficial.  
+
Strong emergence may be evident in failures or shutdowns. For example, the US-Canada Blackout of 2003 as described by the US-Canada Power System Outage Task Force (US-Canada Power Task Force 2004) was a case of cascading shutdown that resulted from the {{Term|Design (glossary)|design}} of the system. Even though there was no equipment failure, the shutdown was systemic. As Hitchins points out, this example shows that emergent properties are not always beneficial (Hitchins 2007, 15).  
  
 
Other authors make a different distinction between the ideas of strong, or unexpected, emergence and unpredictable emergence:   
 
Other authors make a different distinction between the ideas of strong, or unexpected, emergence and unpredictable emergence:   
  
*Firstly there are the unexpected properties that could have been predicted but were not considered in a systems development: '''''Properties which are unexpected by the observer because of his incomplete data set, with regard to the phenomenon at hand''''' (Francois, C. 2004, p 737).  A typical example of this would be unwanted vibration in a vehicle.  According to Jackson et al. (2010), a desired level of emergence is usually achieved by iteration. This may occur as a result of evolutionary [[Process (glossary) | processes]], in which element properties and combinations are "selected for", depending on how well they contribute to a systems effectiveness against [[Environment (glossary) | environmental]] pressures or by iteration of design parameters through [[Simulation (glossary) | simulation]] or build/test cycles.  Taking this view, the specific values of weak emergence can be refined and examples of strong emergence can be considered in subsequent iterations so long as they are amenable to analysis.  
+
*Firstly, there are the unexpected properties that could have been predicted but were not considered in a systems development: "Properties which are unexpected by the observer because of his incomplete data set, with regard to the phenomenon at hand" (Francois, C. 2004, 737).  According to Jackson et al. (2010), a desired level of emergence is usually achieved by iteration. This may occur as a result of evolutionary {{Term|Process (glossary)|processes}}, in which element properties and combinations are "selected for", depending on how well they contribute to a system’s effectiveness against {{Term|Environment (glossary)|environmental}} pressures or by iteration of design parameters through {{Term|Simulation (glossary)|simulation}} or build/test cycles.  Taking this view, the specific values of weak emergence can be refined, and examples of strong emergence can be considered in subsequent iterations so long as they are amenable to analysis.  
  
*Secondly, there are unexpected properties which cannot be predicted from the properties of the system’s components: '''''Properties which are, in and of themselves, not derivable a priori from the behavior of the parts of the system''''' (Francois, C. 2004, p 737).  This view of emergence is a more familiar one in social or natural sciences, but more controversial in [[Engineering (glossary) | engineering]].  We should distinguish between a theoretical and a practical unpredictability (Chroust 2002). The weather forecast is theoretically predictable, but beyond certain limited accuracy practically impossible due to its [[Chaos (glossary)| Chaotic]] nature. The emergence of consciousness in human beings cannot be deduced from the physiological properties of the brain.  For many, this genuinely unpredictable type of complexity has limited value for engineering.  (See Practical Considerations below.)
+
*Secondly, there are unexpected properties which cannot be predicted from the properties of the system’s components: "Properties which are, in and of themselves, not derivable a priori from the behavior of the parts of the system" (Francois, C. 2004, 737).  This view of emergence is a familiar one in social or natural sciences, but more controversial in {{Term|Engineering (glossary)|engineering}}.  We should distinguish between a theoretical and a practical unpredictability (Chroust 2002). The weather forecast is theoretically predictable, but beyond certain limited accuracy practically impossible due to its {{Term|Chaos (glossary)|chaotic}} nature. The emergence of consciousness in human beings cannot be deduced from the physiological properties of the brain.  For many, this genuinely unpredictable type of complexity has limited value for engineering.  (See '''Practical Considerations''' below.)
  
A type of system particularly subject to strong emergence is the [[System of Systems (SoS) (glossary)]]. The reason for this is that the SoS, by definition, is composed of different systems that were designed to operate independently. When these systems are operated together, the interaction among the parts of the system is likely to result in unexpected emergence. Chaotic or truly unpredictable emergence is likely for this class of systems.
+
A type of system particularly subject to strong emergence is the {{Term|System of Systems (SoS) (glossary)}}. The reason for this is that the SoS, by definition, is composed of different systems that were designed to operate independently. When these systems are operated together, the interaction among the parts of the system is likely to result in unexpected emergence. Chaotic or truly unpredictable emergence is likely for this class of systems.
  
 
==Emergent Properties==
 
==Emergent Properties==
  
[[Emergent Property (glossary)|Emergent properties]] can be defined as follows: “A property of a complex system is said to be ‘emergent’ [in the case when], although it arises out of the properties and relations characterizing its simpler constituents, it is neither predictable from, nor reducible to, these lower-level characteristics”, Honderich (1995, 224),
+
{{Term|Emergent Property (glossary)|Emergent properties}} can be defined as follows: “A property of a complex system is said to be ‘emergent’ [in the case when], although it arises out of the properties and relations characterizing its simpler constituents, it is neither predictable from, nor reducible to, these lower-level characteristics” (Honderich 1995, 224).
  
All systems can have emergent properties which may or may not be predictable or amenable to [[Model (glossary) | modeling]], as discussed above. Much of the literature on [[Complexity (glossary)|complexity]] includes emergence as a defining characteristic of complex systems. For example, Boccara (2004) states that “The appearance of emergent properties is the single most distinguishing feature of complex systems”.  In general, the more ordered a systems is, the easier its emergent properties are to predict. The more complex a system is, the more difficult predicting its emergent properties becomes.
+
All systems can have emergent properties which may or may not be predictable or amenable to {{Term|Model (glossary)|modeling}}, as discussed above. Much of the literature on {{Term|Complexity (glossary)|complexity}} includes emergence as a defining characteristic of complex systems. For example, Boccara (2004) states that “The appearance of emergent properties is the single most distinguishing feature of complex systems. In general, the more ordered a system is, the easier its emergent properties are to predict. The more complex a system is, the more difficult predicting its emergent properties becomes.
  
 
Some practitioners use the term “emergence” only when referring to “strong emergence”. These practitioners refer to the other two forms of emergent behavior as synergy or “system level behavior” (Chroust 2002).  Taking this view, we would reserve the term "Emergent Property" for unexpected properties, which can be modeled or refined through iterations of the systems development.
 
Some practitioners use the term “emergence” only when referring to “strong emergence”. These practitioners refer to the other two forms of emergent behavior as synergy or “system level behavior” (Chroust 2002).  Taking this view, we would reserve the term "Emergent Property" for unexpected properties, which can be modeled or refined through iterations of the systems development.
  
Unforeseen emergence causes nasty shocks. Many believe that the main job of the [[Systems Approach (glossary)| systems approach]] is to prevent undesired emergence in order to minimize the [[Risk (glossary) | risk]] of unexpected and potentially undesirable outcomes. This review of emergent properties is often specifically associated with identifying and avoiding system failures (Hitchins 2007).  
+
Unforeseen emergence causes nasty shocks. Many believe that the main job of the {{Term|Systems Approach (glossary)|systems approach}} is to prevent undesired emergence in order to minimize the {{Term|Risk (glossary)|risk}} of unexpected and potentially undesirable outcomes. This review of emergent properties is often specifically associated with identifying and avoiding system failures (Hitchins 2007).  
  
Good SE isn't just focused on avoiding system failure. It also involves maximizing [[Opportunity (glossary) | opportunity]] by understanding and exploiting emergence in [[Engineered System (glossary)|engineered systems]] to create the required system level characteristics from synergistic interactions between the [[Component (glossary) | components]], not just from the components themselves, (Sillitto, 2010)
+
Good SE isn't just focused on avoiding system failure, however. It also involves maximizing {{Term|Opportunity (glossary)|opportunity}} by understanding and exploiting emergence in {{Term|Engineered System (glossary)|engineered systems}} to create the required system level characteristics from synergistic interactions between the {{Term|Component (glossary)|components}}, not just from the components themselves (Sillitto 2010).
  
One important group of emergent properties include properties such as [[Agility (glossary)|agility]] and [[Resilience (glossary)|resilience]]. These are critical system properties that are not meaningful except at whole system level.
+
One important group of emergent properties includes properties such as {{Term|Agility (glossary)|agility}} and {{Term|Resilience (glossary)|resilience}}. These are critical system properties that are not meaningful except at the whole system level.
  
 
==Practical Considerations==
 
==Practical Considerations==
  
As mentioned above, one way to manage emergent properties is through iteration.  The requirements to iterate the design of an engineered system to achieve desired emergence results in a [[Design (glossary) | design]] [[Process (glossary) | process]] are more lengthy than those needed to design an “ordered” system.  Creating an engineered system capable of such iteration may also require a more configurable or modular solution.  The result is that complex systems may be more costly and time-consuming to develop than “ordered” ones, and the cost and time to develop is inherently less predictable.  
+
As mentioned above, one way to manage emergent properties is through iteration.  The requirements to iterate the design of an engineered system to achieve desired emergence results in a {{Term|Design (glossary)|design}} {{Term|Process (glossary)|process}} are lengthier than those needed to design an ordered system.  Creating an engineered system capable of such iteration may also require a more configurable or modular solution.  The result is that complex systems may be more costly and time-consuming to develop than ordered ones, and the cost and time to develop is inherently less predictable.  
  
Sillitto (2010) observes that “engineering design domains that exploit emergence have good mathematical models of the domain, and rigorously control variability of components and subsystems, and of process, in both design and operation”. The iterations discussed above can be accelerated by using simulation and modeling, so that not all the iterations need to involve building real systems and operating them in the real environment.
+
Sillitto (2010) observes that “engineering design domains that exploit emergence have good mathematical models of the domain, and rigorously control variability of components and subsystems, and of process, in both design and operation.The iterations discussed above can be accelerated by using simulation and modeling, so that not all the iterations need to involve building real systems and operating them in the real environment.
  
The idea of domain models is explored further by Hybertson (2009) in the context of general models or [[Pattern (glossary) | patterns]] learned over time and captured in a model space. Hybertson states that knowing what emergence will appear from a given design, including side effects, requires hindsight. For a new type of problem that has not been solved, or a new type of system that has not been built, it is virtually impossible to predict emergent behavior of the solution or system. Some hindsight, or at least some insight, can be obtained by modeling and iterating a specific system design; however, iterating the design within the development of one system yields only limited hindsight and often does not give a full sense of emergence and side effects.
+
The idea of domain models is explored further by Hybertson in the context of general models or {{Term|Pattern (glossary)|patterns}} learned over time and captured in a model space (Hybertson 2009). Hybertson states that knowing what emergence will appear from a given design, including side effects, requires hindsight. For a new type of problem that has not been solved, or a new type of system that has not been built, it is virtually impossible to predict emergent behavior of the solution or system. Some hindsight, or at least some insight, can be obtained by modeling and iterating a specific system design; however, iterating the design within the development of one system yields only limited hindsight and often does not give a full sense of emergence and side effects.
  
 
True hindsight and understanding comes from building multiple systems of the same type and deploying them, then observing their emergent behavior in operation and the side effects of placing them in their environments. If those observations are done systematically, and the emergence and side effects are distilled and captured in relation to the design of the systems — including the variations in those designs — and made available to the community, then we are in a position to predict and exploit the emergence.  
 
True hindsight and understanding comes from building multiple systems of the same type and deploying them, then observing their emergent behavior in operation and the side effects of placing them in their environments. If those observations are done systematically, and the emergence and side effects are distilled and captured in relation to the design of the systems — including the variations in those designs — and made available to the community, then we are in a position to predict and exploit the emergence.  
  
Two factors are discovered in this type of testing environment: what works (that is, what emergent behavior and side effects are desirable); and what does not work (that is, what emergent behavior and side effects are undesirable). What works affirms the design. What does not work calls for corrections in the design. This is why multiple systems, especially complex systems, must be built and deployed over time and in different environments; to learn and understand the relations among the design, emergent behavior, side effects, and environment.   
+
Two factors are discovered in this type of testing environment: what works (that is, what emergent behavior and side effects are desirable); and what does not work (that is, what emergent behavior and side effects are undesirable). What works affirms the design. What does not work calls for corrections in the design. This is why multiple systems, especially complex systems, must be built and deployed over time and in different environments - to learn and understand the relations among the design, emergent behavior, side effects, and environment.   
  
These two types of captured learning correspond respectively to patterns and “[[Antipattern (glossary) |antipatterns]]” or patterns of failure, both of which are discussed in a broader context in the [[Principles of Systems Thinking]]  and [[Patterns of Systems Thinking]] topics.
+
These two types of captured learning correspond respectively to patterns and “{{Term|Antipattern (glossary)|antipatterns}},” or patterns of failure, both of which are discussed in a broader context in the [[Principles of Systems Thinking]]  and [[Patterns of Systems Thinking]] topics.
  
The use of iterations to refine the values of emergent properties, either across the life of a single system or through the development of patterns encapsulating knowledge gained from multiple developments, applies most easily to the discussion of strong emergence above. In this sense those properties which can be observed but cannot be related to design choices are not relevant to a systems approach. However, they can have value when dealing with a combination of engineering and managed problems which occur for system of systems contexts ((Sillitto 2010)). (See [[Systems Approach Applied to Engineered Systems]].)
+
The use of iterations to refine the values of emergent properties, either across the life of a single system or through the development of patterns encapsulating knowledge gained from multiple developments, applies most easily to the discussion of strong emergence above. In this sense, those properties which can be observed but cannot be related to design choices are not relevant to a systems approach. However, they can have value when dealing with a combination of engineering and managed problems which occur for system of systems contexts (Sillitto 2010). (See [[Systems Approach Applied to Engineered Systems]].)
  
 
==References==  
 
==References==  
 
===Works Cited===
 
===Works Cited===
Abbott, R. 2006. "Emergence Explained: Getting Epiphenomena to Do Real Work". Complexity, 12(1) (September-October): 13-26.
+
Abbott, R. 2006. "Emergence explained: Getting epiphenomena to do real work". ''Complexity,'' vol. 12, no. 1 (September-October), pp. 13-26.  
 
 
Bedau, M.A. and P. Humphreys, P. (eds.). 2008. "Emergence" In Contemporary Readings in Philosophy and Science. Cambridge, MA, USA: The MIT Press.  
 
  
Boccara, N. 2004. Modeling Complex Systems. New York: Springer-Verlag.
+
Bedau, M.A. and P. Humphreys, P. (eds.). 2008. "Emergence" In ''Contemporary Readings in Philosophy and Science''. Cambridge, MA, USA: The MIT Press.  
  
Checkland, P. 1999. Systems Thinking, Systems Practice. New York, NY, USA: John Wiley & Sons.  
+
Boccara, N. 2004. ''Modeling Complex Systems.'' New York, NY, USA: Springer-Verlag.
  
Chroust. G. 2002. Emergent Properties in Software Systems, pages 277-289. 10th Interdisciplinary Information Management Talks; Hofer, C. and Chroust, G. (eds.). Verlag Trauner Linz, ISBN 3 85487 424-3.
+
Checkland, P. 1999. ''Systems Thinking, Systems Practice.'' New York, NY, USA: John Wiley & Sons.  
  
Chroust, G. 2003. The Concept of Emergence in Systems Engineering. The Eleventh Fuschl Conversation Hofer. C. and Chroust. G. OSGK, Reports of the Austrian Society for Cybernetic Studies, Vienna, ISBN 3-85206-166-0.
+
Chroust. G. 2002. "Emergent properties in software systems." 10th Interdisciplinary Information Management Talks; Hofer, C. and Chroust, G. (eds.). Verlag Trauner Linz, pp. 277-289.
  
Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. Explaining Emergence: Towards an Ontology of Levels. Journal for General Philosophy of
+
Chroust, G., C. Hofer, C. Hoyer (eds.). 2005. ''The concept of emergence in systems engineering." The 12th Fuschl Conversation, April 18-23, 2004, Institute for Systems Engineering and Automation, Johannes Kepler University Linz. pp. 49-60.
Science 28: 83-119 (1997). http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.  
 
  
Francois, C. 2004. International Encyclopedia of Systems and Cybernetics, 2nd edition, 2 volumes. K.G.Saur, Munchen 3-598-11630-6.   
+
Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. "Explaining emergence: Towards an ontology of levels." ''Journal for General Philosophy of Science,'' vol. 28, no. 1, pp. 83-119. Accessed 3 December 2014Available at:http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.
  
Hitchins, D. 2007. Systems Engineering: A 21st Century Systems Methodology. Hoboken, NJ, USA: John Wiley & Sons.  
+
Francois, C. 2004. ''International Encyclopedia of Systems and Cybernetics'', 2nd edition, 2 volumes. Munich, Germany: K.G.Saur Verlag.
  
Honderich. T. 1995. The Oxford Companion to Philosophy. New York: Oxford University Press.
+
Hitchins, D. 2007. ''Systems Engineering: A 21st Century Systems Methodology''. Hoboken, NJ, USA: John Wiley & Sons.  
  
Hybertson, D. 2009. Model-Oriented Systems Engineering Science: A Unifying Framework for Traditional and Complex Systems. Auerbach/CRC Press, Boca Raton, FL.
+
Honderich. T. 1995. ''The Oxford Companion to Philosophy''. New York, NY, USA: Oxford University Press.
  
Jackson, S., D. Hitchins, and H. Eisner. 2010. "What is the Systems Approach?" INCOSE Insight 13(1) (April 2010): 41-43.  
+
Hybertson, D. 2009. ''Model-Oriented Systems Engineering Science: A Unifying Framework for Traditional and Complex Systems''. Boca Raton, FL, USA: Auerbach/CRC Press.
  
O’Connor, T. and H. Wong. 2006. Emergent Properties. Stanford Encyclopedia of Philosophy. http://plato.stanford.edu/entries/properties-emergent/.  
+
Jackson, S., D. Hitchins, and H. Eisner. 2010. "What is the Systems Approach?" INCOSE ''Insight.'' 13(1) (April 2010): 41-43.  
  
Page, S.E. 2009. Understanding Complexity. The Great Courses. Chantilly, VA, USA: The Teaching Company.  
+
O’Connor, T. and H. Wong. 2006. "Emergent Properties," in  ''Stanford Encyclopedia of Philosophy''. Accessed December 3 2014:  Available at: http://plato.stanford.edu/entries/properties-emergent/.  
  
Ryan, A. 2007. "Emergence is Coupled to Scope, Not Level." Complexity, 13(2) (November-December).  
+
Page, S.E. 2009. ''Understanding Complexity.'' The Great Courses. Chantilly, VA, USA: The Teaching Company.  
  
Sheard, S.A. and A. Mostashari. 2008. "Principles of Complex Systems for Systems Engineering." Systems Engineering. 12: 295-311.  
+
Ryan, A. 2007. "Emergence is coupled to scope, not level." ''Complexity,'' vol. 13, no. 2, November-December.  
  
Sillitto, H.G. 2010. "Design Principles for Ultra-Large-Scale Systems". Proceedings of the INCOSE International Symposium, Chicago, July 2010, reprinted in “The Singapore Engineer”, April 2011  
+
Sillitto, H.G. 2010. "Design principles for ultra-large-scale systems". Proceedings of the 20th Annual International Council on Systems Engineering (INCOSE) International Symposium, July 2010, Chicago, IL, USA, reprinted in “The Singapore Engineer,April 2011.
  
US-Canada Power System Outage Task Force. 2004. Final Report on the August 14, 2003 Blackout in the United States and Canada: Causes and Recommendations. April, 2004. Washington-Ottawa. Available at https://reports.energy.gov/BlackoutFinal-Web.pdf.
+
US-Canada Power System Outage Task Force. 2004. ''Final Report on the August 14, 2003 Blackout in the United States and Canada: Causes and Recommendations''. Washington-Ottawa. Accessed 3 December 3, 2014. Available: http://energy.gov/oe/downloads/blackout-2003-final-report-august-14-2003-blackout-united-states-and-canada-causes-and
  
 
===Primary References===
 
===Primary References===
  
Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. "[[Explaining Emergence]]: Towards an Ontology of Levels." ''Journal for General Philosophy of Science'', 28: 83-119 (1997). http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.  
+
Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. "[[Explaining Emergence|Explaining emergence]]: Towards an ontology of levels." ''Journal for General Philosophy of Science,'' vol. 28, no. 1, pp. 83-119. Available: http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.  
  
Hitchins, D. 2007. [[Systems Engineering: A 21st Century Systems Methodology]]. Hoboken, NJ, USA: John Wiley & Sons.
+
Hitchins, D. 2007. ''[[Systems Engineering: A 21st Century Systems Methodology]]''. Hoboken, NJ, USA: John Wiley & Sons.
  
Page, S. E. 2009. [[Understanding Complexity]]. The Great Courses. Chantilly, VA, USA: The Teaching Company.
+
Page, S. E. 2009. ''[[Understanding Complexity]]''. The Great Courses. Chantilly, VA, USA: The Teaching Company.
  
 
===Additional References===
 
===Additional References===
  
Jackson, S., D. Hitchins, and H. Eisner. 2010. "What is the Systems Approach?" INCOSE ''Insight.'' 13(1) (April): 41-43.
+
Sheard, S.A. and A. Mostashari. 2008. "Principles of complex systems for systems engineering." ''Systems Engineering,'' vol. 12, no. 4, pp. 295-311.
 
 
Shalizi, C. 2007. Emergent Properties. http://www.cscs.umich.edu/~crshalizi/notebooks/emergentproperties.html.
 
 
 
Sheard, S.A. and A. Mostashari. 2008. "Principles of Complex Systems for Systems Engineering." ''Systems Engineering''. 12: 295-311.
 
  
US-Canada Power System Outage Task Force. 2004. ''Final Report on the August 14, 2003 Blackout in the United States and Canada: Causes and Recommendations''. April, 2004. Washington-Ottawa. Available at https://reports.energy.gov/BlackoutFinal-Web.pdf.
 
 
----
 
----
<center>[[Complexity|< Previous Article]] | [[Systems Fundamentals|Parent Article]] | [[Systems Science|Next Article >]]</center>
+
<center>[[Complexity|< Previous Article]] | [[Systems Science|Parent Article]] | [[Systems Thinking|Next Article >]]</center>
 
 
{{DISQUS}}
 
  
 +
<center>'''SEBoK v. 2.10, released 06 May 2024'''</center>
  
 
[[Category:Part 2]][[Category:Topic]][[Category:Systems Fundamentals]]
 
[[Category:Part 2]][[Category:Topic]][[Category:Systems Fundamentals]]

Latest revision as of 21:53, 2 May 2024


Lead Author: Rick Adcock, Contributing Authors: Scott Jackson, Dick Fairley, Janet Singer, Duane Hybertson


This topic forms part of the Systems Science knowledge area (KA). It gives the background to some of the ways in which emergenceemergence has been described, as well as an indication of current thinking on what it is and how it influences systems engineeringsystems engineering (SE) practice. It will discuss how these ideas relate to the general definitions of systemssystems given in What is a System?; in particular, how they relate to different engineered systemengineered system contexts. This topic is closely related to the complexity topic that precedes it.

Emergence is a consequence of the fundamental system conceptsconcepts of holismholism and interaction (Hitchins 2007, 27). System wholes have behaviorsbehaviors and properties arising from the organization of their elementselements and their relationships, which only become apparent when the system is placed in different environmentsenvironments.

Questions that arise from this definition include: What kinds of systems exhibit different kinds of emergence and under what conditions? Can emergence be predicted, and is it beneficial or detrimental to a system? How do we deal with emergence in the development and use of engineered systems? Can it be planned for? How?

There are many varied and occasionally conflicting views on emergence. This topic presents the prevailing views and provides references for others.

Overview of Emergence

As defined by Checkland, emergenceemergence is “the principle that entities exhibit properties which are meaningful only when attributed to the whole, not to its parts.” (Checkland 1999, 314). Emergent system behaviorbehavior can be viewed as a consequence of the interactions and relationships between system elementssystem elements rather than the behavior of individual elements. It emerges from a combination of the behavior and properties of the system elements and the systems structure or allowable interactions between the elements, and may be triggered or influenced by a stimulus from the systems environment.

Emergence is common in nature. The pungent gas ammonia results from the chemical combination of two odorless gases, hydrogen and nitrogen. As individual parts, feathers, beaks, wings, and gullets do not have the ability to overcome gravity; however, when properly connected in a bird, they create the emergent behavior of flight. What we refer to as “self-awareness” results from the combined effect of the interconnected and interacting neurons that make up the brain (Hitchins 2007, 7).

Hitchins also notes that technological systems exhibit emergence. We can observe a number of levels of outcome which arise from interaction between elements in an engineered systemengineered system context. At a simple level, some system outcomes or attributesattributes have a fairly simple and well defined mapping to their elementselements; for example, center of gravity or top speed of a vehicle result from a combination of element properties and how they are combined. Other behaviors can be associated with these simple outcomes, but their value emerges in complexcomplex and less predictable ways across a system. The single lap performance of a vehicle around a track is related to center of gravity and speed; however, it is also affected by driver skill, external conditions, component ware, etc. Getting the 'best' performance from a vehicle can only be achieved by a combination of good design and feedback from real laps under race conditions.

There are also outcomes which are less tangible and which come as a surprise to both system developers and usersusers. How does lap time translate into a winning motor racing team? Why is a sports car more desirable to many than other vehicles with performances that are as good or better?

Emergence can always be observed at the highest level of system. However, Hitchins (2007, 7) also points out that to the extent that the systems elements themselves can be considered as systems, they also exhibit emergence. Page (2009) refers to emergence as a “macro-level property.” Ryan (2007) contends that emergence is coupled to scopescope rather than system hierarchical levels. In Ryan’s terms, scope has to do with spatial dimensions (how system elements are related to each other) rather than hierarchical levels.

Abbott (2006) does not disagree with the general definition of emergence as discussed above. However, he takes issue with the notion that emergence operates outside the bounds of classical physics. He says that “such higher-level entities…can always be reduced to primitive physical forces.”

Bedau and Humphreys (2008) and Francois (2004) provide comprehensive descriptions of the philosophical and scientific background of emergence.

Types of Emergence

A variety of definitions of types of emergence exists. See Emmeche et al. (1997), Chroust (2003) and O’Connor and Wong (2006) for specific details of some of the variants. Page (2009) describes three types of emergence: "simple", "weak", and "strong".

According to Page, simple emergence is generated by the combination of element properties and relationships and occurs in non-complex or “ordered” systems (see Complexity) (2009). To achieve the emergent property of “controlled flight” we cannot consider only the wings, or the control system, or the propulsion system. All three must be considered, as well as the way these three are interconnected-with each other, as well as with all the other parts of the aircraft. Page suggests that simple emergence is the only type of emergence that can be predicted. This view of emergence is also referred to as synergysynergy (Hitchins 2009).

Page describes weak emergence as expected emergence which is desired (or at least allowed for) in the system structurestructure (2009). However, since weak emergence is a product of a complex system, the actual level of emergence cannot be predicted just from knowledge of the characteristics of the individual system componentscomponents.

The term strong emergence is used to describe unexpected emergence; that is, emergence not observed until the system is simulated or tested or, more alarmingly, until the system encounters in operation a situation that was not anticipated during design and development.

Strong emergence may be evident in failures or shutdowns. For example, the US-Canada Blackout of 2003 as described by the US-Canada Power System Outage Task Force (US-Canada Power Task Force 2004) was a case of cascading shutdown that resulted from the designdesign of the system. Even though there was no equipment failure, the shutdown was systemic. As Hitchins points out, this example shows that emergent properties are not always beneficial (Hitchins 2007, 15).

Other authors make a different distinction between the ideas of strong, or unexpected, emergence and unpredictable emergence:

  • Firstly, there are the unexpected properties that could have been predicted but were not considered in a systems development: "Properties which are unexpected by the observer because of his incomplete data set, with regard to the phenomenon at hand" (Francois, C. 2004, 737). According to Jackson et al. (2010), a desired level of emergence is usually achieved by iteration. This may occur as a result of evolutionary processesprocesses, in which element properties and combinations are "selected for", depending on how well they contribute to a system’s effectiveness against environmentalenvironmental pressures or by iteration of design parameters through simulationsimulation or build/test cycles. Taking this view, the specific values of weak emergence can be refined, and examples of strong emergence can be considered in subsequent iterations so long as they are amenable to analysis.
  • Secondly, there are unexpected properties which cannot be predicted from the properties of the system’s components: "Properties which are, in and of themselves, not derivable a priori from the behavior of the parts of the system" (Francois, C. 2004, 737). This view of emergence is a familiar one in social or natural sciences, but more controversial in engineeringengineering. We should distinguish between a theoretical and a practical unpredictability (Chroust 2002). The weather forecast is theoretically predictable, but beyond certain limited accuracy practically impossible due to its chaoticchaotic nature. The emergence of consciousness in human beings cannot be deduced from the physiological properties of the brain. For many, this genuinely unpredictable type of complexity has limited value for engineering. (See Practical Considerations below.)

A type of system particularly subject to strong emergence is the system of systems (sos)system of systems (sos). The reason for this is that the SoS, by definition, is composed of different systems that were designed to operate independently. When these systems are operated together, the interaction among the parts of the system is likely to result in unexpected emergence. Chaotic or truly unpredictable emergence is likely for this class of systems.

Emergent Properties

Emergent propertiesEmergent properties can be defined as follows: “A property of a complex system is said to be ‘emergent’ [in the case when], although it arises out of the properties and relations characterizing its simpler constituents, it is neither predictable from, nor reducible to, these lower-level characteristics” (Honderich 1995, 224).

All systems can have emergent properties which may or may not be predictable or amenable to modelingmodeling, as discussed above. Much of the literature on complexitycomplexity includes emergence as a defining characteristic of complex systems. For example, Boccara (2004) states that “The appearance of emergent properties is the single most distinguishing feature of complex systems.” In general, the more ordered a system is, the easier its emergent properties are to predict. The more complex a system is, the more difficult predicting its emergent properties becomes.

Some practitioners use the term “emergence” only when referring to “strong emergence”. These practitioners refer to the other two forms of emergent behavior as synergy or “system level behavior” (Chroust 2002). Taking this view, we would reserve the term "Emergent Property" for unexpected properties, which can be modeled or refined through iterations of the systems development.

Unforeseen emergence causes nasty shocks. Many believe that the main job of the systems approachsystems approach is to prevent undesired emergence in order to minimize the riskrisk of unexpected and potentially undesirable outcomes. This review of emergent properties is often specifically associated with identifying and avoiding system failures (Hitchins 2007).

Good SE isn't just focused on avoiding system failure, however. It also involves maximizing opportunityopportunity by understanding and exploiting emergence in engineered systemsengineered systems to create the required system level characteristics from synergistic interactions between the componentscomponents, not just from the components themselves (Sillitto 2010).

One important group of emergent properties includes properties such as agilityagility and resilienceresilience. These are critical system properties that are not meaningful except at the whole system level.

Practical Considerations

As mentioned above, one way to manage emergent properties is through iteration. The requirements to iterate the design of an engineered system to achieve desired emergence results in a designdesign processprocess are lengthier than those needed to design an ordered system. Creating an engineered system capable of such iteration may also require a more configurable or modular solution. The result is that complex systems may be more costly and time-consuming to develop than ordered ones, and the cost and time to develop is inherently less predictable.

Sillitto (2010) observes that “engineering design domains that exploit emergence have good mathematical models of the domain, and rigorously control variability of components and subsystems, and of process, in both design and operation.” The iterations discussed above can be accelerated by using simulation and modeling, so that not all the iterations need to involve building real systems and operating them in the real environment.

The idea of domain models is explored further by Hybertson in the context of general models or patternspatterns learned over time and captured in a model space (Hybertson 2009). Hybertson states that knowing what emergence will appear from a given design, including side effects, requires hindsight. For a new type of problem that has not been solved, or a new type of system that has not been built, it is virtually impossible to predict emergent behavior of the solution or system. Some hindsight, or at least some insight, can be obtained by modeling and iterating a specific system design; however, iterating the design within the development of one system yields only limited hindsight and often does not give a full sense of emergence and side effects.

True hindsight and understanding comes from building multiple systems of the same type and deploying them, then observing their emergent behavior in operation and the side effects of placing them in their environments. If those observations are done systematically, and the emergence and side effects are distilled and captured in relation to the design of the systems — including the variations in those designs — and made available to the community, then we are in a position to predict and exploit the emergence.

Two factors are discovered in this type of testing environment: what works (that is, what emergent behavior and side effects are desirable); and what does not work (that is, what emergent behavior and side effects are undesirable). What works affirms the design. What does not work calls for corrections in the design. This is why multiple systems, especially complex systems, must be built and deployed over time and in different environments - to learn and understand the relations among the design, emergent behavior, side effects, and environment.

These two types of captured learning correspond respectively to patterns and “antipatternsantipatterns,” or patterns of failure, both of which are discussed in a broader context in the Principles of Systems Thinking and Patterns of Systems Thinking topics.

The use of iterations to refine the values of emergent properties, either across the life of a single system or through the development of patterns encapsulating knowledge gained from multiple developments, applies most easily to the discussion of strong emergence above. In this sense, those properties which can be observed but cannot be related to design choices are not relevant to a systems approach. However, they can have value when dealing with a combination of engineering and managed problems which occur for system of systems contexts (Sillitto 2010). (See Systems Approach Applied to Engineered Systems.)

References

Works Cited

Abbott, R. 2006. "Emergence explained: Getting epiphenomena to do real work". Complexity, vol. 12, no. 1 (September-October), pp. 13-26.

Bedau, M.A. and P. Humphreys, P. (eds.). 2008. "Emergence" In Contemporary Readings in Philosophy and Science. Cambridge, MA, USA: The MIT Press.

Boccara, N. 2004. Modeling Complex Systems. New York, NY, USA: Springer-Verlag.

Checkland, P. 1999. Systems Thinking, Systems Practice. New York, NY, USA: John Wiley & Sons.

Chroust. G. 2002. "Emergent properties in software systems." 10th Interdisciplinary Information Management Talks; Hofer, C. and Chroust, G. (eds.). Verlag Trauner Linz, pp. 277-289.

Chroust, G., C. Hofer, C. Hoyer (eds.). 2005. The concept of emergence in systems engineering." The 12th Fuschl Conversation, April 18-23, 2004, Institute for Systems Engineering and Automation, Johannes Kepler University Linz. pp. 49-60.

Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. "Explaining emergence: Towards an ontology of levels." Journal for General Philosophy of Science, vol. 28, no. 1, pp. 83-119. Accessed 3 December 2014. Available at:http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.

Francois, C. 2004. International Encyclopedia of Systems and Cybernetics, 2nd edition, 2 volumes. Munich, Germany: K.G.Saur Verlag.

Hitchins, D. 2007. Systems Engineering: A 21st Century Systems Methodology. Hoboken, NJ, USA: John Wiley & Sons.

Honderich. T. 1995. The Oxford Companion to Philosophy. New York, NY, USA: Oxford University Press.

Hybertson, D. 2009. Model-Oriented Systems Engineering Science: A Unifying Framework for Traditional and Complex Systems. Boca Raton, FL, USA: Auerbach/CRC Press.

Jackson, S., D. Hitchins, and H. Eisner. 2010. "What is the Systems Approach?" INCOSE Insight. 13(1) (April 2010): 41-43.

O’Connor, T. and H. Wong. 2006. "Emergent Properties," in Stanford Encyclopedia of Philosophy. Accessed December 3 2014: Available at: http://plato.stanford.edu/entries/properties-emergent/.

Page, S.E. 2009. Understanding Complexity. The Great Courses. Chantilly, VA, USA: The Teaching Company.

Ryan, A. 2007. "Emergence is coupled to scope, not level." Complexity, vol. 13, no. 2, November-December.

Sillitto, H.G. 2010. "Design principles for ultra-large-scale systems". Proceedings of the 20th Annual International Council on Systems Engineering (INCOSE) International Symposium, July 2010, Chicago, IL, USA, reprinted in “The Singapore Engineer,” April 2011.

US-Canada Power System Outage Task Force. 2004. Final Report on the August 14, 2003 Blackout in the United States and Canada: Causes and Recommendations. Washington-Ottawa. Accessed 3 December 3, 2014. Available: http://energy.gov/oe/downloads/blackout-2003-final-report-august-14-2003-blackout-united-states-and-canada-causes-and

Primary References

Emmeche, C., S. Koppe, and F. Stjernfelt. 1997. "Explaining emergence: Towards an ontology of levels." Journal for General Philosophy of Science, vol. 28, no. 1, pp. 83-119. Available: http://www.nbi.dk/~emmeche/coPubl/97e.EKS/emerg.html.

Hitchins, D. 2007. Systems Engineering: A 21st Century Systems Methodology. Hoboken, NJ, USA: John Wiley & Sons.

Page, S. E. 2009. Understanding Complexity. The Great Courses. Chantilly, VA, USA: The Teaching Company.

Additional References

Sheard, S.A. and A. Mostashari. 2008. "Principles of complex systems for systems engineering." Systems Engineering, vol. 12, no. 4, pp. 295-311.


< Previous Article | Parent Article | Next Article >
SEBoK v. 2.10, released 06 May 2024