Chaos Theory in Organizational Design and Project Management

Background and Overview of Chaos Theory

Today, businesses of all sizes and types face an increasingly complex and globalized marketplace that demands effective strategies to achieve and sustain a competitive advantage. The vast majority of project-driven companies have encountered countless novel challenges in recent years, due in large part to the growing complexity of the environments in which they compete. To identify viable strategies that can help address these challenges, this study examines what initial factors are most salient in promoting successful project management outcomes. Drawing on the basic principles of chaos theory — which holds that even minor changes in the initial conditions of projects can have major effects on their outcomes — this study uses an exploratory research strategy focused on three main areas: the origins and fundamental tenets of chaos theory, current applications of chaos theory to organizational design and structure, and the implications of chaos theory for business practitioners.

During the early 1960s, Edward Lorenz, a professor of meteorology at the Massachusetts Institute of Technology, became interested in determining why weather was so difficult to forecast (Glenn, 1996). Accurately predicting weather patterns beyond a day or two seemed beyond the ability of meteorologists at the time. Based on Lorenz's original thinking about these constraints and his subsequent experimental inquiries, a veritable scientific revolution — termed "chaos theory" — resulted, transforming the manner in which business practitioners conceptualize the problems arrayed against their organizations (Oestreicher, 2007). In essence, a chaos theory view of the natural environment in which organizations operate holds that "the world is a nonlinear, complicated and unpredictable system [and] refers to systems which, while displaying disorder, contain a kind of order hidden inside them, and present disordered, nonlinear, unpredictable behavior" (Namaki, 2018, p. 41). In other words, even when humans are able to discern orderly patterns, there are invariably underlying factors that will have unexpected effects on the outcome of a given event.

Other authorities also cite the decades immediately following Lorenz's original conceptualizations as especially formative in shaping chaos theory's application to modern organizations. According to Millerd (2020):

In the 1970s and 80s a new field of research began to emerge called chaos theory. Scientists were looking at complex dynamic systems and trying to understand how they emerge and evolve. They drew inspiration from the natural world, looking at phenomena like how organisms grow in the wild, and how weather evolves. Eventually, they began applying the lessons to fields such as finance, biology, economics and, eventually, organizations. (para. 5)

While this incarnation of chaos theory is relatively recent in its introduction to the scientific community, its basic precepts actually date to antiquity. As Moshiri (2002) notes, "Chaos theory is rather new in science, but it is rooted in ancients' perception of the world" (p. 29). Ancient theorists seemed to intuitively understand that the same survival activities — such as hunting strategies — frequently produced mixed results, making absolute predictability all but impossible. Moshiri further explains that "the main idea [of chaos theory] is that although a complex system, such as the world, seems to be generated by a random, and therefore unpredictable process, it may run by a nonlinear deterministic process" (p. 29). In some ways, like fuzzy logic, chaos theory suffers from a branding problem: its title connotes scientific and technological complexity, but in reality the fundamental principles of chaos theory are fairly intuitive and readily understandable. In sum, chaos theory is a branch of mathematics that focuses on developing a better understanding of different types of complex systems in order to gain analytical insights (Adewumi, Kagamba, & Alochukwu, 2016).

This primary focus is grounded in the inevitability of unpredictable — and unexpected — behaviors in complex systems caused by even minuscule changes in a system's initial starting conditions. One expert advises that "chaos theory is the science of surprises, and not always pleasant surprises" (Schmarzo, 2017, para. 4). Schmarzo (2017) elaborates:

While traditional science deals with predictable phenomena like gravity, electricity, or chemical reactions, chaos theory deals with nonlinear things that are mostly impossible to predict, calculate, or control, like turbulence, a bar brawl, the stock market futures, debris flying out of the bed of a truck, or a child darting onto the street. (para. 4)

The basic principles of chaos theory include the following:

The butterfly effect: Probably the most commonly cited principle — that a butterfly flapping its wings in one part of the world can eventually cause a hurricane in another. More precisely, small changes in initial conditions can lead to drastic changes in results. People's lives are an ongoing demonstration of this principle.

Unpredictability: Because it is impossible to fully know all the initial conditions of a complex system in sufficient detail, it is also impossible to predict the ultimate fate of that system. Even slight errors in measuring a system's initial state can be amplified dramatically, rendering any prediction useless or even counterproductive.

Mixing: Turbulence describes how two adjacent points in a complex system can eventually end up in very different positions after time has elapsed. For example, two neighboring water molecules may end up in different parts of the ocean, or a group of helium balloons launched together may land in drastically different locations.

Feedback: Systems often become chaotic when feedback is present. The behavior of the stock market is a good example: as the value of a stock rises or falls, people are inclined to buy or sell that stock, which in turn further affects its price, causing chaotic and unpredictable movements (adapted from Schmarzo, 2017, para. 6).

The feedback principle is referenced time and again in the management literature concerning the application of chaos theory to organizations. The feedback loop is especially significant since management initiatives routinely receive ongoing input from project managers and other stakeholders that can substantially affect a project's outcome. This consideration also makes clear that project management is not a static enterprise but rather requires ongoing oversight and thoughtful responses to changes in the operating environment.

One noteworthy finding that emerged from the research is that while even minuscule changes can have major downstream effects, major changes tend to have less effect on an outcome when the organizational design and structure is appropriate for the purpose. According to Millerd (2020), "The individual behaviors and reactions of people within a complex system are unpredictable, but they are linked to one another. The feedback from each of those unpredictable actions will give feedback to others in the organization and influence their subsequent decisions and reactions" (para. 7). In other words, the extent to which everyone is aligned with a given project's successful outcome will likely be the extent to which the feedback loop contributes to that success (Millerd, 2020).

Taken together, chaos theory represents a valuable tool for modern business practitioners who are routinely confronted with seemingly inexplicable variables that ultimately affect their ability to achieve organizational goals.

Application of Chaos Theory to Organizational Design and Structure

Since its formal introduction in the early 1960s, chaos theory has experienced important changes and expansions on its original tenets, which can be summarized as follows:

Complex systems are unpredictable and disorderly; renewal and revitalization are essential processes for natural systems; small changes in initial conditions create enormous consequences; and similar patterns take place across layers — a concept known as fractal geometry (adapted from Englund, 2009, p. 2).

Over the past several decades, the increased application of chaos theory to various organizational settings has produced a new perspective called complexity science (Englund, 2009). In an organizational context, complexity science includes the following concepts, which have special importance for project management:

Information is the primary organizing force and should be shared widely; diverse relationships should be cultivated; vision should be embraced as an invisible field; people have similar needs and corresponding responses; working together is a source of meaning and purpose; and a shared sense of purpose should be established (Englund, 2009, p. 3).

Although the items in the foregoing list may appear unrelated, they all share the feature of representing an initial starting point for any project management initiative. It is therefore essential to ensure that organizational design and structure are aligned with these concepts in order to optimize the likelihood of successful project management outcomes. As Englund (2009) explains, "Each of these points provides guidance for organizational behavior" (para. 6). Implementing the appropriate organizational design and structure that takes these points into account is therefore an essential element of effective project management.

While these considerations are perhaps most relevant for larger companies given the greater number and presumed additional complexity of their projects, the same considerations are highly relevant for small- and medium-sized enterprises since project success is invariably associated with organizational performance, productivity, and profitability. As Englund (2009) concludes, "You need to create conditions for people to make connections, because those initial conditions provide the idea or practice that could lead to resolving a major issue or inventing a new product or service" (para. 7). Both types of outcomes are critically important for growing a business and securing a competitive advantage in today's globalized marketplace (Doherty & Delener, 2015). An informed application of chaos theory to organizational settings can therefore provide a number of important benefits, as discussed in the following section.