Software Engineering Requirements Are Volatile: Design, Resource Allocation, and Lifecyles Aren't So Flexible

For the majority of software development initiatives, bad requirements are a fact of life. Even when there is a high quality elicitation process, requirement change throughout the software lifecycle model. This is expected, if not desired to build a system that the customers wants and will use. But, it's difficult to change design and resource allocation once these have been developed based on initial requirements. And, the lifecycle model itself makes adjusting processes to accommodate new requirements difficult, even when abandoning discrete models in favor of more continuous approaches.

Bad requirements happen for many reasons. But, of all the requirements engineering processes, requirements elicitation has the highest incidence of malpractice.

Too little time is spent on elicitation and it is difficult to get customers to communicate their requirements because they either do not know what they want, are unable to fully define what they want or are unable to decide what they want. There also exists a communications barrier between systems developers and domain experts that provide the requirements. System developers do not know the terms of the domain and most domain experts are not conversant in software engineering terminology. Also, developers and customers often have different meanings for what a "requirement" is. Customers consider a requirement to be a statement of need while the developer sees a requirement as the real need of the customer that can be tested and validated. Despite the hype, formal methods have not been effective in bridging the gap between the customer and the developer.

The requirements analysis process is intended to verify the consistency and feasibility of requirements. However, technology issues often arise because of over or under analysis. Over analysis fails to set priorities for what is important and attempt to take on too broad of a scope while under analysis often takes place as a cost savings measure. Tools to support analysis have high learning curves and become shelf ware if they impose a process that is conflict with an organization's process.

Requirements management is also another source of questionable requirements.

Requirements management is meant to control change during and after the development of requirements. However, it is difficult for projects...

According to research sponsored by the Computer Resources Support Improvement Program (CRSIP):
The accepted requirements volatility metric is 1% of requirements per month. If it is much less, one should ask oneself if the system will be desirable to its intended audience. If it is much more than 2% a month, development chaos is all but assured."

Because requirements are volatile, projects need to use a system that facilitates the definition of a requirements baseline and an incremental lifecycle that supports changing requirements.

Requirements validation and verification needs to confirm existing requirements as well as identify missing requirements. However, customers cannot always understand mechanisms used to validate a system, introducing a quality issue. Often, validation and verification is performed too late in the requirements engineering process, rather than being a part of the initial elicitation, stage.

Bad requirements lead to poor software design because they provide deficient input into the development of the design and they lead to incorrect resource allocation decisions that cannot be easily corrected. The following Capers Jones's quote in Design Methods: Seeds of Human Futures appropriately sums up the situation of what happens when the wrong requirements are used in software design:

The fundamental problem is that designers are obliged to use current information to predict a future state that will not come about unless their predictions are correct. The final outcome of designing has to be assumed before the means to achieving it can be explored: the designers have to work backwards in time from an assumed effect upon the world to the beginning of a chain of events that will bring the effect about."

The data, architectural, interface and procedural designs are all negatively influenced by inadequate requirements. During the design phase, decisions are made regarding the appropriate hardware, programming languages, staffing, end-user interfaces, etc. When requirements are ill defined, resource estimates are likely to be incorrect.

Fixing misestimates of these is easier said than done one the project is underway. The Mythical Man-Month by Frederick Brooks is a book that explains why it's difficult to add new staffing resources to help a project catch up because the performance of programming teams does…