Decision Making is the process by which one alternative is selected over another. Decision making generally occurs in the planning phases of transportation projects, but last minute decision making has been shown to occur, sometimes successfully. Several procedures for making decisions have been outlined in effort to minimize inefficiencies or redundancies. These are idealized (or normative) processes, and describe how decisions might be made in an ideal world, and how they are described in official documents. Real-world processes are not as orderly.
Applied systems analysis is the use of rigorous methods to assist in determining optimal plans, designs and solutions to large scale problems through the application of analytical methods. Applied systems analysis focuses upon the use of methods, concepts and relationships between problems and the range of techniques available. Any problem can have multiple solutions. The optimal solution will depend upon technical feasibility (engineering) and costs and valuation (economics). Applied systems analysis is an attempt to move away from the engineering practice of design detail and to integrate feasible engineering solutions with desirable economic solutions. The systems designer faces the same problem as the economist, "efficient resource allocation" for a given objective function.
Systems analysis emerged during World War II, especially with the deployment of radar in a coordinated way. It spread to other fields such as fighter tactics, mission planning and weapons evaluation. Ultimately the use of mathematical techniques in such problems came to be known as operations research, while other statistical and econometric techniques are being applied. Optimization applies to cases where data is under-determined (fewer observations than dependent variables) and statistics where data is over-determined (more observations than dependent variables). After World War II, techniques spread to universities. Systems analysis saw further mathematical development and application to a broad variety of problems.
It has been said of Systems Analysis, that it is:
- "A coordinated set of procedures which addresses the fundamental issues of design and management: that of specifying how men, money and materials should be combined to achieve a higher purpose" - De Neufville
- "... primarily a methodology, a philosophical approach to solving problems for and for planning innovative advances" - Baker
- "Professionals who endeavor to analyze systematically the choices available to public and private agencies in making changes in the transportation system and services in a particular region" - Manheim
- "Systems analysis is not easy to write about: brief, one sentence definitions frequently are trivial" - Thomas
The most prominent decision-making process to emerge from systems analysis is rational planning, which will be discussed next, followed by some critiques and alternatives.
How does one (rationally) decide what to do?
The figure identifies three layers of abstraction. The first layer (top row) describes the high level process, which we can summarize in six steps. A second layer details many of the components of the first layer. A third layer, identified by the blue box, "abstract into model or framework" depends on the problem at hand
The first step is observational, review and gather data about the system under consideration. An understanding of the world around is required, including specifying the system.
The problem (defined in the next step) lies within a larger system, that comprises
- Objectives - measure the effectiveness or performance
- Environment - things which affect the system but are not affected by it
- Resources - factor inputs to do the work
- Components - set of activities or tasks of the system
- Management - sets goals, allocates resources and exercises control over components
- Model of how variables in 1-5 relate to each other
the detailed objectives are identified in the following step, and the detailed model for analysis of the problem is specified in the step after that.
Define the problemEdit
The second step is to define the problem more narrowly, in a sense to identify needs.
The third step is to formulate a goal. For major transportation projects, or projects with intense community interest, this may involve the public.
The goal will need to be testable, the process below "formulate goal" in the flowchart suggests this process in more detail.
The first aspect is to operationalize the goal. We need to measure the adverbs in the goal (e.g. how do we measure "quickly", "safely", "cleanly", or "inexpensively"). Some are straight-forward. "Quickly" is a measure of travel time or speed. But it needs to account for both the access and egress time, the waiting time, and the travel time, and these may not be weighted the same.
The second step is identifying the decision criteria. Each adverb may have a certain value, but it might be that an alternative has not merely have the most points in one area, but establish at least minimum satisfactory points in all areas. So a very fast mode must meet a specific safety test, and going faster does not necessarily mean it can also be more dangerous (despite what a rational economist might think about trade-offs).
The third is to weight those criteria. E.g. how important is speed vs. safety? This is in many ways a value question, though economics can try to value each of these aspects in monetary form, enabling Evaluation. For instance, many Negative externalities have been monetized, giving a value of time in delay, a value of pollution damages, and a value of life.
Examining, evaluating, and recommending alternatives is often the job of professionals, engineers, planners, and economists. Final selection is generally the job of elected or appointed officials for important projects.
There are several sub-problems here, the first is to generate alternatives. This may require significant creativity. Within major alternatives, there may be many sub-alternatives, e.g. the main alternative may be mode of travel, the sub-alternatives may be different alignments. For network problems there may be many combinations of alternative alignments. If the analyst is lucky, these are separable problems, that is, the choice of one sub-alignment is independent of the choice of alternative sub-alignments.
- Algorithms-systematic search over available alternatives
- Exact numerical
- Heuristic numerical
- Generate alternatives selectively, evaluate subjectively
- Fatal flaw analysis
- Simple rating schemes
- Delphi exercises
- Generate alternatives judgmentally, evaluate scientifically using system model
A critical issue is how many alternatives to consider. In principle, an infinite number of more or less similar alternatives may be generated, not all are practical, and some may be minor variations. In practice a stopping rule to consider a reasonable number of alternatives is used. Major exemplars of the alternatives may be used, with fine-tuning awaiting a later step after the first set of alternatives is analyzed. The process may be iterative, winnowing down alternatives and detailing alternatives as more information is gained throughout the analysis.
Abstract into model or frameworkEdit
"All Models are Wrong, Some Models are Less Wrong than Others" -- Anonymous
"All Models are Wrong, Some Models are Useful" -- George Box 
The term Model refers here to a mathematical representation of a system, while a Framework is a qualitative organizing principle for analyzing a system. The terms are sometimes used interchangeably.
Framework Example: Porter’s Diamond of AdvantageEdit
Model Example: The Four-Step Urban Transportation Planning SystemEdit
See Modeling for a deeper discussion of modeling questions.
This is either an output of the analytical model, or the result of subjective judgment.
Sherden identifies a number of major techniques for technological forecasting that can be used to ascertain expected performance of particular technologies, but that can be used within a technology to ascertain the performance of individual projects. These are listed in the following box:
The performance of each of the alternatives is compared across decision criteria, and weighted depending on the importance of those criteria. The alternative with the highest ranking would be identified, and this information would be brought forward to decision-makers.
Compute optimal decisionEdit
The analyst is generally not the decision maker. The actual influence of the results of the analysis in actual decisions will depend on:
- Determinacy of evaluation
- Confidence in the results on the part of the decision maker
- Consistency of rating among alternatives
A decision is made. A project is constructed or a program implemented.
Evaluating outcomes of a project includes comparing outcome against goals, but also against predictions, so that forecasting procedures can be improved. Analysis and implementation experience lead to revisions in systems definition, and may affect the values that underlay that definition. The output from this "last" step in is used as input to earlier steps in subsequent analyses. See e.g. Parthasarathi, Pavithra and David Levinson (2010) Post-Construction Evaluation of Trafﬁc Forecast Accuracy. Transport Policy
Relationship to other modelsEdit
We need a tool to "Identify Needs" and "Evaluate Options". This may be the transportation forecasting model.
Problem PRT: Skyweb ExpressEdit
- Is the "rational planning" process rational?
- Compare and contrast the rational planning process with the scientific method?
Some Issues with Rational PlanningEdit
Nevertheless, some issues remain with the rational planning model:
Problems of incomplete informationEdit
- Limited Computational Capacity
- Limited Solution Generating Capacity
- Limited input data
- Cost of Analysis
Problems of incompatible desiresEdit
- Conflicting Goals
- Conflicting Evaluation Criteria
- Reliance on Experts (What about the People?)
Alternative Planning Decision Making Paradigms: Are They Irrational?Edit
No one really believes the rational planning process is a good description of most decision making, as it is highly idealized. Alternatives normative and positive paradigms to the rational planning process include:
Several strategies normatively address the problems associated with incomplete information:
Other strategies describe how organizations and political systems work:
Some do both:
The paper Montes de Oca, Norah and David Levinson (2006) Network Expansion Decision-making in the Twin Cities. Journal of the Transportation Research Board: Transportation Research Record #1981 pp 1-11 describes the actual decision making process for road construction in the Twin Cities
- Box, G.E.P., Robustness in the strategy of scientific model building, in Robustness in Statistics, R.L. Launer and G.N. Wilkinson, Editors. 1979, Academic Press: New York.
- Sherden, William (1998) The Fortune Sellers, Wiley.
- Figure 6.4, p. 167 Major techniques for technological forecasting, in Sherden, William (1998) The Fortune Sellers, Wiley.