This paper addresses two related topics in applied research methods. The first section evaluates common survey scale formats, examining issues of vagueness, response range, and wording clarity. It then identifies the key factors — purpose, scope, authority, audience, and format — that determine a survey's value in management decision-making. The second section analyzes State Farm's study of the most dangerous intersections in the United States, covering its hypothesis, methodology, limitations, and the distinct value of measuring raw accident counts versus accidents per capita. The paper concludes with practical recommendations for how transportation engineers and policymakers can use such data to target specific safety interventions.
The following observations address the design of four common survey scale formats used in research and management contexts.
A. This code is vague — "depends" encompasses a very broad range of responses and provides little usable data for analysis.
B. There is no middle ground with this survey; it offers only two positive and two negative options, which may force respondents into positions they do not hold.
C. This scale is acceptable, though some respondents might be unclear on the distinction between "average" and "fair," which could introduce inconsistency.
D. This scale is commonly used and generally effective, except that "uncertain" might be better worded as "do not know" or "does not apply." It is best to encourage respondents to answer, using their gut feeling if necessary, to maximize response utility.
A number of different factors affect the value of a survey in management decision-making. Purpose is very important because the survey needs to be relevant to the managerial problem at hand — if it is not relevant, it has no value. Scope is equally important because it is complementary to purpose. A survey might be similar in purpose to the managerial problem, but its scope could be entirely wrong. For example, a study of tipping behavior in the United States will not help a manager determine how to tip in China. The two share the same objective, but the difference in geographic scope renders the survey useless.
Authority is only somewhat important in terms of value. The appeal to authority is a logical fallacy (Constitution.org, 2014), and the strength of the argument itself is what ultimately determines a study's value. That said, those with expert authority are far more likely to produce material that is relevant and free from logical errors, and therefore more likely to be valuable — though this is not guaranteed.
Audience is important to the extent that it frames purpose and scope; otherwise, it is not a primary determinant of value. It is actually a valuable skill to be able to transfer knowledge across disciplines. Format determines value only insofar as the source can be understood. Format is typically shaped by purpose and scope, and as long as the reader can comprehend it, format itself is not the critical issue. It is worth noting, however, that many managers have difficulty penetrating academic journals on management topics — in such cases, the format reduces accessibility and therefore diminishes practical value.
This study was designed to measure the most dangerous intersections in the United States. The study examined number of accidents and accident severity as key variables, and was constructed using State Farm's nationwide insurance data, providing a large and geographically broad dataset.
"Study hypothesis and methodology critique"
"Stakeholder use and engineering recommendations"
"Raw counts versus per-capita accident measures"
You’re 53% through this paper. Sign up to read the remaining 3 sections.
Sign Up Now — Instant Access Already a member? Log inAlways verify citation format against your institution’s current style guide requirements.