GIS Lab in Transportation Engineering Education: A Critical Review
This paper critically evaluates Bham, Cernusca, Luna, and Manepalli's longitudinal study on the use of a GIS laboratory in undergraduate transportation engineering education. The review examines the study's three core research questions, its multi-phase methodology, and the validity of its conclusions. While acknowledging the importance of addressing knowledge gaps among entry-level engineers, the review identifies significant methodological weaknesses, including an ineffective control group design, inconsistent treatment of data across phases, and a qualitative coding process vulnerable to researcher bias. The paper concludes that, despite the study's legitimate educational aims, its findings cannot be accepted at face value due to flawed research design and statistical analysis.
- Introduction and Study Overview: Context and purpose of the reviewed GIS study
- Research Questions and Their Relative Merit: Evaluation of three research questions' value
- Methodological Design and Control Group Problems: Flaws in control group and experimental design
- Statistical Analysis and Inconsistent Sample Treatment: Arbitrary phase grouping undermines statistical validity
- Qualitative Dimension and Researcher Bias: In vivo coding vulnerable to author bias
- Conclusions and Overall Assessment: Study's limitations preclude reliable conclusions
✍️ How to write this paper — guide, tools & examples ▾
What makes this paper effective
- The review maintains a clear evaluative stance throughout, consistently distinguishing between what the study claims and what the evidence actually supports.
- The critique is structured logically, moving from research questions to methodology to analysis to conclusions, mirroring the original paper's own organization.
- Specific textual evidence from the reviewed article is cited at each stage, grounding the critique in the source material rather than general complaints.
Key academic technique demonstrated
The paper demonstrates effective source-based critical analysis. Rather than simply summarizing the reviewed article, the author identifies concrete logical and methodological flaws—such as the absence of a true control group and the arbitrary grouping of phases—and explains precisely why each flaw undermines the study's stated conclusions. This move from description to evaluation is the hallmark of strong academic critique.
Structure breakdown
The review opens by situating the study within its field and summarizing its core purpose. It then walks through the study sequentially—research questions, methodology, statistical analysis, and qualitative component—applying critical scrutiny at each stage. The conclusion synthesizes the cumulative weaknesses and delivers an overall judgment. This mirrors a standard critical review structure appropriate for undergraduate or early graduate coursework.
Introduction and Study Overview
In "Longitudinal evaluation of a GIS laboratory in a transportation engineering course," Bham, Cernusca, Luna, and Manepalli examine the effectiveness of a geographic information system-based tutorial in the teaching of transportation engineering. The authors studied students who were given this form of tutorial in conjunction with other learning techniques. They found that the students who received this tutorial performed better than those who did not. The paper serves to build the body of evidence with respect to GIS as a teaching technique for this subject. The authors sought to show that this technique is effective, and they accomplished that goal. However, the study was not sufficiently rigorous to make a fully reliable contribution to this field.
The article begins by introducing the problem. The authors noted that "previous studies reveal that … entry-level engineers lack significant exposure to transportation engineering methodologies" despite having hourly requirements for study in transportation-related courses in civil engineering programs (Bham et al., p. 258). The use of geographic information systems in tutorials is one of the means by which educators in the field have sought to overcome this knowledge gap among entry-level engineers, and thereby raise the quality of education in this subject. GIS had received the lowest amount of coverage among the education methodologies analyzed in a prior survey, which led to the hypothesis that increasing GIS usage might help resolve this knowledge gap. In particular, GIS would help civil engineering education become more focused on market needs (Bham et al., p. 258).
Research Questions and Their Relative Merit
Working with this basic understanding of the problem, the authors developed a GIS laboratory to assist civil engineering students in learning more about transportation engineering. The software was a "self-paced multimedia tutorial that introduced the steps associated with the use of ArcGIS for each stage of …" eight different tasks (Bham et al., p. 259). The software was based on a set of highway crash data.
Working with this laboratory, the authors sought to explore three key research questions. The first is whether the GIS laboratory is an effective means to help civil engineering students learn about traffic safety. The second is whether it produces a better learning experience. The third is whether students perceive it to be better (Bham et al., p. 259). Arguably, only the first genuinely matters — outcomes-based evidence is superior when analyzing whether software improves engineering education. However, there is good reason for the authors to include the other two research questions as well, since responses from instructors and students could help develop improvements to the software going forward. In particular, if the results to the first research question were not positive, it would be important to know why. The last two research questions therefore deliver valuable feedback to the makers of the GIS tutorial.
Methodological Design and Control Group Problems
The authors then outlined the research methodology. The project was divided into multiple phases. In the first phase, the GIS was implemented in 2009 on a limited basis. Subsequent phases included adjustments to the original methodology. One objective of the different phases was to test whether different means of delivering the software impacted the results. The authors determined that there was a significant effect from using the software.
The authors established a control group as well, but this control group was merely a group that did not receive a 20-minute lecture before using the laboratory — all groups used the GIS lab. This experiment therefore does not effectively test what the authors claim it tests, because there is no control group that did not use the lab at all. The study tests the 20-minute instructional session prior to the lab as the independent variable, not the lab itself. Nevertheless, the researchers found that the non-control group outperformed the control group, even when accounting for GPA and other factors. The different phases were conducted across all four undergraduate course levels, and the findings held up across all four phases.
References
Bham, G., Cernusca, D., Luna, R. & Manepalli, U. (2011). Longitudinal evaluation of a GIS laboratory in a transportation engineering course. Journal of Professional Issues in Engineering Education & Practice. October 2011, 258–266.
Create your account
Always verify citation format against your institution’s current style guide requirements.