Statistical vs. Practical Significance in Educational Research
This paper compares and contrasts two scholarly articles — Gall's "Figuring out the Importance of Research Results: Statistical Significance versus Practical Significance" and Levin's "What if There Were No More Bickering About Statistical Significance Tests?" — examining their differing perspectives on hypothesis testing, sampling strategies, and statistical power. The paper explores where significance testing can and cannot be usefully applied, particularly in educational research, and considers how issues of measurement error, verbal data collection, and researcher resources affect reliability. It concludes by reflecting on how these readings inform the author's own research priorities, especially regarding at-risk populations in educational settings.
- Introduction to the Two Articles: Overview of Gall and Levin's contrasting perspectives
- Applications and Limitations of Significance Testing: Where significance testing applies and where it fails
- Sampling Strategies and Data Accuracy: Critiques of sampling methods and verbal data reliability
- Statistical Power and Research Quality: Why statistical power matters and how to improve it
- Implications for Personal Research Interests: Author's research priorities shaped by Gall and Levin
✍️ How to write this paper — guide, tools & examples ▾
What makes this paper effective
- The paper directly engages with two source texts throughout, consistently attributing claims and quotes to specific authors rather than making unsupported assertions.
- It draws genuine comparisons between Gall and Levin, noting where they agree, where they diverge, and where each author's argument is stronger or weaker.
- The concluding reflection connects the academic material to the writer's own stated research interests, grounding the analysis in a practical context.
Key academic technique demonstrated
The paper demonstrates comparative source analysis — placing two scholarly texts in dialogue with each other. Rather than summarizing each article separately, the writer moves back and forth between Gall and Levin to highlight contrasts in focus (educational practice vs. methodological critique) and in tone (measured vs. pointed). This technique shows the ability to synthesize multiple sources around a shared theme rather than treating them in isolation.
Structure breakdown
The paper opens by introducing and characterizing both articles, then moves into substantive comparison across thematic areas: where significance testing applies, how sampling affects accuracy, and why statistical power matters. Each middle paragraph draws on direct quotations from both sources to anchor the analysis. The paper closes with a brief personal reflection, turning the academic discussion into a statement of research intent. The structure is roughly five paragraphs following a compare-contrast logic.
Introduction to the Two Articles
Gall's "Figuring out the Importance of Research Results: Statistical Significance versus Practical Significance" offers a thoughtful, if somewhat indecisive, viewpoint on the statistical methods used to test the null hypothesis. His observations tend to focus more on the importance of research results than on the question of when results lack significance. He moves back and forth on the subject, suggesting from his perspective that null hypothesis testing is repetitive given the level of certainty required, and that accurate conditions — such as random sampling from a defined population — must be satisfied but are inherently limited.
Levin's "What if There Were No More Bickering About Statistical Significance Tests?" is a well-reasoned, if somewhat pointed, response to "those who advocate replacing statistical hypothesis testing with alternative data-analysis strategies" (Research in the Schools, 1998). Together, these two articles provide a useful lens through which to examine the ongoing debate over statistical versus practical significance in research.
References
Gall, M. (2012). Statistical significance vs. practical significance of research results. Retrieved from http://pages.uoregon.edu/mgall/statistical_significance_v.htm [Accessed 12 May 2012]
Levin, J. R. (1998). What if there were no more bickering about statistical significance tests? Research in the Schools, 5(2), 43–53. Retrieved from [Accessed 12 May 2012]
Create your account
Always verify citation format against your institution’s current style guide requirements.