This paper critically reviews a research bulletin by McCurley and Snyder examining the co-occurrence of substance-related behaviors among youth aged 12 to 17. Drawing on data from the National Longitudinal Study of Youth (NLSY97), the study uses a retrospective meta-analysis to assess whether youth who exhibit one substance-related behavior — such as alcohol use, marijuana use, or drug selling — are more likely to exhibit others. The review evaluates the study's methodology, sampling procedures, validity, data visualization, findings, and implications, including notable racial and ethnic disparities and gaps in categorical representation. The paper also considers ethical considerations and the practical value of the research for juvenile justice professionals and intervention planners.
This paper demonstrates the technique of critical research review — evaluating not just what a study found, but how it was conducted and whether its methodology, sampling, and classification choices are sound. The author identifies specific gaps (e.g., absence of Asian/Pacific Islander data, inconsistent racial labeling) rather than simply summarizing conclusions, showing analytical engagement with the source material.
The paper follows a report-style structure organized around the components of the original bulletin: it opens with the research problem and hypothesis, moves through methodology and analysis, addresses validity and data presentation, and closes with findings and broader implications. This structure mirrors the original study's design, which is appropriate for a research critique and allows systematic evaluation at each stage.
The central problem addressed in this research bulletin is that levels of substance-related behaviors increase substantially as youth age. According to the study, from age 12 to age 17, self-reported alcohol use in the 30 days prior to the research interview climbed more than eightfold. The core research question was whether youth who exhibit a single substance-related behavior are more likely to also exhibit other substance-related behaviors.
The hypotheses were stated as follows. The null hypothesis (H0) held that youth who have a single substance-related behavior are more likely to have other substance-related behaviors. The alternative hypothesis (HA) held that youth who have a single substance-related behavior are no more likely to have other substance-related behaviors.
Biographical information on the authors is not provided within the research bulletin itself. A search of publicly available sources indicates that Carl McCurley has a strong interest in analyzing and improving outcomes for court-involved children, youth, and families, work he was able to apply through the Models for Change program at the National Center for Juvenile Justice. McCurley serves as Director of the Administrative Office of the Courts / Washington State Center for Court Research (WSCCR). After joining the Administrative Office of the Courts in 2007, he sought to broaden the Center's work beyond its customary focus on court operations to analyze the courts' impact on the lives of those they served.
Howard N. Snyder is considered a foremost expert on juvenile justice data and policy and is employed by the Bureau of Justice Statistics, U.S. Department of Justice, in Washington, D.C.
The study was funded by the U.S. Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention.
The research methodology was a retrospective meta-analysis of existing data from the National Longitudinal Study of Youth (NLSY97), in which a nationally representative sample of youth aged 12 to 17 were interviewed regarding substance-related behaviors. The study modified the sample drawn from two waves of the NLSY97 (1997 and 1998) to produce nationally representative estimates of overall youth behavior, as well as estimates within groups constructed according to age, gender, and race or ethnicity.
These modifications were made by creating oversamples and then controlling for oversampling through weighted analysis — both commonly accepted statistical methodologies for addressing natural variation in samples. To facilitate analysis, the sample was also weighted to establish equal proportions of youth for each age-year group. Included in this weighting was an adjustment to exclude 17-year-olds who were disproportionately young — that is, those showing an average age of 17 years and 3 months.
The original NLSY97 data were collected through interviews with more than 15,300 youth aged 12 to 17. The retrospective statistical method employed is a meta-analysis, which is used to generate a more powerful estimate of the true effect size of a phenomenon than any single study conducted under a single set of conditions and assumptions could provide.
The task force of the Organisation for Economic Co-operation and Development (OECD) charged with harmonizing survey operations and technical design — particularly with regard to efficient sample design and weighting methodologies — asserts that the methods employed in this meta-analysis represent best practices. A 2005 report by this task force states:
"According to the report, the ideal survey would utilize probability methods for sample selection, adjust the results for differential non-responses, and weight the data so that the results are representative of the total reference population or volume of economic output for business sector surveys. The size of the sample should be determined by the width of the largest confidence intervals allowable for key results. All surveys should clearly document the sampling frame, sample selection procedures, response rates, imputation methods for missing data, and weighting." (Malgarini, 2005, p. 4)
The goals of the research were to provide information to individuals engaged in identifying and evaluating youth who exhibit or report substance-related behaviors. In other words, the research is intended to establish a knowledge base for professionals who make decisions about placement in programs, interventions, and treatments, and the provision of services. The philosophical foundation of the research is that substance-related behaviors — such as using marijuana, drinking alcohol, and buying or selling drugs — have substantive detrimental consequences for youth, and that understanding the co-occurrence of these behaviors is essential to providing meaningful and effective interventions and support.
No ethical issues arose from the meta-analysis. Participants in the NLSY97 agreed to be interviewed at regular intervals and understood that their data would not be individually identifiable and would be presented only in aggregate form. All human subjects considerations were addressed as part of the original research study.
You’re 51% through this paper. Sign up to read the remaining 3 sections.
Sign Up Now — Instant Access Already a member? Log inAlways verify citation format against your institution’s current style guide requirements.