Appraising Findings of a Quantitative Study on Sugar Warning Labels
This paper critically appraises the quantitative study by Sigala et al. (2022), which investigated the perceived effectiveness of added-sugar warning label designs for U.S. restaurant menus through an online randomized controlled trial. The appraisal systematically evaluates key methodological criteria, including the presence of research hypotheses, participant recruitment and group assignment, sample size determination, fidelity to treatment, control of extraneous variables and bias, and statistical significance. The paper also considers how the study's findings might be applied in practice. Overall, the appraisal finds the study to be methodologically sound in several respects while identifying areas—such as the absence of explicit hypotheses and limited discussion of extraneous variables—where the research could have been strengthened.
- Research Purpose and Hypotheses: Study purpose stated; no explicit hypotheses identified
- Participant Selection and Group Assignment: Recruitment methods and randomized group assignment described
- Sample Size and Extraneous Variables: Sample size rationale and bias control critically evaluated
- Intervention Fidelity and Group Equality: Consistency of treatment delivery and group equivalence assessed
- Statistical Significance and Practical Application: Statistical findings summarized and practice implications discussed
✍️ How to write this paper — guide, tools & examples ▾
What makes this paper effective
- Follows a structured, question-by-question appraisal format that ensures systematic coverage of all major methodological criteria for evaluating a quantitative study.
- Balances direct engagement with the source article (using targeted quotations) with the student's own critical analysis, demonstrating both comprehension and independent evaluation.
- Acknowledges limitations honestly—for example, noting when the researchers themselves did not address certain methodological considerations such as extraneous variables or sample size rationale.
Key academic technique demonstrated
The paper demonstrates critical appraisal of empirical research: rather than merely summarizing the study, the student applies evaluative criteria (hypothesis clarity, randomization, bias control, statistical significance) to assess the study's methodological rigor. This technique is essential in evidence-based health and social science practice.
Structure breakdown
The paper is organized around eight numbered appraisal questions that map onto standard quantitative research evaluation criteria. Each section opens with a direct answer, then provides methodological context drawn from the literature or the student's own reasoning, and closes by relating the criterion back to the Sigala et al. study. A brief reference list follows the body. This format is typical of graduate-level research critique assignments in health or nursing programs.
Research Purpose and Hypotheses
No hypotheses were stated in the article by Sigala et al. (2022). Instead, the introduction reviewed relevant literature and stated its purpose, which was "to provide the foundation for rigorous evaluations of the impact of restaurant menu added-sugar warning labels on consumer behavior" (Sigala et al., 2022, p. 2). Specifically, the authors aimed to better understand the "relative performance of multiple added-sugar warning label designs while establishing whether restaurant menu added-sugar warning labels could change consumer perception and knowledge outcomes on the causal pathway between warning-label exposure and behavior change" (Sigala et al., 2022, p. 2). With this research intention established, the authors proceeded to explain the study's methodology, leaving no indication of how they expected the results to unfold.
Participant Selection and Group Assignment
Participants were selected and assigned to groups through a structured recruitment process. The researchers recruited 1,327 U.S. adults matching 2018 American Community Survey (ACS) 5-year estimates (2013–2018) for age (18–34, 35–54, ≥55 years), gender, race and ethnicity (Hispanic [any race], non-Hispanic White, non-Hispanic Black, and non-Hispanic Asian), and education (≤high school diploma/GED, some college, ≥bachelor's degree) from an online sample provided by Dynata. Participants gave their informed consent and were then assigned to view restaurant menu excerpts with one of 25 labels. A simple allocation ratio via Qualtrics Randomizer was used for assignment.
Sample Size and Extraneous Variables
The researchers did not explicitly discuss how the size of the sample was determined, but they did identify it as one of the study's strengths that the sample reflected the national distribution of key demographics. When determining sample size for a study, there are a number of factors to consider. The first is the type of data that will be collected. For example, if the data is dichotomous (i.e., it can only take two values), then a smaller sample size may be sufficient. However, if the data is continuous (i.e., it can take any value), then a larger sample size is needed. The second factor is the level of precision required. If the study is looking at a small effect size, a larger sample size is necessary to detect that effect. Finally, the type of statistical analysis to be used should also be taken into account, as parametric tests generally require larger sample sizes than non-parametric tests. In general, there is no one-size-fits-all answer; rather, sample size depends on the specific characteristics of the study in question (Adcock, 1997).
The researchers made no explicit mention of extraneous variables or bias control in their study design discussion, though doing so would have strengthened the study. By definition, an extraneous variable is anything that influences the dependent variable other than the independent variable. Because many such variables could potentially affect study outcomes, it is vital for researchers to identify and control as many as possible; otherwise, the results may be invalid. Bias is another factor that can distort results, and researchers must be aware of their own personal biases and take steps to control for them. The researchers did examine multiple demographic variables in an attempt to account for different sources of variation, but no explicit discussion of extraneous variable control was provided in the design section. However, the researchers did address one form of bias, stating that "although social desirability bias could have influenced PME and warning label support, this is unlikely given participant anonymity" (Sigala et al., 2022, p. 7).
References
Adcock, C. J. (1997). Sample size determination: A review. Journal of the Royal Statistical Society: Series D (The Statistician), 46(2), 261–283.
Sigala, D. M., Hall, M. G., Musicus, A. A., Roberto, C. A., Solar, S. E., Fan, S., ... & Falbe, J. (2022). Perceived effectiveness of added-sugar warning label designs for US restaurant menus: An online randomized controlled trial. Preventive Medicine, 160, 107090.
Always verify citation format against your institution’s current style guide requirements.