Evidence & research

Students who hadn’t moved in years moved in a quarter.

Every student in this study had been stuck—reading multiple grade levels behind, with little to show for years of standard instruction. Seventeen secondary students in a high-poverty school then received one quarter of Signal Reading intervention. Their prior record provides the context for what changed next.

The result

A measurable break in the trajectory

≈ 2.2grade levels of reading growth in one quarter on NWEA MAP
1.37 → 2.34mean GPA from the quarter before intervention to the quarter after
g = 1.10bootstrapped effect size across 1,000 resampling iterations

Reading grew about 2.2 grade levels in one quarter on NWEA MAP—in students whose reading had been essentially flat for years before the intervention began.

Grades rose across every class. Mean GPA moved from 1.37 the quarter before intervention to 2.34 after—an increase that held into the following quarter. The intervention happened in a single class period. The grade gains appeared in classes it never touched.

The GPA gain was statistically significant at p = .001 (paired-samples t = 4.31, df = 16). Because the sample was small, the effect size was recomputed with bootstrapping: 1,000 resampling iterations returned a large effect of g = 1.10, with a 95% confidence interval that does not include zero.

For scale, a meta-analysis of 73 reading-intervention studies for grades 4–12 by Scammacca, Roberts, Vaughn, and Stuebing found a mean effect of d = 0.49. The effect measured here is more than double that benchmark.

The baseline

Why the flat history matters

The most common question about a study like this is whether the students would have improved on their own. For this population, the answer is on record: they had not. These students were identified precisely because years of ordinary instruction had not moved them—two or more grade levels behind, flagged by dropout-risk markers, and screened one-on-one to rule out causes other than reading. Their multi-year trajectory was flat.

That prior history functions as each student’s own baseline. Maturation, testing familiarity, and “readiness to bloom”—the usual alternative explanations—all predict gradual prior growth. The record shows the opposite. The students were not on a slow climb that happened to continue. They were stalled, and then they were not. The break in the trajectory aligns with the change in instruction.

Interpretation boundary

What the evidence supports—stated plainly

The evidence supports saying

Students who had been stuck for years made large, statistically significant gains in both reading and overall academic performance; the gains are highly unlikely to be due to chance (p = .001); and the measured effect is large by the standards of the field.

The evidence does not yet support saying

These results will reproduce at the same magnitude across other schools and teachers. This was one site, one teacher, and one quarter. That is the reason to run the larger study—not a reason to discount this one.

We say both because a program that only tells you its best number has already told you how much to trust it. This study produced a real, large, significant result with students the system had given up on. It also has a clear next step. Both are true.

Evidence framework

Four categories keep unlike claims separate

01
Established meta-analytic findings

The component research—structured phonics and encoding, morphology, retrieval practice, self-regulated learning, and writing-to-read—is among the most replicated in education. The foundations of Signal Reading rest here.

02
Component-level studies

Each of the four ropes carries its own evidence base for the instructional decisions it operationalizes.

03
This practitioner study

Real, measured, statistically significant, large—and preliminary at the scale of one site. Full methodology is documented.

04
The integrated-architecture argument

The claim that braiding all four ropes produces outcomes greater than any single rope is theoretically coherent and consistent with the practitioner data. It has not yet been tested as its own hypothesis in an independent controlled trial. This is the frontier, and it is where the next research should go.

The first two categories are established research. The third is a strong signal. The fourth is a testable claim we invite the field to test.

The next study

What would make the evidence stronger

A multi-site study with a larger sample, a comparison condition, fidelity monitoring, and multi-year follow-up would support stronger causal claims at population scale. The framework is documented. The methodology is replicable. The result already on the board justifies that investment—and Signal Reading would welcome an independent research partner to run it.

References

Research cited on this page

  1. Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. Chapman & Hall.
  2. Ehri, L. C. (2014). Orthographic mapping in the acquisition of sight word reading, spelling memory, and vocabulary learning. Scientific Studies of Reading, 18(1), 5–21. https://doi.org/10.1080/10888438.2013.819356
  3. Koch, W. R. (2024). Practitioner case study of a Tier 2 reading intervention for adolescent struggling readers, Mapleton School District [Unpublished practitioner data].
  4. Scammacca, N. K., Roberts, G., Vaughn, S., & Stuebing, K. K. (2015). A meta-analysis of interventions for struggling readers in grades 4–12: 1980–2011. Journal of Learning Disabilities, 48(4), 369–390.
  5. Scarborough, H. S. (2001). Connecting early language and literacy to later reading (dis)abilities: Evidence, theory, and practice. In S. B. Neuman & D. K. Dickinson (Eds.), Handbook of early literacy research (pp. 97–110). Guilford Press.
  6. Wanzek, J., Vaughn, S., Scammacca, N., Gatlin, B., Walker, M. A., & Capin, P. (2016). Meta-analyses of the effects of Tier 2 type reading interventions in grades K–3. Educational Psychology Review, 28(3), 551–576.
  7. Weiser, B., & Mathes, P. (2011). Using encoding instruction to improve the reading and spelling performances of elementary students at risk for literacy difficulties: A best-evidence synthesis. Review of Educational Research, 81(2), 170–200. https://doi.org/10.3102/0034654310396719

A practical next step

Help test the signal at the next scale.

Start with a focused conversation about your current system, constraints, and next decision.