Contradictory results of educational voucher programs in Milwaukee and Cleveland

Educational Vouchers: Multiple Issues and Contradictory Results

The Merriman-Webster online dictionary offers three definitions for "voucher": "...a documentary record of a business transaction; a written affidavit or authorization; a form or check indicating a credit against future purchases or expenditures." None of the three even approaches the emotionally charged version of the term "voucher" when it comes to the current debate swirling around public vs. private schools. This paper digs into the "vouchers" - or "scholarships," or "subsidies," if you prefer - provided to families in several cities and states, to move their children from less desirable, academically troubled public schools to more desirable, for-profit private, mainly religious schools.

Long before there was any discussion about vouchers, Horace Mann of Massachusetts - the "Father of American public school education" - was in the vanguard of the movement (1837) to solidify support for quality public education, excellence in teacher training, and free libraries (North Carolina State University, 2003). As the first Secretary of the Massachusetts State Board of Education, Mann won financial support for public schools and doubled the wages of teachers. Later, his influence extended well beyond his home state. His "Common School Journal" (1841-1848) advocated - successfully, in most cases - for taxpayer support of public schools, that it was every child's American right to a free education, and that religious schools should pay their own way.

Meanwhile, in the late 1870s, the voucher concept's likely genesis emerged through the writings of English philosopher John Stuart Mill (Howell & Peterson, 2002). Mill, a celebrity thinker in the UK, favored compulsory pubic education albeit he insisted families should have the right to choose their children's schools. About his turbulent times, he said England was a "...battlefield for sects and parties, causing the time and labor which should have been spent in educating, to be wasted in quarreling...." Little could Mill have known that today, roughly one hundred thirty years later in the American educational system, there truly is a battlefield between the proponents of voucher system and those against taking money away from public schools. It pits a loose conservative coalition up against a loose coalition of unions, liberals, and church vs. state hard-liners.

Milwaukee & Cleveland and Evaluation Issues

Credit for the initiation of the American school voucher concept generally goes to economist Milton Friedman, who, in the 1955-57 period, with his wife Rose, argued vigorously for vouchers. "Governments...could finance [education] by giving parents vouchers redeemable for a specified maximum sum per child per year if spent on 'approved' educational services," he said. "Parents would then be free," Friedman continued, "to spend this sum and any additional sum on purchasing educational services...of their own choice" (Howell & Peterson, 2002).

Among the first of several large cities to launch large voucher programs were Milwaukee, Wisconsin (1990), and Cleveland, Ohio (1996). In Milwaukee, the voucher program (Milwaukee Parental Choice Program - MPCP) began with 7 private schools, 300 voucher students, and roughly $700,000 paid to parents of those 300 students. By the 2000-2001 school year, an estimated 9,600 students were paying to attend 103 private schools - at a cost of $49 million. And so, the next question logically is how has the program been doing? What are the data to show whether students attending private schools are improving (since leaving their public schools) - or to show that there is little change, little advancement in the learning among the voucher students? This is where the evaluative difficulties enter into the picture of assessment.

A highly respected research team led by Kim K. Metcalf (Metcalf, 2002), of the Indiana Center for Evaluation, has studied the studies and the original program research. Utilizing the exact same set of data from the Milwaukee voucher program, "...three different teams of researchers produced three different results," Metcalf states in the report, titled "Interpreting Voucher Research: The Influence of Multiple Comparison Groups and Types." Metcalf continues [lengthy research team lists omitted for space purposes; all researcher names are found in Metcalf's above-mentioned report]:

One team of researchers found no significant impact on students' achievement after four years; a second team found significant positive impacts in reading and mathematics after four years; and no third team found no significant impact in reading, but a significant impact in mathematics after four years. Data that are available from the first two years of the voucher experiment in Cleveland have similarly been subjected to varying analytic approaches producing differential results. (Metcalf, 2002)

Another researcher looking into the Milwaukee voucher issue is Isa Snell, who is Director of the Education and Child Welfare Program at Reason Public Policy Institute (RPPI). She flatly states that, "Over the past 10 years in the Milwaukee school system, the performance of students attending public schools has improved dramatically." As to specifics, she states (RPPI Web site, 2002):

Between the 1997-1998 and 1999-2000 school years, the national percentile rank of MPCP fourth-grade students improved from a 36 percentile ranking to a 50 percentile ranking in math, 29 to 51 in science, and 35 to 52 in social studies."

The Wisconsin Education Association Council (WEAC, associated with NEA & NTA) reports that University of Wisconsin (Madison) professor John Witte evaluated the empirical data from the MPCP and "...found no achievement differences between voucher students and comparable Milwaukee Public School students" (Witte, et al., Fifth Year Report: Milwaukee Parental Choice Program, U of W-M, 1995). However, Professor Witte's data was re-analyzed by Professors Jay Greene (U. Of Houston), Paul Peterson, and Jiangtao Du (Harvard), and concluded that Milwaukee's voucher students outperformed public school students in math and reading, according to WEAC.

The Witte, et al., re-analysis, WEAC contends: "...focused on students in only 3 of the 20 private schools in the voucher program." Also, WEAC continues, "The charts contained in the report show that results are only statistically significant for math in the 4th year of the program. There was no statistically significant student voucher advantage in reading any of the 4 years."

Meanwhile, if those contradictory studies of the same research data aren't confusing enough, toss in three more issues to the Milwaukee project. One, the issue of how special education students fare when using the voucher system. The Milwaukee program, by law, cannot discriminate against disabled students. However, the private schools receiving voucher students are not obligated to provide any special education services, something of a catch-22. Two, voucher schools generally have no requirements with respect to academic standards, curriculum, or teacher certification, a concern to many parents (no matter how poorly some public schools are administered). And three, it should be noted that the vast majority of voucher schools are run by the Roman Catholic Church. Only recently were Milwaukee voucher parents allowed (in a move by the state legislature) to allow their children to "opt out" of religious studies, but in Cleveland, the church vs. state voucher issue went all the way to the U.S. Supreme Court.

New York City Voucher System

Meanwhile, the School Choice Scholarship Foundation (SCSF) in New York City is in its 5th year, and like other statistical reporting on voucher projects it has seen mixed messages. Three years into the privately financed program (Education Week, Feb. 27, 2002) studies by Mathematica and Harvard (Mathematica, 2002) showed African-American students scored 5.5 percentile points higher in composite test scores for math and reading, than black students in public schools who did not receive a scholarship. That promising gain, however, was balanced with the fact that composite test scores of Latino students who received scholarships showed little or no difference from those Latinos who did not get into the voucher scholarship program. While other statistical data was available from the Mathematica research of SCSF - 64% of scholarship parents say their kids had an hour of homework a night; 41% of parents of non-scholarship students say their children had an hour homework - there is a dearth of hard, cold, factual, empirical data showing great gains from vouchers, or a lack of gains. Like the Supreme Court decision, the thumbs up tend to be conservatives, while thumbs down on vouchers tends to be liberals and unions.

Positive Results in Charlotte

While the New York experiment is still being analyzed, there are some encouraging results from the voucher program in Charlotte, South Carolina.

Three hundred eighty-eight students from low-income families received $1,700 each to attend private schools, grades 2 through 8. After the 1999-2000 school year, they were tested using the Iowa Test of Basic Skills (Greene, 2001). The results show that students who used a scholarship scored 5.9 percentile points higher on math in the ITBS than comparable students who chose to remain in public schools. Also, voucher students scored 6.5 percentile points higher in reading than their public school counterparts. According to Jay Greene, who conducted the research in Charlotte, "On average, a scholarship raised students from the 30th percentile to the 37th percentile." And that is significant, he added. Plus, the surveys showed that parental approval of private schools was very high.

Florida's Vouchers: Punish Schools That Fail

In Florida, besides all the sunshine and beaches, they have failing schools, and a punitive program to embarrass those schools (Section 229.0537). It's called the "A+ Program" (Snell, 2002). The state "grades" schools on a scale of A - F. Students attending schools that receive an "F" for two straight years are in effect paid to walk away to private schools. And when students leave, the school is docked a chunk of state money in that student's absence. In school year 1900-2000, 78 Florida schools received failing grades (based upon cumulative test scores). One problem with putting so much emphasis on test scores - and this is universal, not just a Florida problem - is that teachers and administrators may begin a campaign to "teach to the test," and not teach kids how to think and learn (WEAC, 2002). When an already struggling, run-down school faces the loss of revenue based on poor test scores, it doesn't take rocket science to conjecture that "teaching to the test" plays a role in survival. In fairness to Florida, though, none of the schools who scored an "F" in the first year repeated that failure in the second. As to the results of how voucher students' succeeded academically, little empirical data is available at this time.

Washington D.C. Vouchers Showed Gains for Blacks voucher program that began in 1993 in the nation's capitol, which gave $1,700 to low income families, and which received an infusion of millions of dollars from an unnamed philanthropist, showed gains for Blacks after a 3-year period. In fact, African-Americans scored 6.2 higher in math (overall, on composite averaging) than their peers in public schools in the non-voucher control group. And, blacks scored 6.3 percentile points higher in reading as compared with non-voucher control group students. Indeed, the largest test-score differences between African-American students in private schools and African-American students in public schools, in any of the studies of voucher programs, were observed in the D.C. program. Black students who attended D.C. private schools for two years scored 9.0 percentile points higher on the two tests combined than did students in the control group. The downside of the survey was - and this is much like the research on the New York City and Dayton, Ohio program - that while African-Americans showed gains, Latinos and students of other ethnic heritages did not show gains.

Conclusion

Will voucher programs emerge as a viable, successful and fair alternative to public schools? Will vouchers be good for education in the long run? Is it morally and ethically fair - notwithstanding the Supreme Court's pro-voucher decision - that the Roman Catholic Church should profit from the issuance of vouchers? Those questions are pivotal yet unanswered. Clearly, some voucher programs have shown signs of helping low income parents educate their children in school environments free from drugs, violence, and gangs. But what will be the cost to financially strapped public schools if more and more tax money is drained from their coffers? Even the privately financed voucher programs (New York City, Washington D.C., and elsewhere) end up costing public schools in lost revenue.

Immediately after the U.S. Supreme Court's decision favoring vouchers (June 27, 2002) the head of the teacher's union in Cleveland, Richard Decolibus, remarked: "I think it will be enormously harmful and very divisive. The reality of the matter is the only place these religious schools are going to be able to get the tuition money from is by raiding the public school treasury."

Even the research on voucher studies is clouded with confusion and mixed messages - and generally speaking the "pro" side has one interpretation while the "anti" group has theirs. "Spin doctors" abound, as they do in any political-charged American social issue.

Meantime, the researcher who has likely put his political science microscope on more studies and surveys of studies than any "expert" anywhere, is Kevin B. Smith of the University of Nebraska. He went through the General Accounting Office's (GAO) 23 studies of voucher programs in Milwaukee, Cleveland, and elsewhere, with a fine-toothed comb. In all, Smith studied nearly 500 published research manuscripts of voucher programs. His conclusion? "...Choice and voucher programs are not, as some have claimed, a 'panacea' to the challenges faced by public education." He added, that "...though these programs [for disadvantaged groups] have a real potential upside...the empirical record shows them to be a mixed bag." [See "Table 1" reflecting Smith's research of the research.]

Reference

ABC News (June 27, 2002). [Online] "Divided Court: Voucher Program Victory http://abcnews.go.com/sections/us/DailyNews/scotus_vouchers020627.html.

American Federation of Teachers (2002). [Online] "Report Reveals Right-Wing Backers of BAEO" "Milwaukee Vouchers Cost Twice the Tuition Amount Charged Non-Voucher Students http://www.aft.org/research/vouchers/.

Friedman Foundation (2002). [Online] "School Choice Works http://www.friedmanfoundation.org/schoolchoiceworks/schoolchoiceresearch.html.

Greene, Jay P. (2002). [Online] "Vouchers in Charlotte" Education Next Magazine http://www.educationnext.org/20012/46greene.html.

Howell, William G., & Peterson, Paul E. (2002). The Education Gap: Vouchers and Urban Schools. Washington D.C.: Brookings Institutional Press.

Jennings, Jack (2000). [Online] "School Voucher Debate Gets an Incomplete" The Center on Education Policy http://www.ctredpol.org/vouchers/.

Metcalf, Kim K., Beghetto, Ronald, & Legan, Natalie A. (2002). [Online] "Interpreting Voucher Research: The Influence of Multiple Comparison Groups and Types" Indiana Center for Evaluation http://www.publicpolicyforum.org/josh/metcalf.pdf.

Neas, Ralph G. (2001). [Online] "10 Years and Counting: A Closer Look at the Cleveland Voucher Program" People for the American Way http://www.pfaw.org.

North Carolina State University (2001). "Educational Contributions of Horace Mann" Department of Agricultural and Extension Education, College of Agricultural and Life Sciences http://www.cals.ncsu.edu/agexed/aee501/mann.html.

Peterson, Paul E., Mayer, Daniel P., Myers, David E., Tuttle, Christina Clark, & Howell, William G. (2002). "School Choice in New York City after Three Years: An Evaluation of the School Choice Scholarship Program" Mathematica Research Policy, Inc. http://hdc-www.harvard.edu/pepg/index.htm.

Rehnquist, Chief Justice William (June 27, 2002). "Certiorari to the United States Court of Appeals for the Sixth Circuit" Zelman, et al., v. Simmons-Harris et al., 2002 United States Supreme Court [pdf].

Smith, Kevin B. (2002). "Data Don't Matter? How Empirical Research can Contribute to the School Choice and Voucher Debate" [online] Department of Political Science, University of Nebraska http://www.publicpolicyforum.org.

Snell, Lisa (2002). [Online] "School Vouchers as a Legal Sanction" Reason Public Policy Institute http://www.rppi.org/educ.html.

Viadero, Debra (February 27, 2002). [Online] "Voucher Plans' Test Data Yield Puzzling Trends" Education Week Magazine http://www.edweek.org/ew/ew

Wisconsin Education Association Council (2002). [Online] "The Milwaukee Voucher Program http://www.weac.org/Resource/1998-99/april99/vouchtrack.htm.