Ravitch Review of WfS Breaks Long Silence on NAEP's Fanciful Cut Points

The entire review is well worth the reading, but the clip below is central, especially since it breaks Ravitch's long silence regarding the incredibly unrealistic NAEP cut scores that she helped to establish in the early 90s, along with Chester Finn and others who subsequently used the unrealistic cut scores to demonize public education. 

As Richard Rothstein points out in Grading Schools . . . (pp. 59-65), the National Academy of Sciences, no less, had grave reservations about the NAEP cut points in 1991, but Ravitch and her standardista friends kept pushing the unrealistic goals.  As Bracey subsequently pointed out repeatedly to little effect, if the children in other countries who are cleaning our clocks test-wise were to take the NAEP, they would not be proficient, either.  This point was never made, however, by the enemies of public education who used the fantasy proficiency levels to destroy confidence in the public schools.

Perhaps Diane's next book will deal with her role in the destruction of confidence in public schools that she now decries.

From her WfS review:

. . . .The movie asserts a central thesis in today’s school reform discussion: the idea that teachers are the most important factor determining student achievement. But this proposition is false. Hanushek has released studies showing that teacher quality accounts for about 7.5–10 percent of student test score gains. Several other high-quality analyses echo this finding, and while estimates vary a bit, there is a relative consensus: teachers statistically account for around 10–20 percent of achievement outcomes. Teachers are the most important factor within schools.

But the same body of research shows that nonschool factors matter even more than teachers. According to University of Washington economist Dan Goldhaber, about 60 percent of achievement is explained by nonschool factors, such as family income. So while teachers are the most important factor within schools, their effects pale in comparison with those of students’ backgrounds, families, and other factors beyond the control of schools and teachers. Teachers can have a profound effect on students, but it would be foolish to believe that teachers alone can undo the damage caused by poverty and its associated burdens.

Guggenheim skirts the issue of poverty by showing only families that are intact and dedicated to helping their children succeed. One of the children he follows is raised by a doting grandmother; two have single mothers who are relentless in seeking better education for them; two of them live with a mother and father. Nothing is said about children whose families are not available, for whatever reason, to support them, or about children who are homeless, or children with special needs. Nor is there any reference to the many charter schools that enroll disproportionately small numbers of children who are English-language learners or have disabilities.

The film never acknowledges that charter schools were created mainly at the instigation of Albert Shanker, the president of the American Federation of Teachers from 1974 to 1997. Shanker had the idea in 1988 that a group of public school teachers would ask their colleagues for permission to create a small school that would focus on the neediest students, those who had dropped out and those who were disengaged from school and likely to drop out. He sold the idea as a way to open schools that would collaborate with public schools and help motivate disengaged students. In 1993, Shanker turned against the charter school idea when he realized that for-profit organizations saw it as a business opportunity and were advancing an agenda of school privatization. Michelle Rhee gained her teaching experience in Baltimore as an employee of Education Alternatives, Inc., one of the first of the for-profit operations.
Today, charter schools are promoted not as ways to collaborate with public schools but as competitors that will force them to get better or go out of business. In fact, they have become the force for privatization that Shanker feared.

Because of the high-stakes testing regime created by President George W. Bush’s No Child Left Behind (NCLB) legislation, charter schools compete to get higher test scores than regular public schools and thus have an incentive to avoid students who might pull down their scores. Under NCLB, low-performing schools may be closed, while high-performing ones may get bonuses. Some charter schools “counsel out” or expel students just before state testing day. Some have high attrition rates, especially among lower-performing students.

Perhaps the greatest distortion in this film is its misrepresentation of data about student academic performance. The film claims that 70 percent of eighth-grade students cannot read at grade level. This is flatly wrong. Guggenheim here relies on numbers drawn from the federally sponsored National Assessment of Educational Progress (NAEP). I served as a member of the governing board for the national tests for seven years, and I know how misleading Guggenheim’s figures are. NAEP doesn’t measure performance in terms of grade-level achievement. The highest level of performance, “advanced,” is equivalent to an A+, representing the highest possible academic performance. The next level, “proficient,” is equivalent to an A or a very strong B. The next level is “basic,” which probably translates into a C grade. The film assumes that any student below proficient is “below grade level.” But it would be far more fitting to worry about students who are “below basic,” who are 25 percent of the national sample, not 70 percent.. . .