Skip to main content

Since I am quick to criticize the media for its role in the failures of the current education reform movement—such as PBS, The Charleston Post and Courier, and Education Week—I must also recognize when a media outlet provides much needed insight into education policy that has clearly run off the tracks, such as the so-called Florida miracle and the enduring practice of assigning letter grades to schools.

In "Low-income schools struggle under state's grading system" (Miami Herald, August 10, 2013), Michael Vasquez and David Smiley offer a clear but disturbing picture of accountability in Florida:

With dozens of changes in just the past three years, the formula behind Florida'€™s A-to-F school grading system has been criticized as a confusing mess. But there'€™s been at least one constant in Miami-Dade and Broward results: The wealthiest schools never get Fs, and schools with high populations of poor students face an uphill battle to even get a C.

The trend is visible through a decade-plus of school grade results, dating back to the first grades issued in 1999.

Vasquez and Smiley, along with the Miami Herald, represent a needed aspect of journalism addressing education reform: Recognizing large and compelling patterns, and thus the consequences of education policy.

The analysis of assigning letter grades to schools in Florida exposes some important conclusions:

• Although high poverty rates don'€™t necessarily doom a school to a subpar grade, D and F schools are overwhelmingly serving students from poor neighborhoods, and the few schools that do overcome poverty to achieve an A are outliers. (There were nine such schools this year, all in Miami-Dade).

• Of the 209 schools in Miami-Dade and Broward with at least 90 percent of students receiving free or reduced lunch, 78 percent received a grade of C or worse. Roughly 39 percent of these high-poverty schools received a D or F.

• Of the 43 local schools with much lower poverty rates (30 percent or fewer students receiving free or reduced lunch), 86 percent received an A, and none received a D or F.

Despite efforts to identify educational quality among schools by focusing on growth models, data used in accountability policies remain primarily a reflection of out-of-school factors. Further, the schools that sit outside the typical patterns are rightfully identified by Vasquez and Smiley as "outliers."

This analytical report on letter grades for schools in Florida is a strong example of quality journalism that seeks out and presents complex and detailed evidence, placing that data in the broader context of the many factors that impact not only the evidence we gather on our schools but also what conclusions we draw as well as how we draw those conclusions.

In the article, Miami-Dade Superintendent Alberto Carvalho explains, "'Just as much as poverty can'€™t be an excuse, the exclusion of poverty as a factor is immoral.'"

Rare is the news article that allows a perspective this complex.

No Child Left Behind (NCLB) ushered in several grand promises in 2001, such as closing the achievement gap, but one of the central requirements of the legislation—the use of scientifically based research—is now poised to dismantle the entire accountability movement, including policies such as labeling schools with letter grades based primarily on test scores.

The evidence is clear that thirty years of accountability built on standards and high-stakes testing has failed. The next step is composing and sharing a unified message of that fact, while also building a coalition to reset the reform agenda so that we address poverty, equity, and opportunity in the lives of children and their families as well as in the schools those children attend.

The Unintended Lessons from Florida

After recognizing the excellent analysis by Michael Vasquez and David Smiley of Florida's school grades being strongly correlated with out-of-school factors associated with the students*, I have received several important related points from Vasquez about the unintended lessons coming from one of the most often cited reform states in the U.S.

First, Vasquez pointed me to Matthew DiCarlo's What Florida€'s School Grades Measure, And What They Don'€™t, in which DiCarlo explains:

A while back, I argued that Florida'€™s school grading system, due mostly to its choice of measures, does a poor job of gauging school performance per se. The short version is that the ratings are, to a degree unsurpassed by most other states'€™ systems, driven by absolute performance measures (how highly students score), rather than growth (whether students make progress). Since more advantaged students tend to score more highly on tests when they enter the school system, schools are largely being judged not on the quality of instruction they provide, but rather on the characteristics of the students they serve.

New results were released a couple of weeks ago. This was highly anticipated, as the state had made controversial changes to the system, most notably the inclusion of non-native English speakers and special education students, which officials claimed they did to increase standards and expectations. In a limited sense, that'€™s true grades were, on average, lower this year. The problem is that the system uses the same measures as before (including a growth component that is largely redundant with proficiency). All that has changed is the students that are included in them. Thus, to whatever degree the system now reflects higher expectations, it is still for outcomes that schools mostly cannot control.

The really important aspect of DiCarlo's analysis is that Florida's accountability system has likely caused harmed instead of attaining the lofty goals often associated with accountability policies, as DiCarlo concludes:
In other words, there are many Florida schools with lower-performing students that are actually very effective in accelerating student performance (at least insofar as tests can measure it). This particular ratings system, however, is so heavily driven by absolute performance—how highly students score, rather than how much progress they have made—that it really cannot detect much of this variation.

Closing or reconstituting these schools is misguided policy; their replacements are unlikely to do better and are very likely to do worse. Yet this is what will happen if such decisions are made based on the state’s ratings.

Florida will have to do a lot more than make tweaks to truly improve the high-stakes utility of this system. In the meantime, one can only hope that state and district officials exercise discretion in how it is applied.

Both Vasquez and Smiley's 2013 analysis and DiCarlo's 2012 analysis, however, are even more troubling in light of a St. Petersburg Times (Florida) March 21, 1999, article, "A lesson in grading schools," by Kent Fischer and Geoff Dougherty:
Bush believes the grades, A through F, will make it easier for parents to compare schools and assess how they are doing. A noble goal.

But a St. Petersburg Times analysis indicates his school-grading system may be fundamentally flawed.

It takes no account of the impact poverty has on student achievement, though many studies have proven that children from wealthy families generally outscore children whose parents are poor. So Bush's grades are more apt to reflect the relative wealth of a school's student body rather than the competency of its teachers, the newspaper's analysis shows.

Fourteen years ago, then, Fischer and Dougherty accurately identified the flawed Florida school grading plan, but also acknowledged the key ignored hurdle facing education, poverty:
If there's one thing that has been firmly established by research, it is the impact social factors have on student achievement. This does not mean poor kids can't achieve. Many do. But poor children often lead transient lives, may suffer from malnutrition and endure higher rates of abuse and neglect than other children. They also tend not to be exposed to books, music and other cultural influences that help ready young minds for school.

Research - and the Times' analysis - shows that when large numbers of students are considered, poverty reliably predicts test scores. The Times' analysis found that depending on which test is given, from 69 to 79 percent of the difference in test scores among schools is explained by poverty.

That seems to ignore several significant demographic factors, like single-parent homes and student mobility. But many of those factors have an extremely high correlation to poverty and thus are effectively included in the analysis.

The bottom line, according to many experts: Any grading system that fails to take poverty into account is flawed.

Ultimately, Fischer and Dougherty offered Florida parents a message still relevant today: "There's more to a school than good test scores. When trying to gauge school quality, educators suggest parents do some investigating."

* See below a graphic (click to open and then click again to enlarge) related to Vasquez and Smiley's article they were unable to include in the online article:

Originally posted to plthomasEdD on Wed Aug 21, 2013 at 11:11 AM PDT.

Also republished by Education Alternatives.

EMAIL TO A FRIEND X
Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags

?

More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

  •  Flordia "jumped the shark" when they got rid of (1+ / 0-)
    Recommended by:
    FloridaSNMOM

    Tony Bennett.  His A - F grades to schools in Indiana is proving to be a total fiasco.  Bennett gave so many exceptions to Charter schools so as to totally discredit the scoring system.  Bennett was only in power with the State Educational board for a few weeks in Florida.  He could have done so much more damage there.

  •  Its all socioeconomics (0+ / 0-)

    This state is so stupid. I hope other states do not follow in Florida's footsteps, although Jebby is trying his best. All A-F does is highlight a districts socioeconomic differences - the have and have-nots. Its horrible and is a huge disservice. And its the lower scoring schools that should get more resources not the A's anyway. Totally backwards. But they love the F's because they can be encouraged to go charter. Anyway, great read, many of us have been screaming about this for a long while.  

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site