The Edmond Sun

Opinion

November 16, 2013

Better ways to grade public schools

LOS ANGELES — How do you measure school quality? For the last decade, the answer has been informed by a single set of data: standardized test scores. Now there is a chance to change that. Although Congress remains unwilling to overhaul No Child Left Behind, with its overemphasis on testing, Secretary of Education Arne Duncan has taken matters into his own hands, issuing waivers that have freed 42 states and eight California districts — including L.A. Unified — from the law’s accountability mechanisms. Waiver recipients are now free to go beyond test scores in measuring school success. But so far, policy leaders seem to be thinking very much inside the box about what to include.

Recently a colleague and I built an online tool for the Boston Globe, designed to evaluate all of the schools in Massachusetts in a more comprehensive way. To do this, we drew on publicly available data. But because our project was not tied to any governmental accountability measures, we were able to think more holistically about school quality, moving beyond raw standardized test scores.

The tool we created is imperfect, and we were severely limited by the data available. Still, we were able to build a better mousetrap. And the project got us thinking: Now that waiver recipients can rethink how to evaluate schools, what would a truly robust measure look like?

The most obvious gap in available data on K-12 schools is related to teacher quality. Many states and districts have tried to solve this problem by adopting “value added” calculations, which attempt — often unreliably — to measure the role teachers play in raising or lowering student test scores over time. Yet even if such tools are more carefully used, more can be done to measure teacher effectiveness.

We know from research, for instance, that high rates of teacher turnover are problematic. We know, as well, that teachers in their first few years are significantly less effective than those with more experience. Because information on teacher turnover and experience is already collected by many districts and built into school-level report cards, why not incorporate such measures into statewide accountability schemes? And why not also experiment with student evaluations of teachers, or with teacher evaluations of their working conditions? Combined with robust performance-based assessments, such figures would present a much clearer picture of teacher quality.

Policy leaders should also prioritize the collection of data that tell us what it feels like to walk down a school’s hallway. Again, there is some good information already being collected at the school or district level. Los Angeles Unified schools, for instance, have been conducting a “school experience survey” for the last several years. But such measures have played no role in accountability frameworks, largely because of the challenge of collecting the data in a consistent and accurate way.

New technologies, however, such as software applications that can be implemented across multiple platforms, including mobile phones, are making it possible to conduct frequent brief surveys of teachers and students. By posing questions such as “How safe did you feel at school today?” or “How focused were your peers in class?,” we can begin to gain insight into a school’s climate as well as into the social and emotional well-being of students.

Waiver recipients should also lobby for the inclusion of stronger and more direct measures of academic performance. Raw test scores have long been the primary gauge of performance, but they often indicate more about student background — particularly family income — than about the contribution of the school. Advanced data systems, however, have made it possible to compare students at a single school with other students across the state who have similar testing histories and demographic backgrounds.

Thus, by making a straightforward adjustment in measurement, policymakers would not only present a clearer picture of school quality but also end an accountability system that inherently punishes schools serving high-need populations.

Finally, we should consider more systematic collection of data on nonacademic programs in schools. It will require creative thinking to devise appropriate measurement instruments, but Americans generally agree that schools should do more than produce students who can take tests. And we know from research that students engaged in extracurricular activities tend to have more positive school experiences.

So why not report the number of students who receive regular art instruction, the number of students who participate in a school’s music program and the percentage of students involved in clubs or other extracurricular activities? Why not, in other words, hold schools accountable for being schools and not just test-prep paddocks?

Ultimately, of course, there is no perfect measure of school quality. And despite the rhetoric of the accountability movement, any attempt to measure a school is an inherently subjective enterprise. But as long as we are going to rate our schools, we should be working to piece together a picture of them that is multifaceted, rooted in research and congruent with the things we truly value. In short, we should measure what we care about and not merely what is convenient.

JACK SCHNEIDER is an assistant professor of education at the College of the Holy Cross and the author of “From the Ivory Tower to the Schoolhouse: How Scholarship Becomes Common Knowledge in Education.” He wrote this for the Los Angeles Times.

1
Text Only
Opinion
  • Is English getting dissed?

    Is the English language being massacred by the young, the linguistically untidy and anyone who uses the Internet? Absolutely.
    Is that anything new? Hardly.
    Many words and expressions in common parlance today would have raised the hackles of language scolds in the not-so-distant past. For evidence, let’s look at some examples from recent newspaper articles.

    July 31, 2014

  • 'Too big to fail' equals 'too eager to borrow'

    Four years ago this month, President Barack Obama signed the Dodd-Frank Act into law, promising that the 848-page financial law would “put a stop to taxpayer bailouts once and for all,” he said. But recently, Massachusetts Sen. Elizabeth Warren told a Detroit crowd that “the biggest banks are even bigger than they were when they got too big to fail in 2008.”
    Who’s right?

    July 30, 2014

  • Sheltons travel for better life for family

    Some time around 1865 a mixed-race African American couple, William and Mary Shelton, made their way from Mississippi to east Texas. Nothing is known for certain of their origins in he Magnolia state, or the circumstances under which they began their new lives in Texas.

    July 29, 2014

  • Film critic Turan produces book

    Kenneth Turan, who is the film critic for National Public Radio’s “Morning Edition,” has written a book “Not to be Missed, Fifty-Four Favorites from a Life Time of Film.” His list of movies span the gamut from the beginnings of filmmaking through the present day.
    There are some surprising omissions on his list. While he includes two films, “A Touch of Evil” and Chimes at Midnight” made by Orson Welles, and one, “The Third Man,” that Welles starred in but did not direct. He did not however, include “Citizen Kane,” that was the first movie Welles made, that is  often cited by both film critics and historians as a favorite film.

    July 28, 2014

  • Logan County’s disputed zone

    Watchers of “Star Trek” may recall the episode from the original series entitled, “Day of the Dove.” In this episode, Captain Kirk and his crew are forced by a series of circumstances into a confrontation with the Klingons. The conflict eventually resolves after Kirk realizes that the circumstances have been intentionally designed by an alien force which feeds off negative emotions, especially fear and anger. Kirk and his crew communicate this fact to the Klingons and the conflict subsides. No longer feeding upon confrontation, the alien force is weakened and successfully driven away.

    July 28, 2014

  • Russell leads in Sun poll

    Polling results of an unscientific poll at www.edmondsun.com show that Steve Russell, GOP candidate for the 5th District congressional seat, is in the lead with 57 percent of the vote ahead of the Aug. 26 runoff election. Thirty readers participated in the online poll.

    July 28, 2014

  • Healthier and Wealthier? Not in Oklahoma

    Increased copays, decreased coverage, diminished health care access, reduced provider budgets and increased frustration are all the outcomes of the Legislature’s 2014 health care funding decisions. Unlike some years in the past when a languishing state economy forced legislators into making cuts, the undesirable outcomes this year could easily have been avoided.

    July 26, 2014

  • Medicaid reform a necessity

    Historically, education spending by the state of Oklahoma has been the largest budget item. This is no longer the case. In recent years, the state of Oklahoma spends more on Medicaid (operated by the Oklahoma Health Care Authority) than common education and higher education combined, according to the state’s Comprehensive Annual Financial Report.

    July 25, 2014

  • Remembering lessons from 1974

    This week marks the 40th anniversary of an important milestone in America’s constitutional history. On July 24, 1974, the Supreme Court voted 8-0 to order the Nixon White House to turn over audiotapes that would prove the president and his close aides were guilty of criminal violations. This ruling established with crystal clarity that the executive branch could not hide behind the shield of executive privilege to protect itself from the consequences of illegal behavior. It was a triumph for the continued vitality of our constitutional form of government.

    July 25, 2014

  • RedBlueAmerica: Is parenting being criminalized in America?

    Debra Harrell was arrested recently after the McDonald’s employee let her daughter spend the day playing in a nearby park while she worked her shift. The South Carolina woman says her daughter had a cell phone in case of danger, and critics say that children once were given the independence to spend a few unsupervised hours in a park.
    Is it a crime to parent “free-range” kids? Does Harrell deserve her problems? Joel Mathis and Ben Boychuk, the RedBlueAmerica columnists, debate the issue.

    July 24, 2014

Poll

The runoff race for the 5th District congressional seat is set for Aug. 26. If the voting were today, which candidate would you support?

Al McAffrey
Tom Guild
Undecided
     View Results