The Edmond Sun

Opinion

November 16, 2013

Better ways to grade public schools

LOS ANGELES — How do you measure school quality? For the last decade, the answer has been informed by a single set of data: standardized test scores. Now there is a chance to change that. Although Congress remains unwilling to overhaul No Child Left Behind, with its overemphasis on testing, Secretary of Education Arne Duncan has taken matters into his own hands, issuing waivers that have freed 42 states and eight California districts — including L.A. Unified — from the law’s accountability mechanisms. Waiver recipients are now free to go beyond test scores in measuring school success. But so far, policy leaders seem to be thinking very much inside the box about what to include.

Recently a colleague and I built an online tool for the Boston Globe, designed to evaluate all of the schools in Massachusetts in a more comprehensive way. To do this, we drew on publicly available data. But because our project was not tied to any governmental accountability measures, we were able to think more holistically about school quality, moving beyond raw standardized test scores.

The tool we created is imperfect, and we were severely limited by the data available. Still, we were able to build a better mousetrap. And the project got us thinking: Now that waiver recipients can rethink how to evaluate schools, what would a truly robust measure look like?

The most obvious gap in available data on K-12 schools is related to teacher quality. Many states and districts have tried to solve this problem by adopting “value added” calculations, which attempt — often unreliably — to measure the role teachers play in raising or lowering student test scores over time. Yet even if such tools are more carefully used, more can be done to measure teacher effectiveness.

We know from research, for instance, that high rates of teacher turnover are problematic. We know, as well, that teachers in their first few years are significantly less effective than those with more experience. Because information on teacher turnover and experience is already collected by many districts and built into school-level report cards, why not incorporate such measures into statewide accountability schemes? And why not also experiment with student evaluations of teachers, or with teacher evaluations of their working conditions? Combined with robust performance-based assessments, such figures would present a much clearer picture of teacher quality.

Policy leaders should also prioritize the collection of data that tell us what it feels like to walk down a school’s hallway. Again, there is some good information already being collected at the school or district level. Los Angeles Unified schools, for instance, have been conducting a “school experience survey” for the last several years. But such measures have played no role in accountability frameworks, largely because of the challenge of collecting the data in a consistent and accurate way.

New technologies, however, such as software applications that can be implemented across multiple platforms, including mobile phones, are making it possible to conduct frequent brief surveys of teachers and students. By posing questions such as “How safe did you feel at school today?” or “How focused were your peers in class?,” we can begin to gain insight into a school’s climate as well as into the social and emotional well-being of students.

Waiver recipients should also lobby for the inclusion of stronger and more direct measures of academic performance. Raw test scores have long been the primary gauge of performance, but they often indicate more about student background — particularly family income — than about the contribution of the school. Advanced data systems, however, have made it possible to compare students at a single school with other students across the state who have similar testing histories and demographic backgrounds.

Thus, by making a straightforward adjustment in measurement, policymakers would not only present a clearer picture of school quality but also end an accountability system that inherently punishes schools serving high-need populations.

Finally, we should consider more systematic collection of data on nonacademic programs in schools. It will require creative thinking to devise appropriate measurement instruments, but Americans generally agree that schools should do more than produce students who can take tests. And we know from research that students engaged in extracurricular activities tend to have more positive school experiences.

So why not report the number of students who receive regular art instruction, the number of students who participate in a school’s music program and the percentage of students involved in clubs or other extracurricular activities? Why not, in other words, hold schools accountable for being schools and not just test-prep paddocks?

Ultimately, of course, there is no perfect measure of school quality. And despite the rhetoric of the accountability movement, any attempt to measure a school is an inherently subjective enterprise. But as long as we are going to rate our schools, we should be working to piece together a picture of them that is multifaceted, rooted in research and congruent with the things we truly value. In short, we should measure what we care about and not merely what is convenient.

JACK SCHNEIDER is an assistant professor of education at the College of the Holy Cross and the author of “From the Ivory Tower to the Schoolhouse: How Scholarship Becomes Common Knowledge in Education.” He wrote this for the Los Angeles Times.

1
Text Only
Opinion
  • Instead of mothballing Navy ships, give them to our allies

    A bitter debate has raged in the Pentagon for several months about the wisdom of taking the nuclear aircraft carrier George Washington out of service to save money. The Washington, at 24 years old a relatively young vessel, is due for a costly refit, a routine procedure that all of the 11 large carriers in service undergo regularly.

    April 18, 2014

  • The pessimist’s guide to grizzly bears and Earth Day

    This coming Friday, to “celebrate Earth Day,” the Walt Disney Co. will release one of those cutesy, fun-for-all-ages, nature documentaries. “Bears” is about grizzly bears.
    The trailer says, “From DisneyNature comes a story that all parents share. About the love, the joy, the struggle and the strength it takes to raise a family.”
    Talk about your misguided “Hollywood values.” I previously have acknowledged a morbid, unreasonable fear of grizzly bears, stemming from a youth misspent reading grisly grizzly-attack articles in Readers Digest. This fear is only morbid and unreasonable because I live about 1,500 miles from the nearest wild grizzly bear. Still. ...

    April 16, 2014

  • Digging out of the CIA-Senate quagmire

    Last week, the Senate Intelligence Committee, led by Sen. Dianne Feinstein, D-Calif., voted to declassify parts of its report on the CIA’s rendition, detention and interrogation program. The White House, the CIA and the Senate still have to negotiate which portions of the report will be redacted before it is made public. But this is an important step in resolving the ugly dispute that has erupted between the intelligence committee and the intelligence agency.
    The dispute presents two very serious questions. Was the program consistent with American values and did it produce valuable intelligence? And is effective congressional oversight of secret activities possible in our democracy?

    April 15, 2014

  • Los Angeles Times: Congress extend jobless benefits again

    How’s this for irony: Having allowed federal unemployment benefits to run out in December, some lawmakers are balking at a bill to renew them retroactively because it might be hard to figure out who should receive them. Congress made this task far harder than it should have been, but the technical challenges aren’t insurmountable. Lawmakers should restore the benefits now and leave them in place until the unemployment rate reaches a more reasonable level.

    April 14, 2014

  • Many nations invested in Israel

    Former Israeli Ambassador to the United States Yoram Ettinger recently spoke to a gathering at the Chabad Center for Jewish Life and Learning in Oklahoma City. The event began with a presentation by Rabbi Ovadia Goldman, who told the attendee that the  upcoming Jewish holiday of Passover was an occasion for them to embrace the children of God, which is all of humanity.

    April 14, 2014

  • Coming soon: More ways to get to know your doctor

    Last week, the federal government released a massive database capable of providing patients with much more information about their doctors.
    The Centers for Medicare and Medicaid Services, the government agency that runs Medicare, is posting on its website detailed information about how many visits and procedures individual health professionals billed the program for in 2012, and how much they were paid.
    This new trove of data, which covers 880,000 health professionals, adds to a growing body of information available to patients who don’t want to leave choosing a doctor to chance. But to put that information to good use, consumers need to be aware of what is available, what’s missing and how to interpret it.

    April 14, 2014

  • HEY HINK: Hateful bullies attempt to muffle free speech

    Hopefully we agree it should be a fundamental right to voice criticism of any religion you wish. And you should have the right to sing the praises of any religion you choose. If criticism of religion is unjust, feel free to make your best argument to prove it. If criticism is just, don’t be afraid to acknowledge and embrace it. If songs of praise are merited, feel free to join in. If not, feel free to ignore them. But no American should participate in curbing free speech just because expression of religious views makes someone uncomfortable.

    April 11, 2014

  • Putting Oklahoma parents in charge

    Oklahoma’s public schools serve many children very well. Still, for various reasons, some students’ needs are better met in private schools, in virtual schools or elsewhere. That is why two state lawmakers have introduced legislation to give parents debit cards, literally, to shop for the educational services that work best for their children.

    April 11, 2014

  • Israelis, Palestinians are losing their chance

    Developments in the Middle East suggest that prospects of success for the Israeli-Palestinian talks, to which Secretary of State John Kerry has devoted countless hours and trips, are weakening.

    April 11, 2014

  • Teens might trade naked selfies for mugshots

    Will teenagers ever learn? You think yours will. Maybe so. But it's likely that was also the hope of the parents of children who were so shamed by nude photos of themselves that went south - how else can they go - that they killed themselves.

    April 11, 2014

Poll

Do you agree with a state budget proposal that takes some funds away from road and bridge projects to ramp up education funding by $29.85 million per year until schools are receiving $600 million more a year than they are now? In years in which 1 percent revenue growth does not occur in the general fund, the transfer would not take place.

Agree
Disagree
Undecided
     View Results