By Ashley McGlone, The Hechinger Report
Publish date: June 4, 2013
LOS ANGELES – Robin Wynne Davis was taken aback last year when the state test score gains of her third-grade students at Melrose Elementary School labeled her a less-than-stellar teacher.
“I am just an average teacher, according to that data, but if you look at my class and see how many children are proficient and advanced, it’s a lot of kids,” said Wynne Davis, now an instructional support coach for Melrose Elementary in central Los Angeles.
Seeing her assessment as an “average” teacher in English and a “more effective than average” teacher in math hit the Los Angeles Times a few years ago was upsetting and embarrassing, she said. The assessment of her teaching was based in part on her 2010 students’ test scores.
“I think we have to be judged by how well the kids do in our classrooms, because that’s the nature of teaching. What I don’t like is it doesn’t seem fair,” she said.
Nowhere else in California has the debate over the use of student test scores to grade teachers gained more attention than in the Los Angeles Unified School District. The second-largest school district in the nation at more than 640,000 students, Los Angeles Unified has become a testing ground to increase accountability for teachers, a movement that has gained speed across the nation.
The hope is that schools will improve student achievement by better identifying which teachers are excelling, which are struggling and which need to be removed from the classroom altogether.
California
The outcome in Los Angeles will have repercussions throughout the state, as pressure mounts to improve the state’s lagging achievement and qualify for federal funding.
The district – propelled by a lawsuit and led by Superintendent John Deasy, a darling of reformers who support the effort to overhaul teacher evaluations – has pushed to use mathematical algorithms known as value-added measurement to provide what proponents say is more precise quantitative information about a teacher’s performance. The local union, United Teachers Los Angeles, has fought back furiously and argued against any cookie-cutter approaches.
The two sides have made an uneasy compromise that has not eliminated potential problems that can arise from attributing a student’s performance on a test to a teacher’s abilities.
A deal ratified earlier this year allows the district to use state test scores and the Academic Growth Over Time measurement, which includes past test scores and demographics like family income, language and ethnicity. The deal specifically prohibits the use of individual teacher growth scores other than to “give perspective and to assist in reviewing the past CST (California Standards Test) results of the teacher.”
Critically, however, the agreement is silent on how much weight student data has. An announcement by Deasy in February that student data could account for up to 30 percent of a teacher’s evaluation was met with mixed responses.
Warren Fletcher, president of the 36,000-member United Teachers Los Angeles union, argued that the percentage violates the deal made with the union. It launched an offensive, equipping members with a “Teacher Evaluation Rights Toolkit.” Included was an objection letter to give to principals and examples of what the union said were permissible additions to this year’s initial evaluation planning sheets.
“We negotiated an agreement that honors the concept that administrators and teachers are adults and need to have an amount of discretion in how this works,” said Fletcher, who is in his second year as president of the union.
Despite her experience with the Academic Growth Over Time results, teacher Wynne Davis at Melrose Elementary said she welcomes the capped percentage, which allows for various types of student data.
“I don’t understand why anybody would be upset with 30 percent of your evaluation being tied to student achievement; that means 70 percent is not,” she said. “We are teachers, for God’s sake. I mean, how are you supposed to be judged if you are not using the kids’ work?”
New teacher evaluations
Although the use of test scores remains the most controversial piece of the evaluations, it remains to be seen how the main portion of the evaluations, which are based on intensive, time-consuming qualitative measures of a teacher’s performance, will affect schools and classrooms.
Los Angeles Unified began testing changes to the teacher evaluation system last school year with 425 teachers at 100 campuses who elected to participate and provide feedback.
This year, LAUSD’s pilot program was expanded to more than 1,100 school-site administrators who are working to fine-tune changes with about 900 teachers, one at each campus in the district. In the pilot, state test score gains in a particular class were analyzed and scored relative to the student’s predicted growth based on past scores, and relative to the average gains seen across the district and within different groups of the student population.
But the main focus of the pilot was to test the new qualitative measures.
Lengthy and more detailed evaluation score sheets are given to teachers for self-assessment and principals for observations. What was once a four-page evaluation is now 26 pages with descriptions of what an “ineffective,” “developing,” “effective” and “highly effective” teacher looks like in 61 areas; based on participant feedback, the district limited reviews to 21 areas this year.
Principals also are required to write exactly what they see and hear in the classroom as evidence and rationale of the teacher’s evaluation, a requirement that can leave observers tied to their computers and unable to take in the entire class experience, several pilot participants said. Because principals are working with one teacher as a part of the pilot, it’s unclear what the burden will be when they have to observe all of their teachers when the new system rolls out.
The pilot also tried to address the tricky issue of how to provide student achievement measures for the vast majority of teachers of grades and subjects that are not tested on a state exam, including physical education and art. For now, those teachers, particularly in the early grades, must cobble together a variety of measurements to give some sense of their performance.
At Melrose, veteran teacher Sachiko Miyaji is in her 17th year teaching. She and Wynne Davis were among five teachers at the math, science and technology magnet campus last year to volunteer for the pilot program.
The addition of the hotly contested student test scores in the pilot didn’t affect Miyaji because students take their first California Standards Test in the second grade. As such, the district can’t issue her and other second-grade teachers the individual Academic Growth Over Time scores it has been issuing since spring 2011.
Without state test score gains available, Miyaji relied on other student data for her evaluation. She included her students’ scores on district literacy tests and the University of Oregon’s DIBELS tests, short for Dynamic Indicators of Basic Early Literacy Skills, given three times a year at 20 percent of elementary schools in the nation.
But she said none of that measures the vibrancy of what’s actually happening in the classroom.
On a sunny Friday morning in March, Miyaji gathered her second-graders on the carpet at the front of the class for a lesson on lions and tigers.
“Did you know the back feet of lions and tigers have only four toes?” Miyaji asked. “So which feet? The front or the back?”
Her students, a rambunctious group of 7- and 8-year-olds, respond in unison, “The back!”
Reading from a book, Miyaji told her students that lion prides typically include two dozen cubs.
“That’s 24! Twenty-four cubs,” one student shouted.
“How do you know it’s 24, Carlos?” Miyaji asked.
“Because a dozen is 12,” Carlos said.
It’s observations like this that many teachers hope will provide a clearer picture of their classrooms and make up for any deficiencies in using test scores to judge their performance.
Examining student test scores
Nationally, experts have disputed whether student test score data can be used reliably to measure teacher performance – but nearly all agree that such data should be coupled with more qualitative information to ensure fairness and make sure the evaluations are useful to teachers.
Proponents say the test data is appropriate because it’s one way to measure what’s supposed to be the ultimate outcome of teaching – whether students are learning. The data also can provide a counterweight to principals’ observations, which, depending on how they’re structured, also can have reliability problems.
States and districts mostly have opted to look at student growth, as opposed to raw test scores, because raw scores can disadvantage teachers with large numbers of low-income, limited-English or special needs students, who tend to score lower on standardized tests.
Critics of growth measures have said they can fluctuate depending on the variables and number of years of testing data added to the mathematical formula, making their validity suspect, and worry that grading teachers based on tests will cause them to focus more on test prep in their classrooms.
Drew Furedi, formerly the executive director of Los Angeles Unified’s talent management division and now its executive director of human capital initiatives, said the piloted changes focus on evaluation as “a growth and development tool rather than a punitive tool,” which will tie results to “aligned, targeted, professional development opportunities for teachers.”
In a letter to teachers May 24, Deasy said the district will fully implement the evaluation changes tested in the pilot program next school year.
There’s another reason for the district to be motivated. Los Angeles Unified hopes to opt out of federal student accountability sanctions coming its way in 2014 under the No Child Left Behind Act. The Obama administration offered waivers from the law’s requirement that states steadily increase the number of students graded proficient on standardized exams to 37 states that agreed to other accountability measures, including new evaluations for teachers and principals.
With the promise of local accountability and coordinated efforts to improve, the district is one of nine in a consortium called the California Office to Reform Education – which includes Oakland, Sacramento and San Francisco – seeking a waiver from the U.S. Department of Education. If approved, it would be the first district-level waiver obtained in the offer intended for states.
Other districts and states also have responded to the Obama administration’s urging – through No Child Left Behind waivers and grant competitions like Race to the Top – that districts and states overhaul their evaluations. According to a review by the National Council on Teacher Quality, a Washington, D.C.-based reform group, 20 states in 2012 required student achievement as a significant part of judging teacher performance, including multiple states where student data accounts for 50 percent of an evaluation. In 2009, four states required student data in a significant way.
In many of those places, policymakers have encountered similar resistance from unions and educators on the front lines.
Teacher Denise Casco at Vista del Valle Dual Language Academy in San Fernando said the inclusion of student achievement could disproportionately affect her because she serves a more disadvantaged community than others in the district. She said she worries her students are more likely to lag behind on tests.
Nearly all 500 students on campus in the far northern part of the district are socioeconomically disadvantaged, and half are English-language learners.
“The playing field is not even,” said Casco, who is in her ninth year of teaching. “The funding is not even; the level of support is not even. So I am very cautious at putting a number or percentage for a particular level of student achievement in a teacher evaluation process.”
But not all of the changes are concerning, she said. Like many teachers around the country, she has embraced the more intensive classroom observations, which tend to offer teachers more specific feedback than previous versions.
As a kindergarten teacher last year who participated in the pilot program, Casco had a videotaped math lesson that was selected by the district as a model to train administrators on what to look for during an observation.
In it, her 5- and 6-year-old students are working in small groups. Students play a series of games related to frogs and fish to practice adding and subtracting and eventually are asked to illustrate a story with an equation and grade their own performance on a rubric.
“It forces you to reflect,” Casco said of the evaluation changes, which include the principal asking teachers after the observation if they achieved their objective. “It did hold me more accountable to the results than the old evaluation system would have.”
Lawsuit seeks to strike some teacher protections
The fight in Los Angeles has had a ripple effect across the state. Student plaintiffs filed a lawsuit last May against the state of California and several local districts, including Los Angeles Unified. The lawsuit aims to increase the impact of teacher evaluations by striking down multiple protections teachers have under the law.
Represented by Los Angeles law firm Gibson, Dunn & Crutcher LLP, the plaintiffs allege teacher protections such as tenure, seniority rules in layoffs and other teacher dismissal statutes disparately keep ineffective teachers in the classroom in violation of the state constitution’s equal protection clause. The case also cites court opinions that have held that “the right to an education today means more than access to a classroom” and that the state “has broad responsibility to ensure basic educational equality.”
Deasy and Xavier De La Torre, Santa Clara County’s superintendent of schools, have endorsed the case, according to the nonprofit Students Matter, the advocacy group sponsoring the lawsuit. After failed efforts by the state to get the case dismissed in the last year, a judge granted a request by the California Teachers Association and the California Federation of Teachers to join the lawsuit as defendants May 2. A trial date is set for Jan. 27, 2014.
Los Angeles Unified parent Lauren Campbell has a child plaintiff in the case and said that even though efforts are underway to overhaul the evaluation system in the district, it won’t do much to protect effective, less-senior teachers who she says she has seen get layoff notices year after year at Lanai Road Elementary School in Encino.
“I think that if we value education and we say we want great teachers for our kids, we need to make that job attractive, and part of the way to do that is not fire the best ones every year,” Campbell said.
Los Angeles Unified parent Lisa Liss also argues that the layoff system targets great teachers over less effective ones.
“The impact of having a really bad teacher goes way beyond one academic year. Those kids end up behind for years to come and maybe even permanently,” she said, “so every child should have a great teacher.”
Liss said you have to go to the top to get the wide-reaching changes needed.
“Individual changes will take forever,” she said. “To make a wholesale change at a much higher level is going to be much more effective and much quicker, and these kids don’t have much time to waste. Their education is happening now, not in 20 years.”
Ashly McGlone produced this story for The Hechinger Report and The Center for Investigative Reporting. Sarah Garland of The Hechinger Report contributed to this report.
