Since teacher ratings are of such great interest on the blog, I wanted to share part of an e-mail from a teacher to me and the legislators considering this idea, state Rep. Edward Lindsey’s response to the e-mail and then the letter that New York Chancellor Joel Klein wrote to his teachers explaining why he agreed to release effectiveness ratings there once the courts cleared the way.
I think all three give a pretty good summary of the pros and cons of this highly explosive issue. I think it is fair to say from the hundreds of response to the blog and personal e-mails to me that this is not an idea that Georgia teachers will easily endorse.
And teachers have not done so in Los Angeles where the LA Times released teacher ratings this summer that led to protests in the streets. Teachers are fighting release of similar effectiveness rankings in New York where the media want to see them and the school system wants to provide them under the rationale that parents deserve more information about their children’s teachers.
First, the e-mail from the outraged teacher, who also posted to the blog in shorter form:
This is one of the most ridiculous and insulting ideas in a long line of such that I have come to expect from this country’s politicians and put forth with some measure of support by the less-than-critical news media. I would suggest that this announcement smacks more of political grandstanding than of any substantive desire to improve our abysmal education ranking and that the AJC gives every appearance of serving as the mouthpiece.
As noted in my entry to the blog, teachers have long been subject to annual performance evaluations. Therefore, all your proposal would accomplish is to make these evaluations a matter of public knowledge, unless you intend to add yet another evaluation into the mix. What can possibly be gained by doing such a thing, other than spending taxpayer dollars to study how best to evaluate/report and develop a means of doing so? Will your proposal provide for the means for parents to request the “passing grade” teachers for their children? Will your proposal provide for the means of improvement of the “failing grade” teachers? Will your proposal provide a quantitative and verifiable means to help the students of this state? If not, then of what value is the public report card? If someone with less than stellar performance has remained on the job year in and year out, that is hardly their “fault.”
I would suggest that the one(s) not actually performing the duties of a job would be the administrator(s) incorrectly administering the evaluation instrument or following through with steps to negate the unsatisfactory results. Will your proposal provide for releasing the information contained within the performance evaluations in all prior years of the teacher’s employment so as to explain why someone with such a record has continued in the position
Does not the release of such information constitute a violation of privacy in some form or another as related to employment (public release of private evaluation information, for example)? So many lawsuits have been filed against former employers for giving bad references that few are now willing to say more than that an applicant was employed at the business during a specific time period. Yet the state of Georgia is now planning to release possibly detrimental data to the general public regarding its employees? Do you not feel that you will be exposing the taxpayers of this state as well as of the employing county to lawsuits by publishing such information?
Have you entered into any dialogue at all with the Georgia Department of Education on this topic? After all, is it not the purpose of that body to oversee matters of education in the state of Georgia? If, however, the legislature is now to address these issues, should not the DOE be disbanded? There would seem to be no reason to have such a department when the legislature will be addressing matters of education. Would not such a move serve to address some of the budget shortfall we are now facing in Georgia? Think of the money that could be saved by getting rid of unnecessary employees (all of them, apparently) in that department.
Surely, surely in these lean budget times there are more pressing issues of time and money that the lawmakers of this state should be addressing other than teacher report cards. However, if you feel that this is indeed a worthy pursuit, then I, as a taxpaying citizen of the state of Georgia, would ask that you also push for public report cards for members of the medical profession, the local police and fire forces, our county and city commissioners, any and all other individuals who are paid by local and state governments (including lawmakers in the state house, their staffs, employees of the governor’s office, local school boards, school administrators, bus drivers, cafeteria workers, secretaries, para-pros, coaches, etc., and every single person affiliated in any way with the Georgia Department of Education, elected or otherwise). As all of these people are paid in one way or another by taxpayer dollars (through mandated health care or checks from some level of government), I feel that we taxpayers are “entitled” to see the rating of each of these employees as well.
Do you not feel that citizens of this state have a right to see a report card on every government employee (including yourself) in this state, not just the teachers? Or, perhaps, have you come to understand that the state of Georgia really does have more important matters to address than those which already have a means of correction in place?
And Rep. Lindsey replied:
You have given me quite a stream of consciousness to consider. As I discussed with Ms. Downey, the teacher report card is one of many reforms being seriously studied and should not be viewed in isolation. We need to look at many areas of education including the curriculum in the pre K program, the number of standardized test being given, improving teacher quality, enhancing parental involvement, the high school graduation rates, the technical school program, and the hope scholarship. There is no one single bullet here and all issues need to be on the table.
I also emphasized to Ms. Downey the importance of teacher input on any reforms being advanced. That is what I am doing here now. The one thing that I will not accept is that the status quo is acceptable. My constituents in general and our next generation in particular deserve better. I believe I clearly know where you stand on teacher report cards; however, I also note from your e mail that you did not offer any constructive reforms that you believe would help move the ball forward. I look forward to hearing from you again with any such ideas.
And here is NY Chancellor Joel Klein’s letter to his teachers on why he agreed to release effectiveness ratings, pending the outcome of a court challenge by New York’s teacher union. The court has not ruled yet on the release:
Dear Colleagues,
As you have likely heard or read, several media outlets recently issued Freedom of Information Law (FOIL) requests to the City, requiring the Department to share the Teacher Data Reports we provide schools and teachers in grades 4 through 8 each year. These reports use a method called “value-added data” that seeks to predict student performance based on factors outside of a teacher’s control (high levels of poverty, for example), and then determines whether a given teacher’s students exceeded or fell short of these predicted examination scores (teachers may always access their reports at http://schools.nyc.gov/Teachers/TeacherDevelopment/TeacherDataToolkit/GetYourReports/default.htm).By controlling for factors beyond a teacher’s control, it is the fairest system-wide way we have to assess the real impact of teachers on student learning. And while the City’s particular value-add method is not etched in stone, this is why the State passed legislation this spring, endorsed by the teachers’ unions, committing to using value-added data for all teachers. It is also why value-added data is increasingly being used throughout the nation as part of a comprehensive system of teacher evaluation.
In the past we have provided the numeric value-added data to the press with no indication of the identity of individual teachers. I am writing to you today because media outlets, prompted by similar data being published by the Los Angeles Times, have requested the names of individual teachers, not just the statistics.
As it is the City’s legal interpretation that we are legally obligated to provide the media this information, it is our intent to provide the data as requested.
In the time since we informed the UFT that we intended to comply with the FOIL request, the union has sued the City to prevent the release, and we have agreed to delay any release until at least November 24, when a court hearing will be held. So no data have yet been released. But I want to make sure that, as you read about these events in the newspapers, you understand the circumstances and you understand my view on the issue overall.
Our most important task is to ensure that every one of our students has a great teacher. It is critical, therefore, that when we have indications of a teacher’s proficiency, we use that indication to do what’s right for kids. One indication will never tell the whole story, and sometimes it is hard to discern definitive evidence from data alone —such as with a teacher who is “average” according to these numbers, for example. But where teachers have performed consistently toward the top or the bottom, year after year, these data surely tell us something very important. Namely, we need to retain and reward the great teachers, and we need to develop the low-performing teachers. And those who don’t improve quickly need to be replaced with better-performing teachers.
Secretary Arne Duncan last week said it best when he said, “I give New York credit for sharing this information with teachers so they can improve and get better.” More than anything, these data demonstrate that we need a better, more comprehensive system of evaluation than the one we have now. That’s why the State legislature and the unions supported an evaluation system that uses value-added data. Now it’s time that the DOE and UFT together build a new system that gives teachers an honest sense of how well they’re doing and how they can improve.
In the end, this is about real people. On one hand, for too long, parents have been left out of the equation, left to pray each year that the teacher greeting their children on the first day of school is truly great, but with no real knowledge of whether that is the case, and with no recourse if it’s not.
But this is also about teachers. They take on the hardest work there is, and they deserve our respect. If anyone sees these data as an opportunity to scapegoat public servants, that is a mistake. Doing what’s right for children means making hard decisions; it has nothing to do with personal attacks.
We’ve made huge strides for our kids over the last eight years. That’s because we’ve been willing to face hard facts. It’s also because we have made kids’ best interests our shared priority. My hope is that we approach this issue with both of those thoughts in mind, ensuring fair treatment for adults, but always keeping children first.
Sincerely,
Joel I. Klein– By Maureen Downey, for the AJC Get Schooled blog
264 comments Add your comment
teacher&mom
January 2nd, 2011
7:07 pm
The following article from the New York Times had this to say about efforts to rate teachers:
http://www.nytimes.com/2010/12/27/nyregion/27teachers.html?_r=2&partner=rss&emc=rss
Below are a few items from the article:
“Down the hall, Deirdre Corcoran, a fifth-grade teacher, received a ranking for a year when she was out on child-care leave. In three other classrooms at this highly ranked school, fourth-grade teachers were ranked among the worst in the city at teaching math, even though their students’ average score on the state math exam was close to four, the highest score.”
“But the experience in New York City shows just how difficult it can be to come up with a system that gains acceptance as being fair and accurate. The rankings are based on an algorithm that few other than statisticians can understand, and on tests that the state has said were too narrow and predictable.”
“Yet a promising correlation for groups of teachers on the average may be of little help to the individual teacher, who faces, at least for the near future, a notable chance of being misjudged by the ranking system, particularly when it is based on only a few years of scores.”
teacher&mom
January 2nd, 2011
7:14 pm
Here’s more:
”
One national study published in July by Mathematica Policy Research, conducted for the Department of Education, found that with one year of data, a teacher was likely to be misclassified 35 percent of the time. With three years of data, the error rate was 25 percent. With 10 years of data, the error rate dropped to 12 percent. The city has four years of data.”
The most extensive independent study of New York’s teacher rankings found similar variability. In math, about a quarter of the lowest-ranking teachers in 2007 ended up among the highest-ranking teachers in 2008.
In math, judging a teacher over three years, the average confidence interval was 34 points, meaning a city teacher who was ranked in the 63rd percentile actually had a score anywhere between the 46th and 80th percentiles, with the 63rd percentile as the most likely score. Even then, the ranking is only 95 percent certain. The result is that half of the city’s ranked teachers were statistically indistinguishable.
“The issue is when you try to take this down to the level of the individual teacher, you get very little information,” Dr. Corcoran said. The only rankings that people can put any stock in, he said, are those that are “consistently high or low,” but even those are imperfect.
“So if you have a teacher consistently in the top 10 percent,” he said, “the chances are she is doing something right, and a teacher in the bottom 10 percent needs some attention. Everything in between, you really know nothing.”
“But Dr. Harris urged caution in reading too much into the early crop of rankings, and added, “As a general rule, you should be worried when the people who are producing something are the ones who are most worried about using it.”
teacher&mom
January 2nd, 2011
7:25 pm
According to today’s article in the AJC, “After three years, new teachers whose students aren’t showing enough academic growth on tests would not be recertified. Other teachers would be recertified every five years only if their students post the proper gains.”
Three years of data has a 25% chance of misclassifying a teacher. It takes 10 years to drop the error rate to 12%.
We could potentially end up with teachers losing their certificates before enough data has been collected to accurately classify a teacher.
Based on what I’ve read, the error rate increases when the percentage for standardized test scores is set too high. In NYC, test scores account for 25% of the teachers’ classification. Test scores in GA will make up 40% of the evaluation.
teacher&mom
January 2nd, 2011
7:37 pm
Am I the only one who reads the current information about VAA’s and thinks that maybe publishing a teacher report card is just a little insane?
Are we ready to start pulling teacher’s certification with only 5 years of data? What if the teacher switches grade levels or subjects? This happens all the time in my district based on class sizes and year-to-year needs within different grades. Middle school teachers may teach science one year, and LARTS the next. Some teachers may work in special education for a few years and then move into a regular ed classroom.
How the heck will they keep track of all that?
ScienceTeacher671
January 2nd, 2011
9:14 pm
Teacher&mom, those are excellent points, We also don’t know exactly what qualities make a teacher an excellent teacher, so we don’t know how to measure them.
As others have pointed out, we don’t know how many of the “bad” teachers are in their first couple of years and will be gone before getting clear renewable status or fair dismissal privileges. And no one seems to have any plan for attracting “good” teachers with which to replace the “bad” ones if we’re able to ferret out which is which
HS Math Teacher
January 2nd, 2011
9:45 pm
“There’s nothing more frightening than ignorance in action.” – Goethe
Career Switcher
January 3rd, 2011
2:07 am
Sunday’s AJC article mentions that 3 years of test scores will be used. I teach 8th grade, and I (and a few other middle school math teachers at other schools) have noticed that individual math scores rise a bit from 6th to 7th, and then tend to fall again in 8th. Of course, this is not scientific, and is merely based on my observations. I am not sure if this is related to the difficulty of the test or the curriculum (8th grade material covers a lot of new material, much of it algebra). How would this be accounted for? Does anyone else see similar trends across other grades/subjects with CRCT results? Just another point to ponder.
@Happy Teacher…I don’t recall anyone mentioning that they were giving up on “those” kids or that they only wanted to teach the advanced and honors students. I think most of us simply want to make sure that everyone understands that class loads typically aren’t balanced, and that there are many factors that go into test scores. If we are issued report cards, I would like to know that my class makeup will be included in my data/grade. I think that is only fair. If my grade weren’t somehow adjusted to reflect that most of my students came to me several years below grade level, can you imagine the parent outcry when a child is placed with me the following year (vs. one of the other teachers who teach higher percentages of advanced students)? What if the advanced students showed no growth, but still passed? What if my special ed students showed good gains, but did not pass? Do you realize that many parents and legislators who are not involved in the day to day workings of education often do not understand the ins and outs of things? And that we are attempting to use this board to offer constructive input on factors that should be considered when developing teacher report cards? Let’s hope that you never encounter an unfair administrator or end up with a group of students who, for one reason or another you are unable to reach. Apparently you are teaching in a fantasy world where none of your students miss 40 days of school, get arrested, or just resist any efforts you offer for an education. I can teach like my hair is on fire 180 days a year, provide counseling, offer encouragement, buy hungry children lunch, and still not reach 100% of my adolescent students. Sadly, I have come to realize that is the nature of the middle school population in a high poverty school. I do the best I can, as many of us do, always going over and beyond what I should do. But I don’t need anyone suggesting that I shouldn’t be trying to stand up and speak out about things that need to be changed or considered in this process!
lovetoteach
January 3rd, 2011
9:36 am
There have been so many interesting points brought up on this forum regarding teacher report cards. I am sure that I am repeating what others have said, but I will say it anyway! I have been a public school teacher for 19 years. I feel that I am very good at what I do and I still get excited going to work everyday. Do I need a report card to tell me what I already know? What my peers already know? Or the parents, who always already know? Every year, after the CRCT, I am given a break down of how every child performed. My professional goals for the coming year must be tied to my previous year’s scores. Heck, I could have told you how they were going to do while they were taking the test! Seriously, when a child is finished with the Reading portion in 8 minutes, I can pretty well assume s/he isn’t going to exceed. So now my “report card” will be public knowledge. Will it be published in the local paper like my salary was a couple of years ago? Or will it be online for a parent to have to look it up? Will this new evaluation be implemented for a few years and then be replaced by something else as we have seen in education too many times? I agree that changes need to be made to Georgia’s current educational system but I am unclear as to how much of an impact this will have. One change I would love to see is less reliance on the testing that we do. After several years of CRCT I fear that more and more children are better at testing than they are at thinking! They can eliminate answers, use clue words, and lots of other strategies to get the correct answer out of 4 given, but if I ask them an open-ended question I get the deer in the headlights look. What about the evaluations of those teachers who don’t test students? In my experience, public education is home to some of the most political, good ol’ boy shenanigans I have ever seen. So is my administrator really going to give an unsatisfactory evaluation to his golf buddy who happens to be the PE teacher and does nothing with his students except watch them play while he reads the paper? As I said before, I firmly believe that we will have report cards for teachers. I just hope that the powers that be take a bit more time to do this right. Unlike some of the other educational “reforms” that have come to pass in our state.
teacher&mom
January 3rd, 2011
10:28 am
@Maureen,
The Washington Post has an excellent OpEd today by Anthony Cody. Perhaps the AJC will contact Mr. Cody and post this article.
http://voices.washingtonpost.com/answer-sheet/anthony-cody/the-bad-teacher-bogeyman-and-w.html
cricket
January 6th, 2011
12:37 pm
In case you haven’t figured it all out yet…teacher evaluations and accountability motivations revealed.
http://www.youtube.com/watch?v=BpmQZ5MXs8c&feature=more_related
Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) : shopmajorbrands.com/page7
January 12th, 2011
8:31 am
[...] Apple iPod touch 8 GB (4th Generation) NEWEST MODEL Via Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) [...]
Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) : shopmajorbrands.com/page7
January 12th, 2011
9:31 am
[...] Call of Duty: Black Ops Via Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) [...]
Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) : shopmajorbrands.com/page7
January 12th, 2011
9:46 am
[...] Loopz Game Via Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) [...]
Prospect of teacher ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) | Advance Web Directory
January 12th, 2011
11:41 am
[...] from: Prospect of clergyman ratings sparks debate, criticisms – Atlanta Journal Constitution (blog) This entry was posted in Uncategorized and tagged chancellor, children, city, education, media, [...]