Assorted Stuff

wasting bandwidth since 1999

Tag: teacher

More Statistical Crap

May 1, 2014 / 0 Comments

More on the statistical crap known as Value-Added Measure (VAM), the teacher evaluation system that’s supposed to incorporate the improvement in learning (aka standardized test scores) experienced by students in their classes.

This time some teachers and their local union are suing the Houston Independent School District over the way this process has been applied.

There’s not much new in their criticism of this “badly flawed method of evaluating teacher effectiveness”, one that’s already been challenged by people who actually understand the analysis of data, the American Statistical Association.

However, one highly inaccurate statement posted to the district website in support of using VAM jumped out at me:

Nothing matters more to student success than teachers.

While good teachers certainly can make a difference, there are many studies showing that a student’s socioeconomic status and parents are far more important factors of their success in school.

And, which is important in this case, there’s very little credible research1 supporting VAM as a teacher evaluation tool or as a means of improving student learning (again, aka standardized test scores).

Unexpected Change

April 9, 2013 / 1 Comment

Speaking of teacher evaluation (which I was in yesterday’s post), Jay Mathews has changed his mind about the use of standardized tests in that process.

I used to think student test score gains were a good way to rate teachers. I don’t think that any more. Grading individual teachers with scores is too approximate, too erratic and too destructive of the team spirit that makes great schools. Rating schools, rather than teachers, by test score gains is better, at least until we find a way to measure deeper indicators of learning.

My immediate response was, it’s about time. Teachers do not do great work in isolation. They have always had a support system of some kind and we should be evaluating and rewarding everyone as a team as well as individuals.

Anyway, so what changed the mind of Mathews? Well, he doesn’t make that completely clear in this column but it has something to do with his admiration for the teachers receiving the Agnes Meyer award, given annually by his employer, The Washington Post, to the teacher of the year in each of the DC area districts. Plus other teachers he has written about over the years.

Mathews goes on to note that the assessment system used in DC (and elsewhere) puts too much emphasis on student test schools, rarely mentioning the “creativity and vitality” of the teacher or schools, and making a “big deal” out of adhering to the rules. I actually agree with him that the teachers who do the best work for kids are usually the ones who are not afraid to challenge and break those rules when necessary.

While I’m not sure I subscribe to Mathews’ idea that we should go back to the “old fashioned” system in which teacher evaluation is based solely on principal observations, at least he’s headed in the right direction.

However, if Mathews would only change his mind and abandon the incredibly narrow and “too approximate, too erratic, and too destructive” system of evaluating the quality of high schools known as the “challenge” index (which, of course, is his invention and also ignores “creativity and vitality”), that would be very unexpected, and welcome, change.

© 2023 Assorted Stuff

Theme by Anders Noren — Up ↑