Focus On Developing Teachers, Not Simply Measuring Them

This cross-posted item is from a piece I wrote for the Silicon Valley Education Foundation's TOP-Ed blog.

-----------------------------------------------

Amid the current flurry of state policy reform activity around teaching, I've been thinking about what's missing. My conclusion: A focus on teachers as learners....

----------------------------------------------

To read more, visit the TOP-Ed blog post.

You have read this article California / Education / induction / professional development / teacher effectiveness / teaching with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2012/02/focus-on-developing-teachers-not-simply.html. Thanks!

rheeForm

Proposed education reforms that do not imagine that current and beginning teachers can become more effective while on the job should be considered null and void. This postulation, if accepted, would direct Michelle Rhee's new StudentsFirst agenda to the nearest paper shredder.

To be blunt, it is just plain naive and short-sighted to think that we can maximize teacher effectiveness purely by firing more teachers and marginally changing the cadre of incoming teacher candidates. Is supporting and strengthening the teaching practice of our veteran educators not worthy of our focus and investment?

StudentsFirst's "Elevate Teaching" policy objectives are limited to evaluating teachers and principals, reforming teacher certification laws, reforming teacher compensation, "exiting" teachers, and eliminating teacher tenure. Specifically, the objectives are:

• State law must require evaluation that is based substantially on student achievement. Evaluation tools should measure at least half of a teacher's performance based on student achievement, using a value-added growth model. The other aspects of a teacher's evaluations should derive from measures that align with student results, including high-quality observations and student evaluations of teacher practice.
• To avoid all teachers being ranked as effective without meaningful assessment, evaluations must anchor effectiveness around a year's worth of growth.
• State law must require principal evaluation that is based on student achievement and effective management of teachers. Districts should evaluate at least half of a school administrator's performance based on student achievement, and the remaining portion should mostly relate to their ability to attract, retain, manage, and develop excellent teachers.
• State law should give districts the autonomy to develop teacher evaluation systems apart from the collective bargaining process. Evaluations should be a matter of district policy.
• States must reduce legal barriers to entry in the teaching profession, including complicated credentialing or certification schemes that rely upon factors that do not clearly correlate with teacher effectiveness.
• State law should not be structured to penalize districts financially for recruiting teachers from alternate certification programs.
• States should adopt a clear process by which alternative certification programs are authorized, continually evaluated, and decommissioned if not producing high-quality educators.
• State law must facilitate digital learning by allowing certification for online instruction and modifying or eliminating mandatory "seat time" laws.
• State law must require pay structures based primarily on effectiveness. Teacher contracts must allow for individual performance-based pay.
• State law and district policy should not mandate higher salaries for master's degrees or additional education credits.
• State law should require staffing decisions (transfers, reductions, placements) be based on teacher effectiveness.
• State laws must prohibit forced placements and allow district control in staffing. Districts should ensure that teacher contracts require mutual consent placements. Districts should have the flexibility to offer defined grace periods, severance, or other options for teachers who have effective ratings, but do not find a mutually agreeable placement. Teachers rated ineffective should be exited from the system.
• State law should not grant, implicitly or directly, tenure or permanent contracts for PK–12 education professionals.

There is evidence (from sources such as IES and AIR) that shows that high-quality approaches to new teacher induction and professional development pay dividends in terms of student outcomes. Why would a "student first" agenda utterly ignore initiatives that work in favor of some that have a paltry or non-existent research base?

To keep it brief, please read some of my most relevant past posts arguing why a focus on teacher support and development makes sense and why it should be at the centerpiece of every education reform agenda.

• Teacher Quality: What You Need To Know
• Adding Value To The Value-Added Debate
• Positive Effects Of Comprehensive Teacher Induction
• State Teacher Policies Suck!
• Race To The Top: Under The Hood
• Research: Attracting New Teachers To Urban Schools
• Thoughts On Equitable Teacher Distribution
• Measurement Is Not Destiny
• Does Mentoring Improve New Teachers?
  

With regard to the StudentsFirst plan, to use a Twitter construct, #edreformfail.

You have read this article Education / induction / mentoring / Michelle Rhee / professional development / reform / StudentFirst / teacher effectiveness / teacher quality with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2011/01/rheeform.html. Thanks!

A New Year

We hope all our readers enjoyed relaxing holidays and have returned refreshed for the new year. While our family and professional lives continue to make it difficult to blog with great frequency, we hope you'll continue to read our infrequent commentary and join in the discussion during 2011.

A few thoughts to start the new year...

(1) Outcomes First? If outcomes are what really matter in education, it is interesting that so many advocates, commentators and policy organizations seem to count adoption of favored policy reforms as ends in themselves. We are all guilty of this to some degree. It is only when there is a research base to suggest that specific reforms and programs work that there is a strong argument to be made. Examples might include targeted class size reduction in grades k-3, high-quality early childhood education, and comprehensive, multi-year induction support for new teachers. But, at a macro level, certain arguments fall apart when there is no evidence to back them up, such as teachers' unions being a wart on the ass of progress. Take Massachusetts, for example, a strong union state. It leads the nation in TIMMS scores in spite of the fact that the Massachusetts Teachers Association looms large in state politics.

(2) Teachers, Teachers: One of the best developments of 2010 was an increased focus on teachers and on teacher effectiveness in particular. This focus was not always for the better, as in the case of the Los Angeles Times' decision to publish value-added scores for individual teachers or the misleading, union-bashing documentary Waiting For Superman. But an overall focus on the outcomes of teaching is the right policy conversation to be having. However, that conversation must lead to solutions that create comprehensive structures and systems to maximize benefits for all involved -- students, teachers, parents, etc. Regular feedback about teaching is critical for educators, not just summative data or annual evaluations that don't provide actionable feedback. A key goal around improving teacher effectiveness should be the development of schools and districts as communities of practice that make teaching more of a collective endeavor and support all educators to strengthen their individual practices and skills.

(3) ESEA: I am increasingly of the mind that something -- but not much of anything -- will happen with regard to reauthorization of the Elementary and Secondary Education Act in 2011. If successful, reauthorization will primarily serve as a token of bipartisanship that both parties can carry into the 2012 elections to say "we can work together to get things done." If accomplished, it may be one of the few significant bipartisan accomplishments of this Congress. Look for substantive tweaks to the No Child Left Behind Act rather than a wholesale overhaul of it. More flexibility around AYP. Attention to the needs of rural districts. More local control. Perhaps a stronger focus on teacher performance pay, charter schools and school choice options -- some elements of the Obama Blueprint combined with priority issues for Republicans like John Kline and Lamar Alexander. And level funding, at best.

(4) Exclusivity: One of my wishes for the New Year is that the DC echo chamber would become less and less influential in conversations about education policy. I am constantly amazed at how regularly the usual suspects parrot, squawk about and retweet the comments and ideas of the other usual suspects, especially those with whom they have personal or proprietary relationships. And how the same usual suspects are quoted saying the same usual things by the mainstream and educational media. This dynamic plays out, too, in conversations within multiple exclusive fiefdoms within education that generally have little to no intersection with fiefdoms with competing worldviews or different policy priorities. As someone who once worked in DC and who now works for a non-DC-based national non-profit organization that has relationships with all sides of the education community, I am especially cognizant of this dynamic in which voices outside of the Beltway 'influentials' are not heard.

One alternative stream recently profiled by Rick Hess and Jay Greene are academics doing policy-relevant research and cutting a high profile in policy conversations. We need more of that type of intellect in play -- and not just from economists. Another is the rise of state-based reform groups like Stand for Children, the PIE Network, Delaware's Rodel Foundation and Oregon's Chalkboard Project. Finally, the voice of actual teachers is too often missing from policy conversations. Fortunately, there are numerous efforts afoot to remedy this. Two, in particular, worth checking out are Teach PLUS and the VIVA Project. My organization, the New Teacher Center, in conjunction with the College Board, recently profiled real-life teachers in a publication about the importance of teacher mentoring.

One way or another, 2011 undoubtedly will be an interesting year for education.

You have read this article College Board / Education / ESEA / Massachusetts / New Teacher Center / teacher / teacher effectiveness with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2011/01/a-new-year.html. Thanks!

Building A Better Teacher

If you haven't been reading the excellent "Building A Better Teacher" news series in the Milwaukee Journal-Sentinel, you should be. It really doesn't matter whether you're from Wisconsin or not, or particularly interested in this state's policy context. The series is taking an expansive look at the various issues related to human capital development, teacher effectiveness and teaching quality. And it's not quoting the same overused Beltway prognosticators to drive its points home.

The fourth installment in the eight-part series, funded by Hechinger, ran this past Sunday and was entitled "Trying to steer strong teachers to weak schools."

My main quibble with this particular article was that it gave short shrift to one of the most effective answers to the question posed: How do we steer strong teachers to weak schools? The answer: Improve the teaching conditions at those schools.

Here's the extent of what the article offered on this issue:

So what else might be done, in hopes of having more impact? A few ideas in nutshells:

• Make schools better places to work: This is both the simplest and most complex solution. The New Teacher Project report in 2007 said, "The best way to staff high need schools is to make them attractive to great teachers." But how do you achieve that?

Mike Langyel, president of the Milwaukee teachers union, listed things that would attract teachers: "A competent and fair principal is key not only in getting teachers there but in keeping them.... We're also looking at schools that are safe."

My suggestion would have been a much more robust treatment and discussion of the issue of teaching conditions. I have extrapolated on its importance in a series of blog posts, and the New Teacher Center (my employer) has unique national expertise in administering statewide Teaching and Learning Conditions surveys. The NTC has a grant from the Bill & Melinda Gates Foundation to administer a Teaching & Learning Conditions Survey as part of the foundation’s Measures of Effective Teaching (MET) project. The Survey is being administered in select schools and districts participating in the MET project across the country.

Perhaps Wisconsin and Milwaukee, in particular, should consider administering such an anonymous full population survey to its educators -- teachers, administrators and support staff -- and see what they have to say. Why do they stay or leave a given school or district? What's working and what isn't? States and districts that have administered such surveys have used the data to improve principal preparation, rewrite professional standards for teachers and principals, and strengthen teacher mentoring and professional development. This is not data to be afraid of but data that can empower policymakers, school leaders and teachers alike.

Teaching and learning conditions are highly correlated with issues such as teacher retention and the presence of such conditions explain as much as 15 percent of the variance in student achievement between schools (Helen 'Sunny' Ladd, 2009). This stuff matters greatly in the current policy debates about teaching and student outcomes and it gets far too little attention as compared with value added, teacher evaluation and teacher pay.

You have read this article Milwaukee Journal Sentinel / teacher / teacher effectiveness / teacher quality / teaching / Wisconsin / working conditions with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2010/12/building-better-teacher.html. Thanks!

Misleading Manifesto

I'm sorry, but the "manifesto" published in today's Washington Post really pisses me off because it is built upon a false premise. It is authored by a number of urban school superintendents, including Chicago's Ron Huberman, New York City's Joel Klein, Washington DC's Michelle Rhee, and New Orleans' Paul Vallas. And it -- intentionally? -- misstates educational research.

"[T]he single most important factor determining whether students succeed in school is not the color of their skin or their ZIP code or even their parents' income -- it is the quality of their teacher."

No. That is patently false.

Now, listen here. I work for a teacher-focused, non-profit organization, the New Teacher Center (NTC). Wouldn't it be powerful to go out and say that teachers matter more than ANYTHING else? But they don't. In terms of school-based variables, they do. But in terms of all variables that impact students, they simply do not. No research says that. In our messaging at the NTC, we are always careful to say that teacher quality is the most important school-based variable for student achievement (examples here and here (on page 4)). That's accurate, honest and powerful in its own right.

So why not make the case for improving teaching in a honest fashion? There is an incredibly strong case to make that improving teaching quality is a critically important and policy amenable part of the solution to increasing student achievement and closing achievement gaps for disadvantaged students. But it's only part of the answer which requires solutions beyond the educational system. Let's not lose sight of that.

At the Shanker Blog, Matthew Di Carlo explored this same issue last month and took journalists to task for making similar claims. Back in July, he summarized existing teacher quality research.

September 16, 2010:

The same body of evidence that shows that teachers are the most important within-school factor influencing test score gains also demonstrates that non-school factors matter a great deal more. [emphasis added] The first wave of high-profile articles in our newly-energized education debate not only seem to be failing to provide this context, but are ignoring it completely. Deliberately or not, they are publishing incorrect information dressed up as empirical fact, spreading it throughout a mass audience new to the topic, to the detriment of us all.

Even though the 10-15 percent explained by teachers still represents a great deal of power (and is among the only factors “within the jurisdiction” of education policy), it is nevertheless important to bear in mind that poor educational outcomes are a result of a complicated web of social and economic forces. [emphasis added] People have to understand that, or they will maintain unrealistic expectations about the extent to which teacher-related policies alone can solve our problems, and how quickly they will work.

July 14, 2010:

But in the big picture, roughly 60 percent of achievement outcomes is explained by student and family background characteristics (most are unobserved, but likely pertain to income/poverty). [emphasis added] Observable and unobservable schooling factors explain roughly 20 percent, most of this (10-15 percent) being teacher effects. The rest of the variation (about 20 percent) is unexplained (error). In other words, though precise estimates vary, the preponderance of evidence shows that achievement differences between students are overwhelmingly attributable to factors outside of schools and classrooms (see Hanushek et al. 1998; Rockoff 2003; Goldhaber et al. 1999; Rowan et al. 2002; Nye et al. 2004).

Let's take Di Carlo's and Joe Friday's advice. Just the facts, please.

You have read this article Education / Joel Klein / Michelle Rhee / New Teacher Center / research / teacher effectiveness with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2010/10/misleading-manifesto.html. Thanks!

LA Times Value Added Editorial

The Los Angeles Times editorial page gets it mostly right today on the value-added issue ("Good teachers, good students," September 3, 2010). It says a number of smart things that I agree with, such as:

• "Test scores are indeed just one indicator of a teacher's performance."
• "But it's revealing, and disturbing, to read the comments of some teachers who don't seem to care whether their students' scores slide. They argue that they're focused on more important things than the tests measure. That's unpersuasive."
• "This page has never believed that test scores should count for all of a teacher's evaluation — or even be the most important factor. But they should be a part of it."
• "Right now, the "value-added" scores The Times has been reporting are more useful for evaluating schools than teachers. Many factors can throw off the data at the classroom level."
• "That's why we think the Obama administration has been too hasty to push states into linking test scores to teacher evaluations and to reward states that overemphasize the scores, making them count for half or more of a teacher's worth. The administration's first priorities should have been developing better tests, which it's working on now — if we're going to judge teachers in part by these scores, it's unacceptable to say that top-notch tests are too expensive — and statistical models that minimize random factors and make the scores a better evaluation tool."
• "Current teacher evaluation practices are ripe for overhaul. Performance reviews should include, at minimum, classroom observations, portfolios of student work over the academic year and, yes, objective test data."

I just wish its news division had taken some of these points to heart, namely having patience until the methodology was ready to be joined by other measures of teacher effectiveness, such as classroom observations, and not publishing the value-added scores of individual teachers and definitively labeling some as most effective and least effective.

Heather Horn of The Atlantic magazine offers a nice summary of some of the related issues and links to relevant sources in this September 1, 2010 blog post.

And Dana Goldstein offers a smart retort (and a preview of her upcoming The Nation feature on value added?) to a vacuous and vitriolic Slate post by Jack Shafer on this topic.

Related Posts:

• Education Optimists: "Adding Value to the Value-Added Debate" (August 31, 2010)

• Education Optimists: "More Grist for the Value-Added Mill" (September 1, 2010)

• Education Optimists: All "value added" related posts

You have read this article Los Angeles / Los Angeles Times / teacher / teacher effectiveness / teaching / value added with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2010/09/la-times-value-added-editorial.html. Thanks!

More Grist for the Value-Added Mill

Here is additional smart and pithy commentary on the current value-added conversation that I wasn't able to incorporate into yesterday's post or have only discovered since.

• Dr. Douglas Harris - "Not By Value Added Alone" (The Blog of Harvard Education Publishing)
• Dr. Aaron Pallas - "Value-added measures: The cardinal rule and the cardinal sin" (A Sociological Eye on Education)
  
• Stephen Sawchuk - "Some Scholars Slam Value-Added for Teacher Accountability" (Teacher Beat/Education Week)
• Jay Mathews - "America's Best Teacher and the L.A. Times" (Class Struggle/Washington Post)
• Dr. Daniel Willingham - "3 Key Factors in Teacher Evaluation" (The Answer Sheet/Washington Post)
• Sherman Dorn - "Please leave your magic numbers on the magic carpet with your magic wand" (Sherman Dorn)
• Bill Tucker - "My Value-Added Number" (Quick and the Ed)
• John Thompson - "High-Ranking Teachers Ignore Pacing Standards" (This Week In Education)
• Walt Gardner - "Why Not Name and Shame Teachers?" (Walt Gardner's Reality Check/Education Week)
• Claus von Zastrow - "The LA Times Goes Astray" (Public School Insights/Learning First Alliance)
• Alan Borsuk - "Where newspaper goes in rating teachers, others soon will follow" (Milwaukee Journal Sentinel)
• Andy Rotherham - "LA Story" (Eduwonk)

You have read this article Los Angeles / Los Angeles Times / teacher / teacher effectiveness / teaching / value added with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2010/09/more-grist-for-value-added-mill.html. Thanks!

Adding Value to the Value-Added Debate

Seeing as I am not paid to blog as part of my daily job, it's basically impossible for me to be even close to first out of the box on the issues of the day. Add to that being a parent of two small children (my most important job – right up there with being a husband) and that only adds to my sometimes frustration of not being able to weigh in on some of these issues quickly.

That said, here is my attempt to distill some key points and share my opinions -- add value, if you will -- to the debate that is raging as a result of the Los Angeles Times's decision to publish the value-added scores of individual teachers in the L.A. Unified School District.

First of all, let me address the issue at hand. I believe that the LA Times's decision to publish the value-added scores was irresponsible. Given what we know about the unreliability and variability in such scores and the likelihood that consumers of said scores will use them at face value without fully understanding all of the caveats, this was a dish that should have been sent back to the kitchen.

Although the LA Times is not a government or public entity, it does operate in the public sphere. And it has a responsibility as such an actor. Its decision to label LA teachers as 'effective' and 'ineffective' based on suspect value-added data alone is akin to an auditor secretly investigating a firm or agency without an engagement letter and publishing findings that may or may not hold water.

Frankly, I don't care what positive benefits this decision by the LA Times might have engendered. Yes, the district and the teachers union have agreed to begin negotiations on a new evaluation system. Top district officials have said they want at least 30% of a teacher's review to be based on value-added and have wisely said that the majority of the evaluations should depend on classroom observations. Such a development exonerates the LA Times, as some have argued. In my mind, any such benefits are purloined and come at the expense of sticking it -- rightly in some cases, certainly wrongly in others -- to individual teachers who mostly are trying their best.

Oh, I know, I know. It's not about the teachers anymore. Their day has come and gone. "It's about the kids" now, right? But you know what? The decisions we make about how we license, compensate, evaluate and dismiss teachers affects them as individual people, as husbands and wives, as mothers and fathers. It effects who may or may not choose to enter the profession in the coming years. If we mistakenly catch a bunch of teachers in a wrong-headed, value-added dragnet based upon a missionary zeal and 'head in the sand' conviction that numbers don't lie, we will be doing a disservice both to teachers and to the kids. And, if we start slicing and dicing teachers left and right, who exactly will replace them?

(1) Value-added test scores should not be used as the primary means of informing high-stakes decisions, such as tenure and dismissal.
One primary piece of evidence was released just this week from the well-respected, nonpartisan Economic Policy Institute. The EPI report, co-authored by numerous academic experts, said:

• Student test scores are not reliable indicators of teacher effectiveness, even with the addition of value-added modeling (VAM).
  
• Though VAM methods have allowed for more sophisticated comparisons of teachers than were possible in the past, they are still inaccurate, so test scores should not dominate the information used by school officials in making high-stakes decisions about the evaluation, discipline and compensation of teachers.
  
• Neither parents nor anyone else should believe that the Los Angeles Times analysis actually identifies which teachers are effective or ineffective in teaching children because the methods are incapable of doing so fairly and accurately.
• Analyses of VAM results show that they are often unstable across time, classes and tests; thus, test scores, even with the addition of VAM, are not accurate indicators of teacher effectiveness. Student test scores, even with VAM, cannot fully account for the wide range of factors that influence student learning, particularly the backgrounds of students, school supports and the effects of summer learning loss. As a result, teachers who teach students with the greatest educational needs appear to be less effective than they are.

Other experts, such as Mathematica Policy Research, Rick Hess, and Dan Goldhaber have offered important cautions as well.

The findings of the IES-funded Mathematica report were “largely driven by findings from the literature and new analyses that more than 90 percent of the variation in student gain scores is due to the variation in student-level factors that are not under the control of the teacher. Thus, multiple years of performance data are required to reliably detect a teacher’s true long-run performance signal from the student-level noise…. Type I and II error rates [‘false positives’ and ‘false negatives’] for teacher-level analyses will be about 26 percent if three years of data are used for estimation. In a typical performance measurement system, more than 1 in 4 teachers who are truly average in performance will be erroneously identified for special treatment, and more than 1 in 4 teachers who differ from average performance by 3 months of student learning in math or 4 more in reading will be overlooked. In addition, Type I and II error rates will likely decrease by only about one half (from 26 to 12 percent) using 10 years of data.”

Hess has “three serious problems with what the LAT did. First … I'm increasingly nervous at how casually reading and math value-added calculations are being treated as de facto determinants of "good" teaching…. Second, beyond these kinds of technical considerations, there are structural problems. For instance, in those cases where students receive substantial pull-out instruction or work with a designated reading instructor, LAT-style value-added calculations are going to conflate the impact of the teacher and this other instruction…. Third, there's a profound failure to recognize the difference between responsible management and public transparency.”

Goldhaber, in a Seattle Times op-ed, says that he “support[s] the idea of using value-added methods as one means of judging teacher performance, but strongly oppose[s] making the performance estimates of individual teachers public in this way. First, there are reasons to be concerned that individual value-added estimates may be misleading indicators of true teacher performance. Second, performance estimates that look different from one another on paper may not truly be distinct in a statistically significant sense. Finally, and perhaps most important, I cannot think of a profession in either the public or private sector where individual employee performance estimates are made public in a newspaper.”

Multiple measures to inform teacher evaluation seems like the right approach, including the use of multiple years of value-added student data (one thing the LA Times DID get right). That said, the available research would seem to suggest that states (particularly in Race to the Top) that have proposed basing 50% or more of an individual educators evaluation on a value-added score may have gone too far down the path. LA Unified officials have said (LA Times, 8/30/2010) they want at least 30% of a teacher's review to be based on value-added and that the majority of the evaluations should depend on observations. That might be a more appropriate stance.

(2) Embracing the status quo is unacceptable.
As reports such at The New Teacher Project's Widget Effect have chronicled, current approaches to teacher evaluation are broken. They don’t work for anyone involved. Critics of VAM cannot simply draw a line in the sand and state that, "This will not stand!" If not this, then what? Certainly not the current system! Fortunately, efforts led by organizations such as the American Federation of Teachers and the Hope Street Group are developing or have offered thoughtful solutions to this issue. [Disclosure: I participated in Hope Street's effort and my New Teacher Center colleague Eric Hirsch serve on AFT’s evaluation committee.] Sadly, LA Unified and the LA Teachers Union both are culpable –along with the LA Times – in bringing this upon the city's teachers by refusing to act to analyze or utilize available value-added data. An adherence to the status quo created a void that the LA Times sought to fill in order to sell more newspapers in a wrong-headed attempt to inform the public.

(3) The ‘lesser of two evils’ axiom should not be invoked.
Even if you agree that all the factors we currently use to select and sort teachers is worse than a value added only alternative, as argued by Education Sector's Chad Aldeman, our current arsenal does not meaningfully inform high-stakes decisions (apart from entry tests with largely low passing scores and the aforementioned impossible-to-fail evaluations). That's, of course, both a condemnation of the current system's inability and/or unwillingness to differentiate between teachers, but it's also a recognition that we haven't struck the right balance or developed the value-added systems to inform high-stakes decisions in this regard in all but a few promising places.

(4) Don't lose sight of the utility of value-added data to inform formative assessment of teaching practice.
If one of the takeaways from research is that value-added data shouldn't be used to drive high-stakes decisions, it is helpful to think about the use of this data to inform teacher development. Analysis of student work, including relevant test scores, is an important professional development opportunity that all teachers, especially new ones, should have regular opportunities to engage in. Systems such as the NTC’s Formative Assessment System provide such a tool in states and districts with whom it works on teacher induction. Sadly, this is not the norm in American schools, but is built into high-quality professional development approaches, as Sara Mead wisely discusses in her recent Ed Week blog post. As I noted under #2, LA Unified missed an opportunity to embrace such data to inform its educators in such a way. In the LA Times value added series, several teachers bemoaned the fact that they had never had the opportunity to see such data until it was published in the newspaper.

(5) Valid and reliable classroom observation conducted by trained evaluators is critical.
Other elements of an evaluation system are even more important than value-added methodology if for no other reason that the majority of teachers do not teach tested subjects. Unless we, God forbid, develop multiple-choice assessments of more and more subjects and grade levels, we're going to need valid and reliable ways of assessing the practice of educators who cannot be assessed by value-added student achievement scores. Despite some of the criticisms lobbed at the District of Columbia's new IMPACT evaluation system, this is an element at the heart of DC’s approach to teacher evaluation. Further, the Gates Foundation’s on-going teacher effectiveness study holds great promise.

(6) We've got to get beyond this focus on the 'best' and 'worst' teachers.
How about we focus on strengthening the effectiveness of the 80-90% of teachers in the middle? We know how to do that through comprehensive new teacher induction and high-quality professional development, but we're just lacking the collective will to pull it off and invest in what makes a difference. These are similar roadblocks to what has prevented the use of student outcomes from being considered in teacher evaluations. It raises discomfort, requires a change in prevailing (often mediocre) practices, demands greater accountability, and necessitates viewing teaching not as a private activity but as a collective endeavor. But I keep making this point over and over again about the importance of a teacher development focus within the teacher effectiveness conversation because I see too few reform advocates taking it seriously. Take off the blinders, folks. It is not primarily about firing teachers.

(7) Teacher effectiveness is contextual.
Teaching and learning conditions impact an individual educator’s ability to succeed. It is entirely possible that an individual teacher's value-added score is significantly determined by the teaching and learning conditions (supportive leadership, opportunities to collaborate, classroom resources) present at their school site than about their individual knowledge, skills and practices. In Seinfeldian terms, teachers are not 'masters of their domain' necessarily. The EPI report makes this point. So do my New Teacher Center colleagues through statewide teaching and learning conditions surveys. So does Duke University economist Helen Ladd (also a co-signed on the EPI report) and the University of Toronto’s Kenneth Leithwood.

You have read this article Los Angeles / Los Angeles Times / teacher effectiveness / teacher evaluation / value added with the title teacher effectiveness. You can bookmark this page URL http://apt3e.blogspot.com/2010/08/adding-value-to-value-added-debate.html. Thanks!