A New Year

We hope all our readers enjoyed relaxing holidays and have returned refreshed for the new year. While our family and professional lives continue to make it difficult to blog with great frequency, we hope you'll continue to read our infrequent commentary and join in the discussion during 2011.

A few thoughts to start the new year...

(1) Outcomes First? If outcomes are what really matter in education, it is interesting that so many advocates, commentators and policy organizations seem to count adoption of favored policy reforms as ends in themselves. We are all guilty of this to some degree. It is only when there is a research base to suggest that specific reforms and programs work that there is a strong argument to be made. Examples might include targeted class size reduction in grades k-3, high-quality early childhood education, and comprehensive, multi-year induction support for new teachers. But, at a macro level, certain arguments fall apart when there is no evidence to back them up, such as teachers' unions being a wart on the ass of progress. Take Massachusetts, for example, a strong union state. It leads the nation in TIMMS scores in spite of the fact that the Massachusetts Teachers Association looms large in state politics.

(2) Teachers, Teachers: One of the best developments of 2010 was an increased focus on teachers and on teacher effectiveness in particular. This focus was not always for the better, as in the case of the Los Angeles Times' decision to publish value-added scores for individual teachers or the misleading, union-bashing documentary Waiting For Superman. But an overall focus on the outcomes of teaching is the right policy conversation to be having. However, that conversation must lead to solutions that create comprehensive structures and systems to maximize benefits for all involved -- students, teachers, parents, etc. Regular feedback about teaching is critical for educators, not just summative data or annual evaluations that don't provide actionable feedback. A key goal around improving teacher effectiveness should be the development of schools and districts as communities of practice that make teaching more of a collective endeavor and support all educators to strengthen their individual practices and skills.

(3) ESEA: I am increasingly of the mind that something -- but not much of anything -- will happen with regard to reauthorization of the Elementary and Secondary Education Act in 2011. If successful, reauthorization will primarily serve as a token of bipartisanship that both parties can carry into the 2012 elections to say "we can work together to get things done." If accomplished, it may be one of the few significant bipartisan accomplishments of this Congress. Look for substantive tweaks to the No Child Left Behind Act rather than a wholesale overhaul of it. More flexibility around AYP. Attention to the needs of rural districts. More local control. Perhaps a stronger focus on teacher performance pay, charter schools and school choice options -- some elements of the Obama Blueprint combined with priority issues for Republicans like John Kline and Lamar Alexander. And level funding, at best.

(4) Exclusivity: One of my wishes for the New Year is that the DC echo chamber would become less and less influential in conversations about education policy. I am constantly amazed at how regularly the usual suspects parrot, squawk about and retweet the comments and ideas of the other usual suspects, especially those with whom they have personal or proprietary relationships. And how the same usual suspects are quoted saying the same usual things by the mainstream and educational media. This dynamic plays out, too, in conversations within multiple exclusive fiefdoms within education that generally have little to no intersection with fiefdoms with competing worldviews or different policy priorities. As someone who once worked in DC and who now works for a non-DC-based national non-profit organization that has relationships with all sides of the education community, I am especially cognizant of this dynamic in which voices outside of the Beltway 'influentials' are not heard.

One alternative stream recently profiled by Rick Hess and Jay Greene are academics doing policy-relevant research and cutting a high profile in policy conversations. We need more of that type of intellect in play -- and not just from economists. Another is the rise of state-based reform groups like Stand for Children, the PIE Network, Delaware's Rodel Foundation and Oregon's Chalkboard Project. Finally, the voice of actual teachers is too often missing from policy conversations. Fortunately, there are numerous efforts afoot to remedy this. Two, in particular, worth checking out are Teach PLUS and the VIVA Project. My organization, the New Teacher Center, in conjunction with the College Board, recently profiled real-life teachers in a publication about the importance of teacher mentoring.

One way or another, 2011 undoubtedly will be an interesting year for education.

You have read this article College Board / Education / ESEA / Massachusetts / New Teacher Center / teacher / teacher effectiveness with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2011/01/a-new-year.html. Thanks!

Misleading Manifesto

I'm sorry, but the "manifesto" published in today's Washington Post really pisses me off because it is built upon a false premise. It is authored by a number of urban school superintendents, including Chicago's Ron Huberman, New York City's Joel Klein, Washington DC's Michelle Rhee, and New Orleans' Paul Vallas. And it -- intentionally? -- misstates educational research.

"[T]he single most important factor determining whether students succeed in school is not the color of their skin or their ZIP code or even their parents' income -- it is the quality of their teacher."

No. That is patently false.

Now, listen here. I work for a teacher-focused, non-profit organization, the New Teacher Center (NTC). Wouldn't it be powerful to go out and say that teachers matter more than ANYTHING else? But they don't. In terms of school-based variables, they do. But in terms of all variables that impact students, they simply do not. No research says that. In our messaging at the NTC, we are always careful to say that teacher quality is the most important school-based variable for student achievement (examples here and here (on page 4)). That's accurate, honest and powerful in its own right.

So why not make the case for improving teaching in a honest fashion? There is an incredibly strong case to make that improving teaching quality is a critically important and policy amenable part of the solution to increasing student achievement and closing achievement gaps for disadvantaged students. But it's only part of the answer which requires solutions beyond the educational system. Let's not lose sight of that.

At the Shanker Blog, Matthew Di Carlo explored this same issue last month and took journalists to task for making similar claims. Back in July, he summarized existing teacher quality research.

September 16, 2010:

The same body of evidence that shows that teachers are the most important within-school factor influencing test score gains also demonstrates that non-school factors matter a great deal more. [emphasis added] The first wave of high-profile articles in our newly-energized education debate not only seem to be failing to provide this context, but are ignoring it completely. Deliberately or not, they are publishing incorrect information dressed up as empirical fact, spreading it throughout a mass audience new to the topic, to the detriment of us all.

Even though the 10-15 percent explained by teachers still represents a great deal of power (and is among the only factors “within the jurisdiction” of education policy), it is nevertheless important to bear in mind that poor educational outcomes are a result of a complicated web of social and economic forces. [emphasis added] People have to understand that, or they will maintain unrealistic expectations about the extent to which teacher-related policies alone can solve our problems, and how quickly they will work.

July 14, 2010:

But in the big picture, roughly 60 percent of achievement outcomes is explained by student and family background characteristics (most are unobserved, but likely pertain to income/poverty). [emphasis added] Observable and unobservable schooling factors explain roughly 20 percent, most of this (10-15 percent) being teacher effects. The rest of the variation (about 20 percent) is unexplained (error). In other words, though precise estimates vary, the preponderance of evidence shows that achievement differences between students are overwhelmingly attributable to factors outside of schools and classrooms (see Hanushek et al. 1998; Rockoff 2003; Goldhaber et al. 1999; Rowan et al. 2002; Nye et al. 2004).

Let's take Di Carlo's and Joe Friday's advice. Just the facts, please.

You have read this article Education / Joel Klein / Michelle Rhee / New Teacher Center / research / teacher effectiveness with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2010/10/misleading-manifesto.html. Thanks!

Positive Effects of Comprehensive Teacher Induction

Today, Mathematica Policy Research, Inc. released the final report of its IES/U.S Department of Education-funded randomized controlled trial (RCT) of comprehensive teacher induction. It shows a statistically significant and sizeable impact on student achievement in mathematics (0.20 standard deviations) and reading (0.11 standard deviations) of third-year teachers who received two years of robust induction support. That's the equivalent of moving students from the 50th to 54th percentile in reading achievement and from the 50th to 58th percentile in math achievement.

As a basis of comparison, I note that in 2004, Mathematica conducted a RCT of Teach for America (TFA). In that study, it compared the gains in reading and math achievement made by students randomly assigned to TFA teachers or other teachers in the same school. The results showed that, on average, students with TFA teachers raised their mathematics test scores by 0.15 standard deviations (versus 0.20 standard deviations in the induction study), but found no impact on reading test scores (versus 0.11 standard deviations in the induction study).

In another recent Mathematica report (boy, these folks are busy!), the authors note that "The achievement effects of class-size reduction are often used as a benchmark for other educational interventions. After three years of treatment (grades K-2) in classes one-third smaller than typical, average student gains amounted to 0.20 standard deviations in math and 0.23 standard deviations in reading (U.S. Department of Education, 1998)." In that report -- an evaluation of the Knowledge Is Power Program (KIPP), Mathematica researchers found a very powerful impact from KIPP: "For the vast majority of KIPP schools studied, impacts on students’ state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial.... By year three, half of the KIPP schools in our sample are producing math impacts of 0.48 standard deviations or more, equivalent to the effect of moving a student from the 30th percentile to the 48th percentile on a typical test distribution..... Half of the KIPP schools in our sample show three-year reading effects of 0.28 standard deviations or more."

Is it appropriate to compare effect sizes among RCTs or, for that matter, among research in general? I am told that it is, although certainly considerations such as cost effectiveness and scalability have to enter into the conversation. Implementation issues also must be attended to. With regard to teacher induction, the issue of cost effectiveness was addressed in a 2007 cost-benefit study published in the Education Research Service's Spectrum journal and summarized in this New Teacher Center (NTC) policy brief.

Disclosure: I am employed by the NTC which participated in the induction RCT, and I helped to coordinate NTC's statement on the study.

The NTC is "encouraged" by the study. However, NTC believes that "it does not reflect the even more significant outcomes that can be achieved when districts have the time, capacity and willingness to focus on an in-depth, universal implementation of comprehensive, high-quality induction. It speaks volumes about the quality of induction and mentoring provided and the necessity of new teacher support that student achievement gains were documented despite [design and implementation] limitations to the study."

UPDATE: Read the Education Week story by Stephen Sawchuk here. And the Mathematica press release here.

You have read this article induction / Institute for Education Sciences / KIPP / mentoring / New Teacher Center / research / Teach for America / teacher effectiveness / TFA with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2010/06/positive-effects-of-comprehensive.html. Thanks!

ESEA Hearing on Teachers and Leaders

The U.S. Senate Committee on Health, Education, Labor and Pensions is holding a hearing this morning on the reauthorization of the Elementary and Secondary Education Act (ESEA), currently known as No Child Left Behind. Today's hearing focuses on the teacher and school leader elements of ESEA.

Among the witnesses are:

• Randi Weingarten, President, American Federation of Teachers
• Stephanie Hirsch, Executive Director, National Staff Development Council
  
• Jon Schnur, CEO, New Leaders for New Schools
  
• Ellen Moir, CEO, New Teacher Center
  
• Timothy Daly, President, The New Teacher Project
• Thomas Kane, Professor of Education and Economics, Harvard University and Deputy Director, U.S. Education, Bill & Melinda Gates Foundation
  

UPDATES:
A video replay of the hearing -- as well as links to the participants' testimony -- is available here.

You have read this article ESEA / federal / NCLB / New Teacher Center / teacher / teacher effectiveness / U.S. Senate with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2010/04/esea-hearing-on-teachers-and-leaders.html. Thanks!

Teaching and Learning Conditions

I'm catching up on education news and blogging after some well-spent time with our family in New York and Vermont last week....

Both successful Phase One Race to the Top (RttT) states -- Delaware and Tennessee -- plan to conduct a statewide teacher working conditions survey. Was this the secret to each state's victory? Well, not exactly, as the states of Colorado, Kentucky, Massachusetts, North Carolina and Ohio also built such a survey into their applications. Of course, each of those states were among the 16 Phase One semifinalists. So, maybe there is something there.

Independent of RttT, however, such efforts are in line with President Obama’s recent Blueprint for Reform: The Reauthorization of the Elementary and Secondary Education Act, which would require states and districts to collect and report teacher survey data on available professional support and working conditions in schools biennially.

Research has demonstrated a connection between positive teaching and learning conditions, teacher retention, and student achievement.

• “There is good evidence to show that teachers’ working conditions matter because they have a direct effect on teachers’ thoughts and feelings—their sense of individual professional efficacy, of collective professional efficacy, of job satisfaction; their organizational commitment, levels of stress and burnout, morale, engagement in the school or profession and their pedagogical content knowledge. These internal states are an important factor in what teachers do and have a direct effect in what happens in the classroom, how well students achieve, and their experience of school.” (Leithwood, 2006)
  
• “Working conditions emerge as highly predictive of teachers’ stated intentions to remain or leave their schools, with leadership emerging as the most salient dimension. Teachers’ perceptions of their working conditions are also predictive of one-year actual departure rates and student achievement, but the predictive power is far lower…Taken together, the working conditions variables account for 10 to 15 percent of the explained variation in math and reading scores across schools, after controlling for individual and school level characteristics of schools.” (Ladd, 2009)
• “[O]ur analysis of teacher mobility showed that salary affects mobility patterns less than do working conditions such as facilities, safety and quality of leadership.” (Hanushek and Rivkin, 2007)
• “…working conditions factors, especially principal support, had more influence on simulated job choice than pay level, implying that money might be better spent to attract, retain or train better principals than to provide higher beginning salaries to teachers in schools with high-poverty or a high proportion of students of color.” (Milanowski et al., 2009)
• A survey of 2,000 educators from California found that 28 percent of teachers who left the profession before retirement indicated that they would come back if improvements were made to teaching and learning conditions. (Futernick, 2007)

Last week's press release from the New Teacher Center goes into greater detail:

“Research has shown that understanding and improving teaching and learning conditions results in increased student success, improved teacher efficacy and motivation, higher teacher retention, and better recruitment strategies that bring educators to hard-to-staff schools,” said Ellen Moir, Chief Executive Officer of the New Teacher Center. “In the past, policymakers have not had the data necessary they need to address educators’ working conditions. Our surveys change this by putting valuable information in the hands of people who make important decisions every day that impact our schools and all those who work and learn in them.”

The New Teacher Center (NTC) assists states and school districts in administering the anonymous, web-based Teaching and Learning Conditions Survey. The NTC has a proven track record of successful administration of teaching and learning conditions surveys in 15 states. In addition to working with state stakeholders to design a customized survey, NTC provides analyses and training materials to help all stakeholders understand and use the Teaching and Learning Conditions Survey results for school improvement.

The Teaching & Learning Conditions Survey has the longest history in North Carolina where policymakers at different levels have utilized Survey data in different ways. Local education leaders have used results at the district level to further bond initiatives. At the state level, data was used in rewriting standards for principals and teachers. The Survey initiative has been so expansive that it has supported the creation of additional funding for professional development in low-performing schools. Results also have led to the development of school leadership training which requires administrators to use Survey data in making school-level improvement decisions.

The news article ('Teacher Surveys Aimed at Swaying Policymakers') from Education Week's Stephen Sawchuk provides additional context:

Despite their differing sample sizes and specific questions, the surveys’ findings about what teachers say they need to be successful are remarkably consistent from instrument to instrument. Some of the top findings: Teachers report that the quality of their schools’ leadership, a say in school decisionmaking, and opportunities to work with their peers affect their own capacity as educators.

You have read this article ARRA / Delaware / ESEA / New Teacher Center / North Carolina / Race To The Top / RttT / teacher effectiveness / teacher quality / Tennessee / working conditions with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2010/04/teaching-and-learning-conditions.html. Thanks!

Live from San Jose

Tomorrow I'll be Twittering from the New Teacher Center's 12th National Symposium in San Jose, California.

Tuesday's agenda features a morning keynote panel on measuring teacher effectiveness. Panelists include Terry Holliday, Kentucky Commissioner of Education; Brad Jupp, Senior Program Advisor, Teacher Effectiveness and Quality, U.S. Department of Education; and Tom Kane, Professor of Education & Economics, Harvard University and Deputy Director for Education, Gates Foundation. It is moderated by my intrepid NTC colleague, Eric Hirsch.

Today, keynoters include Linda Darling-Hammond and Richard Rothstein, but my schedule likely won't allow me to have my thumbs affixed to my phone or laptop during their presentations.

To follow me, here is the link to my Twitter account.

You have read this article New Teacher Center / teacher effectiveness with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2010/02/live-from-san-jose.html. Thanks!

Race To The Top: Under The Hood

My colleagues and I at the New Teacher Center submitted revised language during the public comment period to strengthen proposed Race to the Top (RttT) regulations. (8/28/2009: "RttT: Redefining Teacher Effectiveness".) I am delighted that most of our suggestions were adopted. Specifically, three changes I am pleased to see in the final RttT regulations and state application released by the U.S. Department of Education today are:

(1) A focus on multiple measures in teacher evaluation.

We have defined effective teacher to mean “a teacher whose students achieve acceptable rates (e.g., at least one grade level in an academic year) of student growth (as defined in this notice). States, LEAs, or schools must include multiple measures, provided that teacher effectiveness is evaluated, in significant part, by student growth (as defined in this notice). Supplemental measures may include, for example, multiple observation-based assessments of teacher performance.”

We have revised criterion (D)(2)(ii) to read, “Design and implement rigorous, transparent, and fair evaluation systems for teachers and principals that (a) differentiate effectiveness using multiple rating categories that take into account data on student growth (as defined in this notice) as a significant factor, and (b) are designed and developed with teacher and principal involvement.”

(2) A stronger focus on school leaders and the inclusion of positive teaching and learning conditions in the definition of effective principal.

We have changed the definition of effective principal as follows: (a) replaced “States may supplement this definition as they see fit” with “States, LEAs, or schools must include multiple measures;” (b) added ”Supplemental measures may include, for example, high school graduation rates and college enrollment rates, as well as evidence of providing supportive teaching and learning conditions, strong instructional leadership, and positive family and community engagement;” and (c) replaced “so long as principal effectiveness is judged, in significant measure by student growth” with “provided that principal effectiveness is evaluated, in significant part, by student growth.”

(3) Greater attention to the need for high-quality teacher induction, mentoring and professional development.

We agree that induction programs and coaching by accomplished teachers and principals can be important and effective strategies for supporting novice teachers and principals upon their entering the profession. We are revising the criterion to clarify that States’ plans in response to this criterion should provide for coaching and induction programs as supports for teachers and principals. Changes: We have revised criterion (D)(5)(i) to clarify that plans should include providing effective, data-informed “coaching” and “induction.”

We agree that professional development, including mentoring and coaching, are important aspects of teacher effectiveness. For this reason, criterion (D)(2)(iv)(a) focuses on using evaluations to inform decisions regarding developing effective teachers and principals, including by providing relevant coaching, induction support, and/or professional development. Criterion (D)(5) also provides for evaluation of the extent to which a State has a high-quality plan for its participating LEAs to provide effective, data-informed professional development, coaching, induction, and common planning and collaboration time to teachers and principals.

Sources of great analysis on the final RttT regulations here:

• Education Week (Michele McNeil): "Rules Set for $4 Billion 'Race to Top' Contest"
• New York Times (Sam Dillon): "After Criticism, The Administration Is Praised for Final Rules on Education Grants"
  
• Teacher Beat: "Teacher Elements of Final Race to the Top Guidelines"
  
• Eduflack: "Just The Race Facts"
• Eduflack: "The Race Officially Begins ... Now"
• Eduwonk: "Racing To The Top"

You have read this article ARRA / leadership / New Teacher Center / principal / Race To The Top / RttT / teacher evaluation / U.S. Department of Education / working conditions with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2009/11/race-to-top-under-hood.html. Thanks!

Teachers' Voice

An important survey was released this week that captures teachers' perceptions of their professional working environment. The national study of 900 teachers by Public Agenda describes educators as falling into one of three groups: "Disheartened," "Contented," and "Idealists." It also raises some serious policy implications for the placement, retention and longevity of teachers based on teachers' perceptions about working conditions, why they entered the profession, and their opinions about proposed policy reforms.

But as useful as this survey may be in defining these issues at a 30,000-foot level, it does not approach the power and utility of teacher surveys that offer entire populations of educators in individual states and districts the opportunity to share their voice about working conditions, leadership support, resources, opportunities for professional learning, etc. In turn, these anonymous surveys also provide contextualized, customized summary data at the state-, district- and school-level based on the perceptions and opinions of local educators.

Teaching and Learning Conditions surveys have been led by the New Teacher Center in states such as Alabama, Kansas, Maryland, Massachusetts, North Carolina and West Virginia, and in school districts such as Fairfax County, Virginia. They provide state and district policymakers and educational leaders with powerful data to define issues that need to be addressed in school and districts that have major implications for the quality and effectiveness of teachers and principals.

Read the Public Agenda report, but also think about conducting a Teaching and Learning Conditions survey in your state or school district. What do the teachers where you live and work think?

You have read this article Alabama / Kansas / Maryland / Massachusetts / New Teacher Center / North Carolina / Public Agenda / teacher / teaching / West Virginia / working conditions with the title New Teacher Center. You can bookmark this page URL https://apt3e.blogspot.com/2009/10/teachers-voice.html. Thanks!