This blog provides information on public education in children, teaching, home schooling

Showing posts with label accountability. Show all posts
Showing posts with label accountability. Show all posts
Saturday, January 7, 2012

Remaking Academia: Improve the Hiring Process

The latest entry in a continuing series here at The Education Optimists


Have you ever sought a job as a professor? Depending on your field and where you’ve applied, it goes something like this:

(1) You send in a letter of interest, a CV, and some publications. Maybe some letters of reference too, or perhaps just contact information for those people. If it’s a teaching institution or a school of education, maybe you’ll also send in a statement of teaching philosophy and some student evaluations.

(2) If the search committee likes what they see in the file, they get in touch. This typically means you’ve published a fair bit, demonstrated that you have some interesting ideas, come from a good graduate program, have very solid letters that say you’re among the very best, can attract grant funding, etc.

(3) Then you either meet with the committee via phone or Skype, or at a conference, or more commonly go to campus. (Sometimes it’s a two-step or three-step sequence, sometimes you just go right to campus.) During the visits, you’ll do a talk about your research (to show how you approach questions, theory and evidence), talk with lots of academics who will ask you about your future research plans and what you like to read and discuss (mainly to see if they think you’re smart and they like you), meet with an administrator or two, talk to students, and maybe give a demonstration of your teaching (e.g. a pedagogical talk).

(4) At the end of the evaluation period, a search committee, or even the entire department, together with the dean, has a set of information about you. It includes a written record of what you’ve done, thoughts about what they’ve heard, some student evaluations on a set of metrics, etc. Then they make their decisions.

Often this results in the offer of a job at a pretty good salary with decent benefits, with a three-year contract, and the possibility of tenure. Or, if you’re lucky, it’s a tenured position—in which case they’ve committed (after a tenure committee does their own review) to hire you “for life.”

This process has long puzzled me for what it omits. And as I listen to heated discussions of ineffective professors and teachers, and watch the advent of a strong debate from k -20 over using metrics to decide who to fire, I have to wonder: why can’t we start instead by using data and standard human resources practices to improve our effectiveness at hiring?

Before I list some suggestions for improvement, let me admit that I have held one academic job for my entire career (which admittedly is just 8 years long). And this area—hiring and evaluation—isn’t the topic of my own research. So I don’t know about every practice used in every college or school, and it’s quite possible some of what I think should be done IS being done—in which case we should get a good census of practices and start evaluating their effectiveness. This is a blog I really hope to get constructive feedback on (yes, more so than usual).

(1) Rethink who does the hiring. Right now prospective colleagues primarily do it. This is good, since they are whom you’ll end up working with and spending time with. They should and must have a role. But those peers were hired because they are talented researchers and teachers, not because they know how to evaluate large numbers of prospective applicants and make terrific judgment calls. Professionalization of this hiring practice is needed, and it must include very experienced people who’ve done hiring in academia for decades. Ideally, they’d be systematically trained in identifying expertise in the competencies academics need to do their jobs very well (see next point).

(2) Bring some additional competencies into the mix. Being a good professor or teacher requires strong time management skills, grit, resilience, ability to respond under pressure, communication skills, drive, ability to implement feedback, performance orientation, inquisitiveness, and cultural competencies as well. Where/how are these being assessed now? Primarily in terms of how much you’ve managed to publish in X time (which doesn’t necessarily tell you how well time was managed since other activities are often sacrificed). There are instruments for measuring such things, and we’re often ignoring them. That’s not good enough. What other competencies predict success in academia? We need to know, and we need to integrate them into hiring.

(3) Lengthen the process. My colleagues will hate me for saying this, but spending only a total of maybe 2-5 days evaluating whether a person should be allowed to teach large numbers of students, enjoy limited campus resources, etc, is far too quick. You need more data and more time to analyze it.

(4) Systematize the evaluation process. We use very superficial forms and often don’t consider the data that result in any sophisticated way. The process of reference and background checks is too personal, political, and idiosyncratic, mainly because people who were never trained to do these checks are in charge!

There’s got to be even more we can do. Sure it has to be a flexible process that can be adapted to public flagships or private liberal arts colleges, as well as community colleges, etc. It also can’t be so expensive as to prevent scaling. And it will need revision and improvement. When’s the last time your department changed how it recruited and evaluated applicants?

The current process skips key steps and fails to assess competencies that when not present, lead to failure and turnover in academia (and k12 teaching). Instead of researching who we should fire, why not focus our attention on improving the hiring process? It seems far more efficient, not to mention equitable and ethical.
You have read this article accountability / evaluation / hiring / professors / value-added with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2012/01/remaking-academia-improve-hiring-process.html. Thanks!
Thursday, October 13, 2011

ESEA Come, ESEA Go

The chatter among the education cognescenti this week is about what is and what isn't in the bipartisan ESEA draft released by Senate education chair Tom Harkin (D-IA) and ranking member Mike Enzi (R-WY).

Let me repeat my prior contention that, politically, ESEA reauthorization is an issue for 2013 -- not 2011 or 2012. The Republican-led U.S. House is not going to give President Obama any kind of a political victory, despite the solid compromise put forth by the Senate HELP Committee. For that reason, the work currently underway is in part about laying the groundwork for a future compromise, in part a genuine attempt to get something done (despite the House), and in part political cover.

The bill itself represents a sensible step back from a pie-in-the-sky accountability goal of 100% proficiency in favor of annual state data transparency, continued data disaggregation among subgroups, and greater state flexibility over educational accountability. Personally, I am not an accountability hawk and am unswayed by spotty evidence and advocates such as former Florida Governor Jeb Bush who contends that it was Florida's accountability system (rather than its major investment in literacy and other interventions) that fueled student test-score gains. Chairman Harkin nails it by saying that the bill "focuses on teaching and learning, not testing and sanctioning." Amen to that.

Seeing as I have a day job that doesn't allow me to analyze the entirety of 800-page bills, here is my quick take on a few elements in the draft bill:

Positives
  • Accountability: Eliminates AYP. Requires states to identify 5% lowest-performing schools and 5% of schools with the largest achievement gaps.
  • CSR: Tightens up the use of Title II, Part A for class-size reduction to ensure that those dollars are directed at research-based implementation of smaller class sizes. [UPDATE: This could potentially free up some Title II, Part A dollars for teacher professional development and new teacher support.]
  • Teacher & Principal Training & Recruiting Fund: This Fund would support state & local activities that further high-quality PD, rigorous evaluation and support systems, and improve the equitable distribution of teachers. The bill's language significantly strengthens existing federal policy language regarding the elements of comprehensive, high-quality educator induction and mentoring.
Concerns
  • Equitable teacher distribution: The bill would require states to ensure that high-poverty and high-minority schools receive an equitable distribution of the most effective educators as measured by new teacher evaluation systems that must include four performance tiers. Sounds good and fair. But given that teacher working conditions significantly impact an individual educator's ability to be effective in the classroom (and garner a "highly effective" rating [see DC]), wouldn't this just create a massive game of musical chairs and major disruptions in the teaching pool unless a determined effort were mounted to improve the often poor teaching and learning conditions present in high-poverty schools?
Good Coverage & Analysis

Alyson Klein - Politics K-12 - Education Week
Joy Resmovits - Huffington Post
Stephen Sawchuk - Teacher Beat - Education Week
The Quick and the Ed (Education Sector)
You have read this article accountability / Education / ESEA / Florida / Mike Enzi / NCLB / teacher distribution / teacher quality / teaching / Tom Harkin / U.S. Senate / Washington DC with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2011/10/esea-come-esea-go.html. Thanks!
Tuesday, March 29, 2011

Live By The Sword, Die By The Sword Redux


A USA Today investigation calls into question "dramatic" improvements in student test scores in select District of Columbia schools due to an "abnormal pattern" of erasures. This occurred during Michelle Rhee's tenure as DC schools chancellor.

Among the 96 DC schools that were flagged for wrong-to-right erasures by the city's testing contractor in 2008 "were eight of the 10 campuses where Rhee handed out so-called TEAM awards 'to recognize, reward and retain high-performing educators and support staff'.... Rhee bestowed more than $1.5 million in bonuses on principals, teachers and support staff on the basis of big jumps in 2007 and 2008 test scores.

In 2008, to her credit, then-DC state superintendent (now Rhode Island education commissioner) Deborah Gist recommended that large test score gains in certain schools be investigated, but as USA Today reported, "top D.C. public school officials balked and the recommendation was dropped."

Such allegations and instances of cheating are not unique to Washington DC of course. In 2010, a New York Times article chronicled erasures in Houston and noted investigations in Georgia (including a criminal probe in Atlanta), Indiana, Massachusetts, Nevada, and Virginia.

This latest development, however, adds a new wrinkle to my 2009 post, "Live By The Sword, Die By The Sword."
Michelle Rhee and other education reform advocates have publicly argued that student performance as measured by test scores is basically the be all and end all....

Student learning, school leadership and teaching cannot be measured and judged good or bad based on a single set of test scores. Test scores must be part of the consideration -- and supporting systems such as accountability, compensation and evaluation must be informed by such data -- but they should not single-handedly define success or failure.
When such huge stakes are placed on a single metric, it raises the likelihood of monkey business. Although it is highly likely this is what occurred in DC, a former employee of DC Public Schools (who tweets as @EduEscritora) makes several smart observations on her blog:
[T]he fact that the number of flagged schools decreased so precipitously from 2008 to 2009 is encouraging, even if we don’t know why that happened.

The decreasing number of schools also doesn’t support the claim that the pay-for-performance system now in place under IMPACT has resulted in cheating; 2010 was the first year that IMPACT existed, and that had the fewest number of flagged schools out of the three years in the study and the fewest number of schools with over 50% of the classrooms flagged – only two!
The problem for an advocate like Michelle Rhee is that she has chosen to largely define success based on a single metric: the test score. If many of these DC test-score gains turn out to be illusory and succumb to what some are calling the "Erase To The Top" scandal, it may spell further trouble for Rhee as a spokesperson for the school reform movement. (Rhee has claimed the largest NAEP score gains in the nation under her leadership, although other analyses have shown that increases began and were larger under Rhee's predecessors.) Her credibility already has been questioned by some as a result of alleged embellishments on her resume about her own teaching record. Without credibility, it is impossible to sell one's wares to anyone but true believers.

From a PR standpoint, this erasure story would seem to call for a measured response that carefully chronicles whatever steps, if any, were taken by DCPS at the time to address the unusual frequency of erasures. Instead, through a spokesperson, Michelle Rhee chose to 'shoot the messenger,' bombastically placing USA Today among the "enemies of school reform." [UPDATE: From the Washington Post's Jay Mathews: "Rhee calls her remarks on test erasures 'stupid'"]

Given Rhee's rhetoric, her policies in DC, and her current focus as head of StudentsFirst (which increasingly appears to be working solely with Republican governors and legislators at the state level), Michelle Rhee has largely pinned her credibility to the test score. If she had chosen to sit on a stool with more than a single leg, she might be sitting more comfortably right now and might not be engaged in a such a precarious and delicate balancing act. No doubt by taking on teacher tenure, she would have made enemies no matter what else she said or did. However, if she touted a more nuanced view of school improvement and student success and didn't poo-poo collaboration, she might not face a growing anti-Rhee cottage industry and her new organization might have had a chance to be a true non-partisan force in education reform.



You have read this article accountability / Michelle Rhee / test scores / USA Today / Washington DC with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2011/03/live-by-sword-die-by-sword-redux.html. Thanks!
Monday, October 4, 2010

Becoming Diane Ravitch

Even before Alexander Russo's tweet last week ("I read somewhat [sic] that you should wait at least 30 min between switching sides and diving back into the debate, just like eating & swimming"), I was drafting this blog item about Diane Ravitch and had landed in just about the same place.

I struggle in making a professional assessment of Diane Ravitch's conversion from a Lamar Alexander-era U.S. Assistant Secretary of Education and a No Child Left Behind proponent to chief curmudgeon on all things draped in education reform. Her past explanations about "accumulating evidence" and getting "caught up in the rising tide of enthusiasm" for school choice don't seem to tell the whole story. I'm not suggesting she's insincere, but I just don't understand how she got from here to there.

Don't get me wrong. I find myself in agreement with many of Ravitch's recent statements, especially those about the one-sidedness and rhetorical hyperbole surrounding Waiting for Superman and other education reform PR vehicles, such as NBC's Education Nation. And I think she is right in her efforts to recast what education reform is or should be. So it's not that I think that people don't have the ability to change. It's more about trying to process and understand so fundamental a change that takes someone from being a ringleader for an accountability-driven education system to a few years later being the foremost national critic of educational accountability, charter schools, and business-style approaches to education reform. How could a highly educated person have gotten it so wrong and so immediately reversed herself? Perhaps I should just go and read her book and see if the answer lies within?

Ravitch doesn't make my job of processing her transformation any easier with her misleading tweets and blog posts. On 9/23/2010, Ravitch tweeted about the recent Vanderbilt University teacher merit pay study and its connection to the federally funded Teacher Incentive Fund (TIF):
Vanderbilt U study discredits merit pay so next day USDOE hands out hundreds of millions for...merit pay. Blind to evidence and research.
Really?!? Ravitch is too intelligent not to know that she is engaging in deliberate simplification in support of her apparent stance against differentiated compensation of teachers. With spin like that, she should go run a political campaign. 'Tis the season, after all. Ravitch is engaged in the same kind of hyperbole that she rightly criticizes in what Alexander Russo has taken to calling "reformy types".

The National Council on Teacher Quality provides a wise counterpoint to Ravitch on the merit pay study here:
Good teacher pay strategies are never written in a vacuum: they're part of a well-thought out system of incentives and professional supports designed to attract and keep the best teachers.... First off, it's no surprise that the findings showed no correlation between performance pay and increasing student achievement, meaning that the very premise of the study might be called into question. Performance pay is a reward system designed to send strong signals that the profession honors and rewards results but, perhaps even more critically, it should increase the profession's appeal to individuals who might not otherwise consider teaching, convinced that the profession disdains excellence. It's a silly notion to think that teachers leave their "A" game at home, absent the promise of a little extra pay.
Funded TIF proposals -- and the federal program itself -- are about much more than pay tied to student test scores. Proposals all have a compensation component, but also embed other critical elements such as classroom evaluation, professional development and collaboration. As examples, check out the CLASS Project led by the Chalkboard Project in Oregon, Chicago Public Schools District #299, the National Board for Professional Teaching Standards proposal for the state of Maine and Richmond, Virginia, and several successful Teacher Advancement Program (TAP) proposals, including one in Knox County, Tennessee.

Absolute, steadfast consistency in the face of mounting or available evidence is not my suggested goal here. Blind faith and arrogance are found in too many education advocates and policymakers on all sides of the debate. So, at a certain level, I appreciate Ravitch's conversion. But the credibility of her current positions and statements are, in part, determined by a plausible explanation for that evolution.

As a final thought, I recognize that I've been especially critical of some education reformers and reform ideas as of late (here and here and on Twitter). Given that I place my personal views somewhere in the middle between the most aggressive reformers and the most steadfast defenders of the educational status quo, I only felt it appropriate to share some nagging questions I've had about someone on the opposing side of the debate.





You have read this article accountability / Diane Ravitch / teacher compensation / teacher pay / TIF with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2010/10/becoming-diane-ravitch.html. Thanks!
Monday, March 22, 2010

Daily Drivel

It's hard to believe that the Wall Street Journal fancies itself a national newspaper while publishing this largely baseless, political clap-trap on its editorial page:
But national standards are no substitute for school choice and accountability, which are proving to be the most effective drivers of academic improvement.
First of all, to frame education reform as pitting national standards against choice/accountability is ridiculous on its face. It is a false choice. Plus, the Obama Administration's reform blueprint is so much more broad than that. About the only thing that the WSJ editorial gets right is in saying that national standards "won't magically boost learning" by themselves.

Secondly, the WSJ appears to be falling into the "silver bullet" mentality all too prevalent among simplistic education reformers. "Just run schools like a business!" Or, "[INSERT pet approach] is the answer." Yes, we've been down that road before .... small schools, merit pay, open classrooms. The WSJ apparently wants to contribute choice and accountability to the junkyard of spent shell casings.

Third, where is the research evidence to suggest that school choice and accountability should be in the driver's seat? The editorial offers no evidence. The presence of publicly funded vouchers is no panacea. Just look at Milwaukee's experience (here and here). At the recent meeting of the American Education Finance Association, the U.S. Department of Education's senior adviser Marshall 'Mike' Smith offered evidence that rates of gain in student test scores were lower after No Child Left Behind became law than before. We chided Margaret Spellings last year for touting the successes of NCLB on similar grounds. So much for bare-bones accountability.

Does the Wall Street Journal have any editorial standards? Or any shame?

UPDATE: Read Claus von Zastrow's take on this editorial on Public School Insights: "It doesn't pass the laugh test."



You have read this article academic standards / accountability / ESEA / NCLB / school choice / Wall Street Journal with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2010/03/daily-drivel.html. Thanks!
Thursday, March 4, 2010

Compromise in Central Falls?

The Central Falls (Rhode Island) Teachers' Union, an AFT affiliate, has approached district superintendent Frances Gallo and signaled a willingness to compromise over several reform issues that last month led Gallo and the school board to recommend the firing of the entire staff at Central Falls High School. It appears that this story is still being written. Sometimes dramatic steps are what is needed to achieve compromise.

For more, check out today's Washington Post ...
"I am pleased to reassure the union their place in the planning process," Central Falls Superintendent Frances Gallo said in a statement. She said she welcomes union input in developing "a dynamic plan to dramatically improve student achievement" at Central Falls High School.

Gallo's statement followed an overture Tuesday from the Central Falls Teachers' Union, an affiliate of the American Federation of Teachers. The instructors have offered support for a longer school day, as well as more rigorous evaluations and training, among other steps.

and Providence Journal stories...
Late Tuesday, Central Falls Teachers Union president Jane Sessums made the first move in a news release that said the teachers were willing to embrace a set of reforms that were very similar to changes Gallo initially proposed.

“My heart skipped a beat,” Gallo said after reading Sessums’ proposal. “I thought, ‘They are basically saying they want what we want for the first time, with the kind of assurances I need.’ … This brings the union back with us, in the conversation about meaningful reform. It’s where they should be.”

Less than 24 hours later, Gallo opened the door with a news release of her own, saying she was excited by the prospect of reaching agreement with the teachers.

Education Commissioner Deborah A. Gist, whose order to improve the struggling school sparked the mass firings, said she was encouraged by the rapprochement between the two sides.

“Our focus in everything … is how to ensure the children in Central Falls receive an excellent education,” Gist said, “and that is always going to be improved when all the adults are working cooperatively together.

Related blog posts:

Central Falls Redux (2/26/2010)
Rhode Island District Fires All Of Its High School Teachers (2/24/2010)
You have read this article accountability / Central Falls / low-performing / Rhode Island / school turnaround / teacher quality with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2010/03/compromise-in-central-falls.html. Thanks!
Friday, February 26, 2010

Central Falls Redux

I have to side with Rick Hess over Andy Rotherham on the question of whether the mass firing of teachers at Rhode island's Central Falls High School is a portend of things to come. In yesterday's Christian Science Monitor story, Hess calls the situation in Central Falls "a canary in a coal mine." In a blog post yesterday, Rotherham calls is "a bogus trend story."
“This will be a canary in the coal mine,” says Frederick Hess, director of education policy studies at the American Enterprise Institute. Such dramatic moves are likely to multiply as “an increasing crop of no-excuses superintendents and state commissioners” take the view that “it’s essential to clean house” to improve persistently failing schools, he says.

This Rhode Island high school situation sure seems like a bogus trend story. Turnarounds may be a trend but really dramatic moves like this seem pretty anomalous. That whale in Florida killing people seems like a more common trend than schools firing all the teachers en masse. -- Eduwonk
In a Tweet this morning, Alexander Russo sardonically notes that "'mass layoff' sounds so much worse than school 'closing' or school 'turnaround' tho they're all the same thing." Indeed.

This morning word comes from the Providence Journal blog that teachers will appeal their firings. No surprise there.

Related Post: Rhode Island District Fires All Of Its High School Teachers (2/25/2010)

------------

UPDATE: President Obama comments on Central Falls in his prepared remarks before the America's Promise Alliance Education Event on March 1, 2010 (via TWIE, via D_Aarons).

"If a school continues to fail its students year after year after year, if it doesn't show signs of improvement, then there's got to be a sense of accountability. And that's what happened in Rhode Island last week at a chronically troubled school, when just 7 percent of 11th graders passed state math tests -- 7 percent."



You have read this article accountability / Central Falls / low-performing / Rhode Island / school turnaround / teacher with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2010/02/central-falls-redux.html. Thanks!
Wednesday, February 24, 2010

Rhode Island District Fires All Of Its High School Teachers

Today's Providence Journal story reports that Central Falls, Rhode Island's "tiniest, poorest city has become the center of a national battle over dramatic school reform." Even the New York Times and the Washington Post have taken notice.

While firing the entire teacher corps at Central Falls High School is a dramatic step, the school board's and superintendent's decision was largely based on the district's track record of very poor student outcomes, the teachers' rejection of a reform plan ultimatum from state Education Commissioner Deborah Gist targeting the state's lowest-performing high schools, and accountability pressures from the federal Education Department. The decision is supported by U.S. Education Secretary Arne Duncan, who recently weighed in on the controversy,
applauding them for “showing courage and doing the right thing for kids.” Nonetheless, the impact on individual teachers is great and undoubtedly places their lives into significant turmoil and uncertainty.

Providence Journal (2/24/2010):

Duncan is requiring states, for the first time, to identify their lowest 5 percent of schools — those that have chronically poor performance and low graduation rates — and fix them using one of four methods: school closure; takeover by a charter or school-management organization; transformation which requires a longer school day, among other changes; and “turnaround” which requires the entire teaching staff be fired and no more than 50 percent rehired in the fall.

State Education Commissioner Deborah A. Gist moved swiftly on this new requirement, identifying on Jan. 11 six of the “persistently lowest-performing” schools: Central Falls High School, which has very low test scores and a graduation rate of 48 percent, and five schools in Providence. Gist also started the clock on the changes, telling the districts they had until March 17 to decide which of the models they wanted to use. Her actions make Rhode Island one of the first states to publicly release a list of affected schools and put into motion the new federal mandate.
I expect that this story will be replicated elsewhere. On one hand, dramatic change IS needed in chronically low-performing schools and districts. BUT if educators and prospective educators see the wholesale firing of staff as a likely consequence in such challenging schools and districts, are they less likely to take jobs in such environments? What is the long-term consequence for such schools' and districts' ability to attract and retain high-quality teachers?
You have read this article accountability / Arne Duncan / Central Falls / Deborah Gist / low-performing / Rhode Island / school / teacher quality with the title accountability. You can bookmark this page URL http://apt3e.blogspot.com/2010/02/rhode-island-district-fires-all-of-its.html. Thanks!

LinkWithin

Related Posts Plugin for WordPress, Blogger...