Remaking Academia: 12 Ideas for 2012

What follows is a summary of a Twitter thread I started a few days ago. Feedback suggested it might be useful to compile it here.

Here are 12 rough, off-the-cuff ideas about how we might collectively remake academia. Just to get the party started. Please throw yours in too!

1. Hey professor: Ask yourself "What new knowledge does this article contribute to the world? Does the method actually address the research question?" If the answer is no or it does not, for pete's sake please don't be so self-serving as to submit it for publication.

2. Publish for the sake of knowledge dissemination, not in the pursuit of tenure. There should be penalties for publishing bad work!

3. At least 1 out of every 5 publications should contribute a lesson for policy or practice at some level.

4. For every three articles placed in academic journals, write at least one executive summary for public dissemination. For those of you at UW, consider this part of the Wisconsin Idea. You could ask your department to host a site where you post these summaries collectively with your colleagues-- no need for a special outlet. Or, consider this bit of info from Julia Savoy- "you might consider depositing your work or summaries of pubs in Minds@UW, an institutional repository that offers a number of benefits, such as long-term archiving and permanent URLs. The outlet is already set up and indexed by Google and other search engines.

5. Blogging and writing op-eds and letters to editor, based on evidence not anecdote, should count for tenure.

6. The full costs of research, and all funders, should be disclosed in a standard statement at the end of articles.

7. It isn't "mixed methods" if you simply add anecdotes in the discussion section to "explain" your statistical findings.

8. Write about what you actually did not what you wished you'd done. Be honest, share tradeoffs and lessons learned.

9. The discussion section of a paper should be INTERESTING and worth reading, not a throwaway.

10. People with controversial opinions should be prized for bravery, not shunned for rocking the boat. Academic freedom & all.

11. Syllabi should include readings from competing perspectives, and varied political ones too.

12. There needs two be a "professor 101" course for all new faculty, helping socialize them to whatever "standards" are expected.

You have read this article publications / remaking academia / research / tenure with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2012/01/remaking-academia-12-ideas-for-2012.html. Thanks!

Busy As a Bee

You may have noticed the recent near radio silence from Sara on our blog. No, she isn't on a secret mission and hasn't left academia to join the NSA. She, however, has been busy as a bee this past year, starting with giving birth to our daughter, being named a W.T. Grant Scholar, and engaging in important academic research.

My pride in her commitment to, excellence in and passion for issues of educational and social inequality is coupled with a recognition of her unwillingness to see academic research relegated to dusty and sometimes impenetrable academic journals. Sara has been aggressive and public with her research and committed to engaging in and communicating her work in a policy relevant manner. That fits a critical need in public policy conversations.

That's why I was quite pleased to see Sara's name mentioned among the ranks of the most prominent academics in the nation in the "EduScholar" rankings issued by the American Enterprise Institute's Rick Hess. And Sara isn't even yet a senior scholar nor is she an economist (who are overrepresented). Hess says:

The academy today does a passable job of recognizing good disciplinary scholarship but a pretty mediocre job of recognizing scholars with the full range of skills that enables them to really contribute to the policy debate. Today, there are substantial professional rewards for scholars who do hyper-sophisticated, narrowly conceived research, but little institutional recognition, acknowledgment, or support for scholars who carry their efforts into the public discourse. One result is that the public square is filled by impassioned advocates, while silence reigns among those who may be more versed on the research or more likely to recognize complexities and hard truths.

I think these kinds of metrics are relevant because I believe it's the scholars who do these kinds of things "who can cross boundaries, foster crucial collaborations, and bring research into the world of policy in smart and useful ways."

Jay Greene -- seeking to give credit to more junior scholars who have had a great impact on contemporary public policy conversations and to move beyond rankings based on a single year (2010) of performance -- perfected the Hess rubric, causing Sara's ranking to increase by about 30 points to #39.

Hotshot researchers like Roland Fryer, Jacob Vigdor, Susanna Loeb, Matthew Springer, Brian Jacob, Jonah Rockoff, and Sara Goldrick-Rab are having a large impact on current education policy discussions even though their careers have not been long enough to accumulate a longer list of books and articles. The original ranking shortchanged these scholars in measuring their current “public presence.”

I agree. As I mentioned in this recent post, advocates who too often simply echo one another's opinions are too influential in policy debates. There is an important void to be filled by the likes of academic researchers as well as classroom teachers.

Congrats, Sara! Keep up the great work!

You have read this article academia / Jay Greene / research / Rick Hess / Sara Goldrick-Rab with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2011/01/busy-as-bee.html. Thanks!

Seeking a PostDoctoral Fellow!

Hi folks-- sorry for the long absence-- I'm hoping to hire a postdoc (or doctoral student) in the next year and wondering if any of our readers might be interested? Here are details...

Sara

----------------------------

Wisconsin Scholars Longitudinal Study

Position Announcement: Funding for Junior Researcher of Color

Graduate Project Assistantship or Postdoctoral Fellowship

Sara Goldrick-Rab, Assistant Professor of Educational Policy Studies and Sociology at UW-Madison, seeks a talented junior researcher of color to join the Wisconsin Scholars Longitudinal Study in 2011 as it prepares to enroll its second cohort of students.

The WSLS is the first-ever longitudinal randomized controlled trial of need-based financial aid. It is a mixed-methods study following two cohorts of Wisconsin Pell grant recipients through college and into the workforce. It is led by an interdisciplinary team of researchers, including co-director Douglas N. Harris, and includes collection of administrative, survey, and in-depth interview data. For more information, please see the WSLS website.

Dr. Goldrick-Rab holds a William T. Grant Scholars award for her work on the WSLS. Her project, “Rethinking College Choice in America,” applies ideas and methods from developmental psychology and behavioral economics to examine how college students' use of time, emotional experiences and amounts of sleep interact with financial aid and affect chances of earning degrees.

The Scholars award includes the opportunity to seek supplementary funding (also from the William T. Grant Foundation) to help Scholars build strong mentoring relationships with students of color. According to the Foundation, “these awards address two issues that receive insufficient attention and resources: how to be a good mentor and challenges facing people of color in research careers.” The Foundation estimates awarding three to four awards in the amount of $60,000 for mentoring doctoral students and $85,000 for mentoring postdoctoral fellows (inclusive of a maximum of 7.5 percent in indirect costs). Funding will begin on July 1, 2011, and end June 30, 2012. Mentors and mentees will come together during annual winter meetings designed to support the mentoring relationships, Scholars’ development as mentors, and Junior Researchers’ development as researchers.

If selected and funded, the Junior Researcher will work with Dr. Goldrick-Rab on her Scholars project and also on an independent inquiry related to the second cohort of students participating in the WSLS.

Eligible applicants must meet the following criteria, according to Foundation rules:
• Junior Researchers of Color may be African American, Asian or Pacific Islander American, Latino, and/or Native American.
• Junior Researchers may be full-time doctoral students or postdoctoral fellows.
• At minimum, students must be in their second year of doctoral studies at the onset of the award.
• The Junior Researcher must be housed at UW-Madison or a nearby college or university.

In addition, per the needs of the WSLS and Dr. Goldrick-Rab’s project, eligible applicants must also possess all of the following qualifications:
• A background in social science coursework, preferably in sociology or anthropology and/or training in a public policy or social work program.
• Prior experience conducting in-depth interviews .
• Statistics skills, include comfort with regression analysis and preferably familiarity with STATA.
• Ability to demonstrate attention to detail, strong writing skills, and the capacity to work independently.
In short, the highly qualified applicant will have already begun to emerge as a skilled mixed-method researcher, or researcher-in-training.

This position is currently in the planning stage. At this time, Dr. Goldrick-Rab seeks interested students who would like to collaborate on an application for either a project assistantship or a postdoctoral fellowship, to begin in July 1, 2011 and conclude June 30, 2012. The final application is due March 2, 2011 and the award decision will be made in June 2011. The applicant is required to jointly prepare the application with Dr. Goldrick-Rab (as the Foundation mandates). To the extent that the student goes beyond the application planning and participates in laying the groundwork for Cohort 2, that work may be compensated on an hourly basis (to be negotiated), regardless of whether the award is granted.

If interested, students should contact Dr. Goldrick-Rab by November 5, 2010. Please send an email that includes a cover letter explaining reasons for interest, along with a CV and contact information for at least two professors who can provide recommendations to srab@education.wisc.edu.

Thank you for your interest!

You have read this article employment / research / University of Wisconsin-Madison / Wisconsin Scholars Longitudinal Study with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/10/seeking-postdoctoral-fellow.html. Thanks!

The Manifesto, Income Inequality & Credibility

On Friday, I wrote a blog item ('Misleading Manifesto') chiding a group of urban superintendents for misstating educational research in a 'manifesto' published in Sunday's Washington Post. Teacher quality *is* important -- but it does not matter MORE THAN family income and concentrated poverty.

I am convinced that too many educational reformers are happy to 'spin' the truth for rhetorical purposes. I think this is exactly what we saw in this manifesto. While this may help to simplify messaging, target solutions at a more narrowly construed problem, and focus in on what education leaders have direct control over, it carries an inherent policy danger along with it. That danger is two-fold: (1) teacher policy reforms may be set up for failure by overstating their potential impact; and (2) more comprehensive strategies desperately needed to combat rising income inequality and growing poverty in our nation may be discounted and ignored.

For me, this isn't an issue of setting low expectations for children from poverty. We must train and support our teachers to have high expectations and develop the potential in all children. But, from a policy perspective, which is the world in which I work, to not even discuss poverty and inequality -- even though the research evidence points to its preeminence -- is akin to taking it off the table as a policy priority.

Nor it is a lack of belief in the ameliorative benefits that sensible teacher reforms can have on student outcomes by expanding the recruitment pool of teacher candidates, improving initial training and on-going support of classroom teachers, improving teaching and learning conditions within schools, providing differential compensation to teachers for leadership roles, difficult assignments, shortage fields, and demonstrated effectiveness, and more....

For teacher quality specifically, as I argued in my previous post, playing fast and loose with the facts isn't necessary. There is a powerful argument to be made based on the fact that teachers are the most important school-based influence on student learning. That's exactly what my colleagues at the New Teacher Center have done. We've made careful and honest declarations about teacher quality being the most critical within-school variable, but haven't framed the issue in a way that would make us education-industry Pinocchios.

And this leads us directly to the question of credibility. While I am personally inclined to support elements of what the superintendents' manifesto calls for -- and inclined to support elements of broader education and teacher reform agendas -- I am disinclined to associate myself with a clarion call that is dishonest on its face and misserves the national need for a critical conversation and accompanying set of public policies to address issues of economic inequality. That need extends well beyond the education system and requires responses much broader than merely strengthening the teaching profession and overhauling human capital systems.

Former Labor Secretary Robert Reich recently has been banging the drums challenging policymakers -- and Democrats, in particular -- to address our nation's historic levels of income inequality and rising levels of poverty. As reported by the Washington Post's Steven Pearlstein, since 1976 "virtually all of the benefits of economic growth have gone to households that, in today's terms, earn more than $110,000 a year." Further, UNICEF reports that the United States has the highest rate of childhood poverty among 24 OECD nations -- over 20% -- and the second-worst rate (barely ahead of bottom-dwelling Great Britain) of childhood well-being in the industralized world. Further, as Walt Gardner recently noted, a September 2010 U.S. Census Bureau report showed that the percentage of Americans below the poverty line in 2009 was the highest in 15 years. And the rise was steepest for children, with one in five affected. Think this has any bearing on U.S. students' relatively poor performance on international student assessments? Uh-huh.

So, let's talk about how to strengthen teaching and its central importance to student outcomes. But let's not fence ourselves in with self-serving rhetoric. Let's be honest in our communications and expansive in our thinking about policies needed to improve the lives of American children.

It's about education -- and a whole lot more.

You have read this article Education / Joel Klein / Michelle Rhee / reform / research / teacher quality / teaching / Washington Post with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/10/the-manifesto-income-inequality.html. Thanks!

Misleading Manifesto

I'm sorry, but the "manifesto" published in today's Washington Post really pisses me off because it is built upon a false premise. It is authored by a number of urban school superintendents, including Chicago's Ron Huberman, New York City's Joel Klein, Washington DC's Michelle Rhee, and New Orleans' Paul Vallas. And it -- intentionally? -- misstates educational research.

"[T]he single most important factor determining whether students succeed in school is not the color of their skin or their ZIP code or even their parents' income -- it is the quality of their teacher."

No. That is patently false.

Now, listen here. I work for a teacher-focused, non-profit organization, the New Teacher Center (NTC). Wouldn't it be powerful to go out and say that teachers matter more than ANYTHING else? But they don't. In terms of school-based variables, they do. But in terms of all variables that impact students, they simply do not. No research says that. In our messaging at the NTC, we are always careful to say that teacher quality is the most important school-based variable for student achievement (examples here and here (on page 4)). That's accurate, honest and powerful in its own right.

So why not make the case for improving teaching in a honest fashion? There is an incredibly strong case to make that improving teaching quality is a critically important and policy amenable part of the solution to increasing student achievement and closing achievement gaps for disadvantaged students. But it's only part of the answer which requires solutions beyond the educational system. Let's not lose sight of that.

At the Shanker Blog, Matthew Di Carlo explored this same issue last month and took journalists to task for making similar claims. Back in July, he summarized existing teacher quality research.

September 16, 2010:

The same body of evidence that shows that teachers are the most important within-school factor influencing test score gains also demonstrates that non-school factors matter a great deal more. [emphasis added] The first wave of high-profile articles in our newly-energized education debate not only seem to be failing to provide this context, but are ignoring it completely. Deliberately or not, they are publishing incorrect information dressed up as empirical fact, spreading it throughout a mass audience new to the topic, to the detriment of us all.

Even though the 10-15 percent explained by teachers still represents a great deal of power (and is among the only factors “within the jurisdiction” of education policy), it is nevertheless important to bear in mind that poor educational outcomes are a result of a complicated web of social and economic forces. [emphasis added] People have to understand that, or they will maintain unrealistic expectations about the extent to which teacher-related policies alone can solve our problems, and how quickly they will work.

July 14, 2010:

But in the big picture, roughly 60 percent of achievement outcomes is explained by student and family background characteristics (most are unobserved, but likely pertain to income/poverty). [emphasis added] Observable and unobservable schooling factors explain roughly 20 percent, most of this (10-15 percent) being teacher effects. The rest of the variation (about 20 percent) is unexplained (error). In other words, though precise estimates vary, the preponderance of evidence shows that achievement differences between students are overwhelmingly attributable to factors outside of schools and classrooms (see Hanushek et al. 1998; Rockoff 2003; Goldhaber et al. 1999; Rowan et al. 2002; Nye et al. 2004).

Let's take Di Carlo's and Joe Friday's advice. Just the facts, please.

You have read this article Education / Joel Klein / Michelle Rhee / New Teacher Center / research / teacher effectiveness with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/10/misleading-manifesto.html. Thanks!

Positive Effects of Comprehensive Teacher Induction

Today, Mathematica Policy Research, Inc. released the final report of its IES/U.S Department of Education-funded randomized controlled trial (RCT) of comprehensive teacher induction. It shows a statistically significant and sizeable impact on student achievement in mathematics (0.20 standard deviations) and reading (0.11 standard deviations) of third-year teachers who received two years of robust induction support. That's the equivalent of moving students from the 50th to 54th percentile in reading achievement and from the 50th to 58th percentile in math achievement.

As a basis of comparison, I note that in 2004, Mathematica conducted a RCT of Teach for America (TFA). In that study, it compared the gains in reading and math achievement made by students randomly assigned to TFA teachers or other teachers in the same school. The results showed that, on average, students with TFA teachers raised their mathematics test scores by 0.15 standard deviations (versus 0.20 standard deviations in the induction study), but found no impact on reading test scores (versus 0.11 standard deviations in the induction study).

In another recent Mathematica report (boy, these folks are busy!), the authors note that "The achievement effects of class-size reduction are often used as a benchmark for other educational interventions. After three years of treatment (grades K-2) in classes one-third smaller than typical, average student gains amounted to 0.20 standard deviations in math and 0.23 standard deviations in reading (U.S. Department of Education, 1998)." In that report -- an evaluation of the Knowledge Is Power Program (KIPP), Mathematica researchers found a very powerful impact from KIPP: "For the vast majority of KIPP schools studied, impacts on students’ state assessment scores in mathematics and reading are positive, statistically significant, and educationally substantial.... By year three, half of the KIPP schools in our sample are producing math impacts of 0.48 standard deviations or more, equivalent to the effect of moving a student from the 30th percentile to the 48th percentile on a typical test distribution..... Half of the KIPP schools in our sample show three-year reading effects of 0.28 standard deviations or more."

Is it appropriate to compare effect sizes among RCTs or, for that matter, among research in general? I am told that it is, although certainly considerations such as cost effectiveness and scalability have to enter into the conversation. Implementation issues also must be attended to. With regard to teacher induction, the issue of cost effectiveness was addressed in a 2007 cost-benefit study published in the Education Research Service's Spectrum journal and summarized in this New Teacher Center (NTC) policy brief.

Disclosure: I am employed by the NTC which participated in the induction RCT, and I helped to coordinate NTC's statement on the study.

The NTC is "encouraged" by the study. However, NTC believes that "it does not reflect the even more significant outcomes that can be achieved when districts have the time, capacity and willingness to focus on an in-depth, universal implementation of comprehensive, high-quality induction. It speaks volumes about the quality of induction and mentoring provided and the necessity of new teacher support that student achievement gains were documented despite [design and implementation] limitations to the study."

UPDATE: Read the Education Week story by Stephen Sawchuk here. And the Mathematica press release here.

You have read this article induction / Institute for Education Sciences / KIPP / mentoring / New Teacher Center / research / Teach for America / teacher effectiveness / TFA with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/06/positive-effects-of-comprehensive.html. Thanks!

Politics, As Usual

The recent decision by the American Educational Research Association (AERA) to hold a news conference condemning Arizona's new immigration law was somewhat unpredictable, and according to at least a few observers, unwise. For example, Rick Hess told the Chronicle of Higher Education it wasn't "smart politics" to "baldly politicize the role of research." The Chronicle's editors fanned the flames further by titling its article, "Education-research group puts itself on the border of advocacy."

Oh, the horror--research and advocacy meeting, having coffee, perhaps even deciding to date. The children which could result are feared by PhDs everywhere, particularly those evil twins: Compromised Objectivity and Biased Conclusions.

Of course academia trains us to think, like Hess, that research is worthy only when fully divorced from politics. Our research questions should be derived from theory, stemming only from the reading of great books and dusty journals, and never from a desire to enter policy or social debates. Puhleese. Every research question is inherently political--we conceive and ask questions the way we do because we have a desire to know something. Knowledge is socially, and therefore politically, constructed.

I'm the first to admit that AERA is a deeply flawed organization, but aren't they all (Hess's included)? I think honesty and transparency are among the best qualities, and would much rather AERA's leaders and members take visible positions on issues they care about rather than pretend not to have opinions. Research lacks an agenda only in the most naïve of imaginations. But agendas lack research all-too-frequently. If AERA begins to use its members' work to create a research-backed agenda, that can only be a good thing.

You have read this article academic life / AERA / Arizona / research with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/05/politics-as-usual.html. Thanks!

Congratulations!

Congratulations to my wife, Sara Goldrick-Rab, who was one of only four academics named yesterday as a 2010 William T. Grant Scholar!

UPDATE: University of Wisconsin-Madison press release.

The W. T. Grant Scholars Program supports promising early-career researchers from diverse disciplines, who have demonstrated success in conducting high-quality research and are seeking to further develop and broaden their expertise. Candidates are nominated by a supporting institution and must submit five-year research plans that demonstrate creativity, intellectual rigor, and a commitment to continued professional development. Every year, four to six Scholars are selected and each receives $350,000 distributed over a five-year period.

The four new William T. Grant Scholars and their research projects are:

Elizabeth Oltmans Ananat, Ph.D., Assistant Professor, School of Public Policy, Duke University --
“Economic and Social Determinants of the Educational, Occupational, and Residential Choices of Young Adults”

Phillip Atiba Goff, Ph.D., Assistant Professor, Department of Psychology, University of California, Los Angeles -- “Broken Windows, Broken Youth: The Effect of Law Enforcement on Non-White Males’ Development”

Sara Goldrick-Rab, Ph.D., Assistant Professor, Educational Policy Studies Department, University of Wisconsin-Madison -- “Rethinking College Choice in America”

Patrick Sharkey, Ph.D., Assistant Professor, Sociology Department, New York University -- “The Impact of Acute Violence and Other Environmental Stressors on Cognitive Functioning and School Performance”

You have read this article research / Sara Goldrick-Rab / University of Wisconsin-Madison / William T. Grant Foundation with the title research. You can bookmark this page URL http://apt3e.blogspot.com/2010/04/congratulations.html. Thanks!