Friday, May 17, 2013

Salt is fine for you! (poor logic in public health and educational pseudo-science)


I'm busy, but this caught my eye, so I'll do it quickly.  It turns out that low-salt diets are actually bad for you.  

This is another in a long line of reversals for overly simplistic public health guidelines (butter is bad, mammograms are good, breastfeeding is bad, eat lots of carbs, etc.), and it should make us very wary of the educational pseudo-science, which often uses the exact same simplistic logic.

Salt was considered bad because salt consumption was associated with slightly higher blood pressure, and slightly higher blood pressure was associated with slightly more heart attacks.  So A was associated with B, and B was associated with C--but no one had actually checked that A actually led to C--that increased salt consumption meant more heart attacks or earlier death.  It turns out that it doesn't--quite the opposite.

This isn't so surprising--the human body is a very complicated system, and there are a lot of other billiard balls on the table besides just salt and blood pressure--but it is worth noting as a cautionary tale, because so much “evidence-based” discourse in the education world is highly dubious and likely to be disproven in the future.

Some examples 
I have seen this kind of logic--A is correlated with B, and B is correlated with C, so A must cause C—in arguments about all sorts of questions.  Here's an example that I wrote about a long time ago:

A.      Explicit vocabulary instruction can lead to some increase in vocabulary
B.      Good readers tend to have larger vocabularies
C.      Therefore, one of the most evidence-based ways to increase reading comprehension is explicit vocabulary instruction

Sometimes the arguments are even weaker:

A.      The texts assigned in schools are less complex than they were 40 years ago.
B.      Students are marginally less good at reading complex texts than they were 40 years ago (I think the evidence for this is very weak, but I’ll accept it for the sake of argument)
C.      Therefore, we should assign more difficult texts in school.

And sometimes they're painfully comical:

A.      Schools are spending more money
B.      Test scores are flat
C.      Therefore, we should get rid of teachers’ unions

Why not more logical arguments?
These arguments would seem to be self-evidently silly, and it might not be worth taking the time to respond to them, except that they are so widely accepted and so central to the major education debates of our time.  So we might ask, why not the following arguments?

A.      Many of our students go whole years without reading a single book.
B.      No one has ever become a good reader without reading a lot
C.      Therefore, we should spend a lot of time and money and thought on getting kids to read more.

A. In an appropriately leveled book, 1% of the words will be new, and readers will learn on average about 15% of those new words.
B. If you read 100 pages a week, you will learn about 45 new words, which is far higher than the ten to fifteen that kids are given in typical vocabulary instruction.
C. Therefore, teachers should stop spending time on explicit vocabulary instruction and should instead devote more time to independent reading.

A.  If you read books that are too hard, you don't improve as much as if you read books that are at the appropriate level.
B. If you read books that are too hard, you will read less.
C. Therefore, students should read books at their reading level.

A. The educational achievement of poor kids is much, much worse than that of rich kids.
B. No school has ever succeeded in educating poor kids up to the level of rich kids.
C. Therefore, if we want all kids to have the same opportunity, we should eliminate poverty.

But that last argument is its own refutation, because of course it is unthinkable anymore to seriously consider attacking poverty directly.  So instead we get ridiculous logic.

Thursday, May 16, 2013

Krugman on Ed Reform

Paul Krugman has a good piece in the NYRB discussing the ill-judged move, over the past few years in the west,  to "austerity"-- that is, cutting government spending and raising taxes.  The article is worth reading even for people who aren't usually terribly interested in economics, both because this is one of the major stories of our time and because Krugman's analysis of how the opinions of the elites and the policymakers could be so wrong is more broadly applicable.  In particular, I think the analysis applies pretty well to the Ed Reform movement of the past decade.

According to Krugman, the move to austerity has a few notable features:

* It found support from scholarly studies that are, despite fancy pedigrees (Harvard!), shaky and dubious
* It had a simple moral and psychological appeal
* It did not demand anything difficult from the elites themselves

All of these fit the Ed Reform movement as well:

Support from dubious but ivy-league scholarship
Educational research is, like economics research, anything but conclusive.  A lot of pretty basic questions are surprisingly unclear: whether homework is worthwhile, whether class size makes a big difference, how reliable or valid standardized test scores are as measures of teacher effectiveness, whether vocabulary instruction is useful, and many , many more.  Nevertheless, you would never know this from the self-assured pronouncements of people like Bill Gates, who can move with dizzying fickleness from demanding small schools to demanding Common Core Standards to demanding that teachers be evaluated by test scores to demanding larger class sizes, citing studies for each new "evidence-based" proposal despite the fact that none of these proposals has more than the slimmest of empirical evidence in its favor.  

In fact, the Ed reformers' emphasis on standardized tests is striking in its radical departure from what has long been understood: that what matters is student engagement with the material in as authentic a way as possible.  But just as radical proponents of austerity economics have, on the basis of thin scholarship and simplistic moralizing ("We must tighten our belts!"), left behind the accepted wisdom of John Maynard Keynes--just so have the Ed reformers radically left behind the legacy of John Dewey on the basis of thin scholarship and similarly simplistic moralizing ("We need to get tough!").

Crude moral and psychological appeal 
Blame and punishment have an eternal appeal.  Just as the Germans blame the Greeks, and demand cuts and austerity from the Greeks even though cutting the Greek economy off at the knees means it won't ever get back on its feet, American Ed reformers blame teachers and schools, and demand punishment.  Never mind changing the larger system of inequality and poverty, never mind the fact that punitive measures never work, blame and punishment are appealing--especially if you can put them onto other people, not yourself or people you know.

Few demands on the elites themselves
Because cutting taxes on the rich helps the rich, cutting government spending doesn't hurt them directly, and failing to tackle high unemployment keeps wages down and corporate profits high, the wealthy proponents of government austerity are remarkably insulated from the bad effects of the policies they propose.  In the same way, the Ed reformers are very far from personally connected to the reforms they propose.  Not only have none of these people (Gates, Broad, Duncan, Obama, Bloomberg, Klein, Coleman, Emanuel, etc.) ever actually been a teacher, not a single one of them, as far as I know, has kids in public school.  The fact that all of the ed reformers send their kids to private school is significant for two reasons: (1) because private schools like Lakeside, Sidwell Friends or the Lab School do not follow an ed reform model now, and (2) because they will never have to.  New standards, new testing regimes, increased class sizes, teacher evaluation based on test scores--all of these dubious reforms will be imposed on those of us in public schools, but their architects and proponents are sheltered and insulated from them.  It is infuriating.

Conclusion
What Krugman says about proponents of austerity economics is, I think, appropriate to Ed Reform as well (and reminds me why the wonk is an invasive species).  Here's Krugman:

"It’s a terrible story, mainly because of the immense suffering that has resulted from these policy errors. It’s also deeply worrying for those who like to believe that knowledge can make a positive difference in the world. To the extent that policymakers and elite opinion in general have made use of economic analysis at all, they have, as the saying goes, done so the way a drunkard uses a lamppost: for support, not illumination. Papers and economists who told the elite what it wanted to hear were celebrated, despite plenty of evidence that they were wrong; critics were ignored, no matter how often they got it right."

Tuesday, May 14, 2013

$150 million of Gates money later, we're still clueless

Valerie Strauss of the Washington Post reports that Bill Gates has given over $150,000,000 to promote and develop curriculum for the CCSS.  This is a lot of money. But we are still mostly clueless.

Yesterday my curriculum coordinator was asked what our department was doing to align our curriculum to the Common Core, and she didn't have a quick and easy answer, because there is no quick and easy answer. The Common Core English Standards demand an ability to read complex texts, ability to make coherent arguments grounded in evidence from text, and an increased familiarity with academic language and "content-rich non-fiction."  The most important things students need to be doing, in other words, is meaningful reading and writing--just what we should have been doing before.  The only new thing here is the emphasis on "informational texts," but the best way to learn to read non-fiction is to read a lot of any old text: I am pretty good at reading informational texts, but I read hardly any non-fiction as an adolescent; Malcolm Gladwell is a master of reading, synthesizing and writing informational texts, but the main thing he reads now, just as, no doubt, when he was in high school, is junky airport fiction. Again, the main job of English teachers should be ensuring that their students are doing as much meaningful reading and writing as possible.

Things may look different in other subjects.  The math department at Leafstrewn has apparently done all sorts of work on Common Core "implementation."  This is probably appropriate; in math, you have to decide which skills to teach when. In English, we should be doing similar things over and over again, just with different texts, and different types of writing.  Trying to teach to the Common Core's "Shifts" (yes, the word is capitalized--it is, in the eyes of the Common Core people, that important) is, as I have tried to show, very likely a mistake, since it will lead to a narrow focus, boring curriculum, and not enough reading.  What we need is reading and writing--provide kids with books, time, and a humane, caring community in which they can do their work.

Wednesday, May 8, 2013

The Common Core's Supposed Emphasis on Close Reading is a Joke (not much reading, and not very close)

In the curriculum materials developed by the Common Core authors' own company, there is very little time available for high-volume reading, and the close reading questions lack depth or complexity.  Poor readers will not read enough to improve; good readers will be bored and very likely contemptuous.

Resources from the Standards' authors' own company
The Common Core standards are supposed to promote increased complexity of text, but they offer very little guidance on how to do it. Since the standards don't say much about what teachers should actually do, I couldn't be sure, but I have long been skeptical that the standards would do much to improve students' ability to read more complex texts, since the most important factor is how much students read, and the standards say very little about reading volume. Nevertheless, ready to be proved wrong, I decided to look at some curriculum that was developed with the Common Core in mind by an organization founded by the some of the authors of the standards.

Both Bill Gates and some corporations (I think GE gave 18 million dollars) have supported an organization called "Student Achievement Partners," which describes itself, awkwardly, as a "nonprofit organization that assembles educators and researchers to design actions based on evidence that substantially improve student achievement." (With tens of millions of dollars, you'd think they could have substantially improved their own writing!)  This organization has established a website called "achievethecore.org," which offers "free, high-quality resources for educators to implement the Common Core Standards."  When I visited the site, I was surprised not only by the paucity of resources, but also by their relatively low intellectual level.

What about "literary texts" in high school? What about independent reading?
From a none too extensive list of lessons on close reading, I clicked on an eighth grade unit on Laura Hillenbrand's Unbroken and Jeanne Watasuki Houston's Farewell to Manzanar--partly because I was surprised that Hillenbrand's book would be taught in the eighth grade (a strong student in one of my Honors Junior classes is reading the book and fnding it challenging because of the length, complexity and the unfamiliar historical content), but also because I wanted to look at a lesson plan on a "literary text", not on an "instructional text," and the site offered not a single lesson plan at the high school level for use with a "literary text." This omission, no doubt related to CCSS's infamous call for 80% of kids' reading in high school to be of informational texts, was disappointing enough--but then I dug into the lesson plan.

The lesson plan only focuses on a few passages from each book.   Each day of the five-day lesson plan has the kids reading one passage from each book, then hearing it aloud, then writing about it, then discussing it.   This would not be terrible--if time were built in for extensive reading beyond these few paragraphs--but the writing and discussion prompts strike me as tedious and shallow, and I am very skeptical that a class doing this lesson plan would have kids actually reading more than a page or two a day.

"Close Reading": Boring Writing Prompts and Discussion Questions

The lesson is prefaced by a warning that since this is close reading, the teacher should not offer students any introduction, background or context for the texts.  This strikes me as truly bizarre advice (the weakness of New Criticism with none of its strengths), especially when the texts in question are brief excerpts from much longer works.  The instructions read:

It is critical to cultivating independence and creating a culture of close reading   that students initially grapple with rich texts without the aid of prefatory material, extensive notes, or even teacher explanations.

These instructions are comically ironic, since this entire teacher-selected, teacher-directed, non-open-ended lesson plan seems designed rather to stifle independence.

Here is the first passage, from Unbroken:

“The men had been adrift for twenty-seven days. Borne by an equatorial current, they had floated at least one thousand miles, deep into Japanese-controlled waters. The rafts were beginning to deteriorate into jelly, and gave of a sour, burning odor. The men’s bodies were pocked with salt sores, and their lips were so swollen that they pressed into their nostrils and chins. They spent their days with their eyes fixed on the  sky, singing “White Christmas,” muttering about food. No one was even looking for them any more. They were alone on sixty-four million square miles of ocean. A month earlier, twenty-six-year-old [Louie] Zamperini had been one of the greatest runners in the world, expected by many to   be the first to break the four-minute mile, one of the most celebrated barriers in sport. Now his Olympian’s body had wasted to less than one hundred pounds and his famous legs could no longer lift him. Almost everyone outside his family had given him up for dead.”

The writing prompt is:

In one or two sentences, briefly describe the condition of Louie Zamperini and the other men who were "adrift" in Japanese-controlled waters.

Then there are three discussion questions, one about how the author establishes "time and geographic location," one about the mental and physical condition of the men on the boat, and one about why the author writes about Louie Zamperini's past life and experiences.

For a good reader, these are boring questions.  They are neither very difficult--it is pretty obvious that the men are in poor shape--nor, just as important, are they open-ended.  These are not questions that could have more than one answer (in case the teacher is not himself a good reader, the lesson plan helpfully gives the answer; for example: "Hillenbrand describes Louie Zamperini's former condition as an Olympic athlete to show how, within a very short period of time, a popular star-athlete could quickly find himself weak, emaciated, and near death while floating aimlessly on a rescue raft in the South Pacific. This portion of text helps students establish a sense of how far Louie was from his former life before the war.")

It's hard to imagine a good discussion coming out of questions like the ones in this unit. There are things in the passage that seem interesting to me, either because I wasn't familiar with the phenomena (rafts turning to jelly, salt sores, etc.) or because I was curious about why (the looking at the sky, the singing of "White Christmas," etc.), or because the logical continuity of the writing seemed tenuous (in the last two sentences, there seems to be an implied connection between Louie's famous legs wasting away and his being given up for dead by folks back home, even mthough you wouldn't know his legs were wasting away unless you were on the raft).  But the questions in the unit just don't get at these strange and interesting elements of the passage, and if I were a student in the class I would feel like I was mostly wasting my time.

It seems to me that it would be much more worthwhile to have students mark up and make comments directly on the passage and then have a more open-ended discussion, beginning perhaps with a pretty broad question like "What didn't you understand in the passage?" or "What do you think the author is doing in this passage?" Open-ended questions will lead to real discussion, and real discussion will help students get better at answering even the boring questions like these.  But answering boring questions won't help kids learn anything, except to dislike school and reading.

Kids need to read a lot, and this lesson plan doesn't encourage that

If this were run as a five-day unit, the students would read a total of four pages in class, and at most another three pages at home.  An appendix does present the possibility of doing a three-week unit in which students would read one of the texts in full, but this possibility would require, for kids reading Unbroken, an average of over thirty pages per night, a pace which, for this demanding text, would lead nearly all students to cheat on the reading, pushing some into the arms of study guides, others into desperate skimming, and all into frustration and contempt.

Assuming that the unit is done as a one-week unit, students would get well-organized lesson plans on interesting, but very brief texts with boring tasks and very, very little reading.  This is not a good way to learn to be a good reader.  Students need to read a lot, and the discussions they have about what they read need to be based on interesting, open-ended questions to which the teacher or lesson-planner does not already know the right answer.

It might be tempting to think that this lesson plan is just a lemon, but it's not.  The Common Core sets an expectation that students will be "given frequent opportunities to read a high volume of
texts independently and be held accountable for this reading", but nothing in the Standards, or in the materials I've seen developed for them, or in presentations I've watched by David Coleman or others, offers any hint as to how this could be accomplished, especially in the context of all the other stuff students are supposed to be doing.  I know from experience, and from the very, very consistent literature on fostering higher-volume reading (by Mary Leonhardt, Nancie Atwell, Stephen Krashen, Richard Allington, Penny Kittle, Kelly Gallagher, and others) that teachers must make a concerted effort to provide students with high-interest books, and with time to read them.  The Common Core just doesn't do this; therefore, unless we teachers take matters into our own hands, students will not advance on the "staircase of text complexity."

The high school lesson plans are no better
For the high school grades, there are no sample lessons on fiction or literature, only on "informational text," and for grades 11 and 12 there are only two sample lesson plans.  The first is a three-day lesson on a two-paragraph speech by the great jurist Learned Hand about America and freedom; the second unit takes "several days" to read and re-read Andrew Carnegie's four-page article,  "The Gospel of Wealth," about how wonderful inequality is, and how poor people should be grateful for it, since it allows rich people to spend some their wealth on philanthropic endeavors.  

Leaving aside the fact that these texts, especially the Carnegie essay, are of dubious literary quality and are essentially propaganda, there are again two major problems with these lesson plans:  (1) the questions and prompts are not not very interesting, and any good reader would hardly have to do any "close reading" in order to answer them; (2) they are together less than five pages long, and yet would seem, along with the "text-dependent questions" and the culminating essays, to be all that was intended to occupy the students for over a week of class time.  This is not a curriculum that is prioritizing reading.

Conclusion
The Common Core's supposed emphasis on close reading is a joke.  Again: in the curriculum materials developed by the Common Core authors' own company, there is very little time available for high-volume reading, and the close reading questions lack depth or complexity. Poor readers will not read enough to improve; good readers will be bored and very likely contemptuous. Of course, a good teacher could probably make these lesson plans work--but then, a good teacher wouldn't need them in the first place.

Although I am more and more sure that the CCSS effort is basically a stalking horse for standardized tests and for-profit curriculum, and that the authors are mostly clueless about how to help students develop into good readers, I do think it would be possible to develop a CCSS curriculum that would work very well.  That curriculum would involve large amounts of independent reading at the students' own reading level, along with focused close reading and instruction in how to read closely.  You might say, Well, that's just what Student Achievement Partners is trying to do!  Perhaps, but they are ignoring the independent reading side of it and doing the close reading side poorly.

In the future, I'm going to put up some curriculum I think would be better--and I'll also have to write about those lesson plans on how great America and inequality are...