Discussion about this post

User's avatar
James's avatar

A few corrective points to make here.

A few examples like Boaler or Hattie aside, most academic researchers are not writing curriculum. Those are by and large written by curriculum publishers and ed tech companies. I don’t think it’s right to claim that ed researchers are all pursuing their own quixotic curriculum.

School confidentiality isn’t just a “norm” it’s a requirement. IRB will reject studies that don’t obscure the schools. Journals won’t publish papers that don’t get IRB approval from the researcher’s institution. Journals often also have their own requirements to obscure school data.

Additionally, schools have to agree to let you do research there. You can’t just walk in and declare yourself to be conducting research. The schools where research takes place also want anonymity and often require it in order for research to take place.

Depending on the type of study, for example one that would require observing classrooms as part of evaluating a program, you might also have to get parents’ permission for each kid studied. Again, they often want anonymity.

In general, ethics tells us you can’t conduct research on people without their consent. While ed research may not be as intrusive or potentially directly harmful as, say, a clinical trial, you can harm children by subjecting them to a treatment that hinders their learning. Now, this should work to stop people like boaler but, really, what she’s doing is using a publisher to shortcut the research process. More on that in a sec.

It’s not the job of academic researchers to implement and enforce accountability laws, that should be done by the state education departments. If I’m evaluating whether a math curriculum is effective, the question of school accountability should not be addressed anyway, right? Because if the kids’ failure to achieve is the fault of the curriculum, it doesn’t make sense to then tell everyone in your paper that the school is bad. It’s not what you’re studying in the first place.

What all this has done is create a two-track system of “evidence”. On one side there’s ed research just kind of doing its own thing and nobody’s really looking at it for much guidance about effective teaching and learning. It’s slow, and like a lot of academic research, is often published for other researchers. It’s actually a low-status move to publish about educational practice. Far better to develop models and theories for other academicians, at least from the perspective of an academic career.

The other track is publishers commissioning their own proprietary research that seemingly always shows their curriculum or product is effective. iReady’s Curriculum Associates publisher is getting a lot of flack about this right now. But they don’t have to deal with any of the above ethical or institutional constraints so they can be more nimble, put consent for research in the terms of service or in the contracts they sign with schools, and then do whatever analysis they want with the data to puff up their efficacy. It’s research as sales.

None of this is defending the academic education side of things, but it’s important to report on the whole mess of education research, report on it accurately, and apply critiques consistently.

Miles's avatar

How is this NOT a colossal scandal?!?

"Among the education papers where they were eventually able to get enough data to check the results, they found zero results that were precisely reproducible — literally none of them."

83 more comments...

Ready for more?