patrick.net

From the link:

The problem, as I showed in a lengthy rundown of the many, many problems with the test published this past January, is that there’s very little evidence to support that claim that the IAT meaningfully predicts anything. In fact, the test is riddled with statistical problems — problems severe enough that it’s fair to ask whether it is effectively “misdiagnosing” the millions of people who have taken it, the vast majority of whom are likely unaware of its very serious shortcomings. There’s now solid research published in a top journal strongly suggesting the test cannot even meaningfully predict individual behavior. And if the test can’t predict individual behavior, it’s unclear exactly what it does do or why it should be the center of so many conversations and programs geared at fighting racism.

One striking thing about the process of reporting that article was the extent to which Banaji tried to smear her critics, suggesting to me in an email she believed that critiques of the test could be explained by the fact that the IAT “scares people who say things like ‘Look, the water fountains are desegregated, what’s your problem.’” She also accused the test’s critics of having a “pathological focus” on black-white race relations and the black-white IAT for reasons that “will need to be dealt with by them in the presence of their psychotherapists or church leaders.”

This is the definition of a derailing tactic — shift the focus from critiques of the IAT itself, some of which in this case appeared in a flagship social-psych journal, to the ostensible moral and psychological failings of the critiquers.

A couple days ago, Quartz published its own article on the IAT, by Olivia Goldhill. The article covers similar ground and comes to similar conclusions as mine, and adds some new insights and analysis: The headline, “The world is relying on a flawed psychological test to fight racism,” captures things pithily. Goldhill’s piece clearly shows that Banaji and Greenwald are still trying to deflect and derail rather than fully engage with the process of evaluating their test:

https://nymag.com/intelligencer/2017/12/iat-behavior-problem.html?source=patrick.net

It captures rather nicely the racism of the plantation owners who developed the test.