Critics of Peer Review Ask How ‘Race Science’ Still Manages to Slip Through

Two scientific papers in South Africa have raised questions among critics about the quality — and potential biases — of international peer review.

As soon as Barbara Boswell began reading the journal article, the associate professor of English at the University of Cape Town (UCT) in South Africa says she was surprised about the language it used. Even the title and the abstract set alarm bells ringing, she recalled. “As I read further, I saw more problems.”

“The article is published as scientific research but draws on colonial stereotypes of African women.”

The controversial paper, “Age- and education-related effects on cognitive functioning in Colored South African women,” was published in March in the journal Aging, Neuropsychology, and Cognition following peer review. The authors, from South Africa’s Stellenbosch University, claimed to show “low cognitive functioning” in this group, which they attributed to low education levels and risky lifestyles. (In South Africa, “colored” is one of the four officially recognized racial categories — a relic of the apartheid system — along with white, Indian/Asian, and black African.)

In April, Boswell spearheaded a petition for the journal to issue a retraction. “The article is published as scientific research but draws on colonial stereotypes of African women, and ‘colored’ South African women specifically, as intellectually deficient,” Boswell and her co-authors wrote. “The article relies on flawed methodology and science, perpetuating harmful, racist stereotypes.”

More than 10,000 people, including scholars and ordinary citizens, signed the petition, which was ultimately successful: The journal retracted the paper on May 2. But this wasn’t the only recent scientific article in South Africa to face fierce criticism on its methodology and treatment of race. A second paper, also published in March in the Journal of Interdisciplinary Economics, claimed to show that inhabitants of countries with lower IQs were more likely to be sold as slaves between the 15th and 20th centuries. Following an outcry, the co-author resigned from his position as an adjunct professor at the UCT.


Love Undark? Sign up for our newsletter!


Together, the papers raise questions regarding how such research made it through peer review, a process in which academics validate studies prior to publication. Peer review is considered by many researchers and academics to be the best quality-check for scholarship, but others point out that it can be flawed, opaque, and susceptible to bias.

Both papers were subjected to reviewers in internationally-published journals despite appearing to dabble in race science, which regards race not as cultural construct, but as a biological variable that can be used to make allegedly scientific conclusions about groups of people. Many experts consider biological notions of race to be largely debunked, making the appearance of such research in the global literature, where it can then be used to undermine the rights and dignity of entire communities, particularly problematic. “Scientific racism was used to justify racist policies like apartheid,” says Boswell. “It was used to make an argument about the inferiority of black people, indigenous people, and why they needed stewardship because they were not fully capable of looking after themselves and the land.”

The two papers show “how shoddy peer review can be at times,” says Agustín Fuentes, an anthropologist at the University of Notre Dame. “The ideal is good — great, in fact — but it does not always work out. I think that there are also a lot of biases about race and gender in the academy in general. And in too many cases those biases go unchallenged and result in things like these getting in to print.”


It has been 25 years since the end of South Africa’s apartheid government, which separated people based on race and often relied on flawed race science as justification, and the country still struggles with racial tension and systemic divisions that drive inequality. The academic system reflects these realties: White researchers still occupy half of all university posts despite accounting for just 8 percent of the population, and they publish about two-thirds of academic research.

The generalizations about a particular population group “become spurious and a real indicator of poor science.”

Stellenbosch University, for instance, was mainly reserved for white students and staff under the Afrikaans-speaking apartheid government. The school has been attempting to address its racist past and transform its university body by increasing scholarships to previously disadvantaged racial groups, hiring more diverse staff, and switching from Afrikaans to English as the main medium of instruction. Eugene Cloete, the vice-rector for research, innovation, and postgraduate studies at Stellenbosch, says that the paper on colored women has set the university “back years.”

Cloete suspects there might be other published articles from the university with racist assumptions, and he is personally reviewing thousands of ongoing projects for racial insensitivity. Still, he says, some blame should lie with the journals. The paper “was published in an international, peer-reviewed journal,” he says. “We publish 1,800 papers a year here through thousands of different journals. We have to rely on peer review.”

Cloete and Boswell, along with other researchers, argue that peer review should have caught what they say is flawed research in the Stellenbosch study. The study’s authors, a team of sports scientists, assessed self-identified colored women from a township in the Western Cape. The sample size was limited, with just 60 women, but they extrapolated the results to apply to millions of people. The researchers also made assumptions about the group, identifying it as racially homogenous when it was actually diverse. And, based on a measure of cognitive ability that has been shown to be inapplicable to South African populations, the researchers made sweeping claims about the poor cognitive abilities of colored women in general.

“The study is based on ideological assumptions that are deeply rooted in a racialized and racist history,” says Garth Stevens, president-elect of the Psychological Society of South Africa. “Those assumptions are overlaid with a set of scientific methods that are themselves fatally flawed.” As a result, the generalizations about a particular population group “become spurious and a real indicator of poor science.”

Corresponding author on the paper, sports scientist Elmarie Terblanche, said she was not allowed to comment as the matter was under investigation.

The academic publisher, Taylor & Francis Group, confirmed that the article was peer-reviewed, but that editors retracted it after Boswell’s petition took off. When Undark asked the organization for comment, press coordinator Saskia Kovandzich said “I’m afraid that nobody is available to discuss this issue with you.”

  • In 2015, students at the University of Cape Town sparked a new wave of anti-colonialist protests across South Africa. Their first victory was the removal of a Cecil John Rhodes statue on campus, which they said represented institutionalized racism.

    Visual: Roger Sedres/Gallo Images via Getty


While the Stellenbosch article was retracted, the one on slavery and IQ was not. That article, “Intelligence and Slave Exports from Africa,” was published by a team of economists in the Journal of Interdisciplinary Economics by Sage Publishing on March 28. The team claims to show that African countries where people have higher IQs experienced lower levels of slave exports than countries which had lower “cognitive ability.”

It remains unclear why, exactly, the papers from Stellenbosch and UCT made it through peer review.

The lead author, economist Simplice Asongu, listed UCT as his institution on the paper, but he was an adjunct professor rather than a full staff member, says Elijah Moholola, a university spokesperson. And the university doesn’t stand behind the findings, Moholola adds: “UCT rejects the assumptions of the paper and this line of research as bad science.” Asongu has since resigned.

Sage did not respond to an interview request.

Like the Stellenbosch study, the methodology of the UCT paper came under scientific scrutiny. The paper claims to prove that countries with higher average IQs saw fewer inhabitants sold into slavery because they were smarter and thus better able to escape, confront enslavers, and organize resistance.

Asongu and his co-author, Oasis Kodila-Tedika, an economist at the University of Kinshasa, show this through linking, among other variables, countries’ IQ; their capacity for technology adaptation, inferred from previous research; the landscape’s ruggedness; and historical population density.

The authors assume most types of intelligence can be captured through IQ tests. But the idea that it is possible to determine the cognitive ability of entire countries is problematic, says Adam Haupt, a professor in media studies, who specializes in race discourse. He points out that there is plenty of research showing IQ tests can be inaccurate and unfair. “There’s a cultural and ideological bias embedded in those tests,” Haupt says. “Science is seen as non-ideological, but we know that’s not true.”

When Undark contacted Asongu for comment, he said he wouldn’t discuss the matter through non-scientific media, adding: “Anybody questioning the robustness of the findings should have his or her comments peer-reviewed and published in a scientific medium, then I will also respond through the same scientific medium or other scientific media.”

But peer review is part of the problem. “If it was a predatory journal” — a journal which charges researchers to publish, but doesn’t offer rigorous services such as peer review — “then you’d understand it,” says Haupt. But “Sage is a reputable publisher. It has you asking questions about their peer review process. All of the supposed safeguards fell flat. Why did editors not ask how sound was this methodological approach? How much do we know about IQ?”


It remains unclear why, exactly, the papers from Stellenbosch and UCT made it through peer review. “A charitable interpretation would be laziness and genuine oversight on the part of the reviewers,” says Angela Saini, a science journalist and author of “Superior: The Return of Race Science,” a new book on the resurgence of race science since it fell out of favor following World War II.

“What does it mean to be a scientist in a world that is trying to undo colonialism, systemic racism, sexism?”

“A less charitable one is that they let this through because they share with the authors some commitment to the idea of biological race — an idea long ago discredited by mainstream scientists,” she adds. “Either way, the system must be flawed in some way or this wouldn’t have happened.”

Regardless of the reason why, it’s common for faulty papers to slip through peer review, says Ivan Oransky, co-founder of Retraction Watch, a watchdog publication for scientific publishing. “There are 1,400 retractions per year, and there are others that should be retracted but aren’t,” he says. “Peer review is a porous system.”

Recent reports reveal that system is under pressure. A 2016 study in PlosOne, looking at biomedical research, found that the responsibility for peer review is concentrated in the hands of a few reviewers. At the same time, the volume of scholarship requiring peer review continues to increase at about 3 to 3.5 percent each year. And there is also bias when it comes to who gets to be a peer reviewer. In its Global State of Peer Review 2018 report, for instance, the peer-review tracking website Publons found that established regions review more than emerging regions; in fact, there was not an African country in the top 20 nations that supplied reviews. And an investigation into gender and international diversity at the biosciences journal eLife found that an all-male review team was more likely to accept papers with male authors, and gatekeepers were also more likely to accept papers whose authors were from the same country as them.

“Humans are fallible and peer review has subjective aspects to it,” explains Cassidy Sugimoto, a professor of informatics at Indiana University, Bloomington and a co-author on the paper.

Part of that subjectivity comes from personal worldviews, but it also encompasses the scholarship reviewers and researchers are exposed to. Editors tend to choose reviewers who have read the same body of literature, Sugimoto adds, and may be oblivious to valid work disproving their viewpoint. In the case of race, there is plenty of well-established scholarship, she says, but mostly in fields that are unfamiliar to researchers and reviewers.

“A number of disciplines outside of the humanities need to engage across those boundaries to think critically about what they do as researchers,” says Haupt. “What does it mean to be a scientist in a world that is trying to undo colonialism, systemic racism, sexism? How do you undo the systemic racism, sexism?”

“You need to interrogate your position and the history of your scholarship,” he adds.

Still, there are moves to change the system. One way is to have a more diverse pool of reviewers, Sugimoto says. Another is to have partially open peer review, where reviewers and authors know one another’s identity and their comments are public.

“If peer review is the mechanism to determine validity of work, open peer review would be accountability and transparency,” Sugimoto says, although she adds that this could spark other problems, such as junior reviewers damaging their careers by openly challenging a senior academic. One way to avoid this would be to make only the reviews, rather than the reviewers’ identities, public.

These fixes, perhaps, could have halted the publication of the papers about colored women or countries that experienced slavery. “I’m sure there are lots of pieces of research like this,” says Boswell.

Such work “doesn’t come out of nowhere,” she adds. “This comes out of a context.”


Sarah Wild is a freelance science journalist based in Johannesburg, South Africa.

Top visual: Anadolu Agency / Contributor via Getty
See What Others Are Saying

17 comments / Join the Discussion

    This article is complete garbage. Nothing more than pointing and sputtering and conclusion you don’t like A media studies professor commenting on an intelligence/economics paper? Haha, this is it’s such a transparent hit piece. Did you just take out the darts and hit on a liberal professor did service you with the quote you wanted? It’s almost like “reporters” just an editorial line and then go hunting for a mouthpiece.

    Not a single substantial reason is given for the retraction of the first paper. It is simply outrageous that petitions from the public would result in a retraction of anything. Science is not some degenerate democratic process.

    The appropriate mechanism is scientific falsification — write and publish another paper. You don’t get to memory-hole a paper you don’t like. This is Stalinesque rubbish.

    Reply

    What does it mean to be a scientist in a world that is trying to undo colonialism, systemic racism, sexism? How do you undo the systemic racism, sexism?”

    The function of a scientist is scientific unbiassed research based on facts like the variation of IQ in peoples across the planet. A scintist should leave the other crusades mentioned to others or detach it from their work.

    More knowledge about IQ and race should be harnessed to reduce systematic racism. We are all varied, equal human beings.

    Reply

    As a researcher and educational psychologist trained at UC Berkeley I am intimately acquainted with the IQ debate and can assure you all that, as Sarah Wild asserts, no one with any training in the field would dream of using IQ as a “national characteristic”. No one would even try to validate a cognitive measure such as non-verbal IQ, which is less culturally loaded, on a population-wide basis. The IQ test was designed to predict educational success on an individual basis. The idea that this construct was borrowed by an economist to demonstrate a historical theory is in itself dubious. The idea of a bunch of sports scientists dabbling in psychology and being taken seriously is alarming. If anyone’s capabilities is now under the microscope it is the authors, associates, and peer reviewers of these two studies.

    Reply

    this approach of removing certain terms such as IQ to discuss factors associated with a specific outcome is a weak attempt to cleanse science. we use socioeconomic terms to convey the same ideas. Population selection covers many sins. i’m more concerned about the hypothese that were being tested in the papers

    Reply

    ——- genetic selection works in every animal except humans ? dogs breed true. horses, cows, cats, etc.

    Reply

    Proven Little wayne…some different humans of all sizes, shapes, nationalities, cultures, ARE Just as smart, Proven able and stable Minded. You seem a bit Questioned in your Question yourself as hmmmm lett’s be kkkkinnndddd and say…Lesser!!! Little wayney

    Reply

    I’m sorry, isn’t the title of this website UNdark? How is squashing scientific research within the spirit of your mission? If the findings are unsupported/easy to debunk, so be it, but I find it scary to declare that the very subject is taboo.

    Reply

    This is a truly funny argument, you are okay with false, misleading, and racist research being published and believe that when researchers debunk it people will say “oh I got it all wrong, thanks for debunking”. Have you been living in a cave? What happened when the link between vaccines and autism was debunked again and again and the paper was retracted? There is still an anti-vaxx movement and it is growing thanks to the use of debunked research. There are still people who believe that man never landed on the moon even with all the evidence to the contrary. You still read about people believing the Earth is flat even when the ancient Greeks knew the Earth was not flat. The goal of peer-review should be to weed out false, misleading, racist, and fake research before it even gets published because once it is out there it gets weaponized by people who seek to use it to oppress, alienate, and profit from it.

    Reply

    Because the article wasn’t retracted because it was false or misleading, it was retracted because its findings were determined to be racist. Like the research paper suggesting wider variance in male performance in mathematics leading to higher achievement at the top of the field, that was then retracted because the findings were declared sexist. The problem, my “friend,” is when we allow science to be quashed by our social values. This doesn’t strike me as the fake news issue you have framed it as.

    Reply

    I’m a bit unclear with your response. What subject do you feel is being declared taboo?

    Reply

    Truth is in the Translation. This is Not Truth it’s Bull poop. You need a helping spoon for your share.

    Reply

    Academics can try to sweep these papers under the carpet simply by screaming racism, but that in itself does not debunk the findings of these papers. I would always prefer to debate the findings scientifically than have them squashed by playing the race card and political correctness.

    Reply

    Hold up, so you believe that colored women have low cognitive functions or that the African countries where slavery existed were lower IQ. How come you feel this way? What research have you read to make you believe this? Have you lived with or engaged with colored women in South Africa?

    Reply

    I did not hear anyone screaming racism. I read an article that discussed people trying to pass off academic papers that used debunked science regarding out notions about race. I also read that one of the reasons they may have slipped through was because the reviewers subconsciously may agree with what they are reading. Look at it this way: I write a paper claiming that eating high fat ice cream is good for the health. I write it despite information to the contrary. I submit it for review and my reader is someone who is looking for a reason to eat ice cream all day everyday. It gets published. Reader and writer are happy. The ice cream board is happy. Does it now become true?

    Reply

    Right, because you read what you wanted to in this article. I read a piece on a research paper that was retracted, under the guise of unsupported research, that was really pulled because the findings were contrary to social norms.

    Reply

    Sip hi we we, your sickness of biases, stems from old sicknesses. Please get a grip on reality there is Not a shred of actual science in these lies and exaggerations of Untruthful sickness.

    Reply

    It may well take generations, if ever, or a major random event, to have racism eliminated. Or minimized .

    Reply
Join the discussion

Your email address will not be published. Required fields are marked *

Top

Whistleblowers
& Tipsters

Corruption in science?
Academic discrimination?
Research censorship?
Government cover-ups?

Undark wants to hear about it.

Email us at tips@undark.org, or visit our contact page for more secure options.