Skip to content

Knorex R&D Team Publishes Research on Advancing Hate Speech Detection Technology

We are thrilled to announce the publication of our R&D team’s latest research paper, “Disentangling Hate Across Target Identities,” which is now available on arXiv, a highly respected and renowned open-access preprint platform backed by Cornell University. This paper takes a critical look at the challenges large language models face in accurately detecting hate speech (HS), contributing to the broader efforts to combat online hate speech and ensure brand safety.  

Our researchers, including Dr. Aneesh Moideen Koya, and Dr. Yiping Jin, delve into the limitations of current HS detection models and offer new insights on reducing bias in these systems. Here’s a summary of our key findings: 

Key Findings: 

  • Bias in Detection: Our research reveals that current HS detectors often assign disproportionately higher hatefulness scores to content mentioning certain minority groups, highlighting concerning bias in current detection algorithms. 
  • Confusion of Emotions: We observed that HS detectors frequently misinterpret negative emotions as hate speech, confusing general emotional negativity with actual hateful content. 
  • Stereotype Correlation: The effectiveness of hate speech detection can be compromised by the presence of stereotypes, impacting the models’ reliability and precision. 

This paper not only highlights significant gaps and bias in current hate speech detection models but also provides a pathway for future work aimed at mitigating these biases, ultimately enhancing brand safety. 

At Knorex, we are committed to leading the charge in protecting brands from harmful online content. The publication of this research underscores our dedication to advancing technologies that promote safer online environments for both the advertisers and consumers.