Star 历史趋势
数据来源: GitHub API · 生成自 Stargazers.cn
README.md

Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmark

🎉 2026.5 Recently, we organized ToxiCN and a selection of its representative citing papers. If you are interested, please see ToxiCN-family. We hope this collection can offer a clearer view of Chinese toxicity research.

This repository will be updated from time to time with the latest research progress of the DUTIR team in Chinese hate speech detection. Welcome to follow! If you have any questions, feel free to contact us at: dut_ljy@foxmail.com.

Contents


The paper has been accepted in ACL 2023 (main conference, long paper). Paper

☠️ Warning: The samples presented in this paper may be considered offensive or vulgar.

Monitor Toxic Frame

We introduce a hierarchical taxonomy, Monitor Toxic Frame. Based on this taxonomy, posts are progressively divided into multiple granularities: (I) Whether Toxic, (II) Toxic Type (general offensive language or hate speech), (III) Targeted Group, and (IV) Expression Category (explicitness, implicitness, or reporting).

ToxiCN

We conduct fine-grained annotation on posts crawled from Zhihu and Tieba, including both direct and indirect toxic samples. The resulting ToxiCN dataset contains 12k comments covering Sexism, Racism, Regional Bias, Anti-LGBTQ, and Others. The dataset is released as ToxiCN_1.0.csv. Below we briefly describe each fine-grained label.

LabelDescription
toxicIdentify whether a comment is toxic (1) or non-toxic (0).
toxic_typenon-toxic: 0, general offensive language: 1, hate speech: 2
expressionnon-hate: 0, explicit hate speech: 1, implicit hate speech: 2, reporting: 3
target (a list)LGBTQ: Index 0, Region: Index 1, Sexism: Index 2, Racism: Index 3, Others: Index 4, non-hate: Index 5

Insult Lexicon

See: https://github.com/DUT-lujunyu/ToxiCN/tree/main/ToxiCN_ex/ToxiCN/lexicon

Baseline

We present a migratable baseline of Toxic Knowledge Enhancement (TKE) for enriching text representations. The implementation is provided in modeling_bert.py, based on transformers 3.1.0.

Licenses and Ethics Statement

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0).

The opinions and findings contained in the dataset samples should not be interpreted as representing the views expressed or implied by the authors. We acknowledge the risk of malicious actors attempting to reverse-engineer comments. We sincerely hope that users will employ the dataset responsibly and appropriately, avoiding misuse or abuse. We believe the benefits of our proposed resources outweigh the associated risks. All resources are intended solely for scientific research and are prohibited from commercial use.

Follow-up Research

Here we list some of our team's work on toxic language detection. Feel free to follow!

  • Towards Comprehensive Detection of Chinese Harmful Meme (NeurIPS2024). In this paper, we present the definition of Chinese Harmful Meme Detection to align with the Chinese online environment. and present ToxiCN MM, the first Chinese harmful meme dataset. paper repo
  • PclGPT: A Large Language Model for Patronizing and Condescending Language Detection (EMNLP2024 findings). In this paper, we focus on a specific type of implicit toxic bias, patronizing and condescending language (PCL), and leverage LLMs to detect it. paper repo
  • Towards Patronizing and Condescending Language in Chinese Videos: A Multimodal Dataset and Detector (ICASSP2025). In this paper, we introduce the PCL MM dataset, the first Chinese multimodal dataset for PCL, and propose the MultiPCL framework for detection. paper repo

Poster

CCAC_2

Cite

If you want to use the resources, please cite the following paper:

@inproceedings{lu-etal-2023-facilitating,
    title = "Facilitating Fine-grained Detection of {C}hinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks",
    author = "Lu, Junyu  and
      Xu, Bo  and
      Zhang, Xiaokun  and
      Min, Changrong  and
      Yang, Liang  and
      Lin, Hongfei",
    booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.acl-long.898",
    doi = "10.18653/v1/2023.acl-long.898",
    pages = "16235--16250",
}

关于 About

The code and resource of "Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmark" (ACL2023).

语言 Languages

Python100.0%

提交活跃度 Commit Activity

代码提交热力图
过去 52 周的开发活跃度
3
Total Commits
峰值: 2次/周
Less
More

核心贡献者 Contributors