TRIDENT 与 SHAKTI:印地语 AI 生成文本检测框架与基准
TRIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection
印地语这类低资源语言一直缺 AI 文本检测基准,这篇给出了 SHAKTI 数据集和 TRIDENT 检测方法,还测了 7 种语言,做低资源语言检测的可以看看。
研究团队发布 SHAKTI 基准,覆盖 4 种文体、8 个 LLM 家族、多种提示策略和对抗变换,用于印地语 AI 生成文本检测。基于人类标注分析人写与 AI 文本的语言、语法和情感差异后,提出基于往返翻译语义一致性的 TRIDENT 检测框架,含 TRIDENT-S(静态阈值)、TRIDENT-D(动态阈值)、TRIDENT-C(逻辑回归)三个变体。实验显示 TRIDENT-S 综合表现最佳,超越常规和监督基线,并在 7 种语言、对抗场景和未见过的 LLM 上验证了泛化能力。研究同时指出检测效果对所用翻译模型较为敏感。
TRIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection
As Large Language Models (LLMs) become increasingly multilingual, distinguishing human-written from AI-generated text is essential for maintaining information integrity. However, research remains English-centric, with limited benchmarks for low-resource languages such as Hindi. To address this gap, we introduce SHAKTI, a large-scale Hindi benchmark covering four genres, eight LLM families, multiple prompting strategies, and adversarial transformations. We evaluate its quality through human annotation and analyze linguistic, grammatical, and sentiment-based differences between human- and AI-generated texts. Building on these findings, we propose TRIDENT, a round-trip translation-based detection framework with three variants: TRIDENT-S (static threshold), TRIDENT-D (dynamic threshold), and TRIDENT-C (logistic regression using multi-distance RTT features). TRIDENT leverages semantic consistency between original and round-trip translated texts to identify AI-generated content. Extensive experiments show that TRIDENT outperforms conventional and supervised baselines, with TRIDENT-S achieving the best overall performance. Further evaluations across seven languages, adversarial settings, and unseen LLMs demonstrate its multilingual applicability and robustness, while highlighting sensitivity to the translation model.