ORIGINAL ARTICLE
Linguistic Features Embedded in Arabic Transformers: A Feature
Ablation Study for E-Commerce Deepfake Detection
More details
Hide details
1
Department of Information and Computer Science, King Fahd University of Petroleum & Minerals, Saudi Arabia
2
Department of Information and Computer Science, King Fahd University of Petroleum & Minerals, Dhahran, Saudi Arabia
3
Department of Computer Sciences, College of Computer and Information Sciences, Princess
Nourah Bint Abdulrahman University, Saudi Arabia
Submission date: 2026-04-23
Final revision date: 2026-05-27
Acceptance date: 2026-08-24
Publication date: 2026-11-16
Corresponding author
Tarek Helmy
Department of Information and Computer Science, King Fahd University of Petroleum & Minerals, 31261, Dhahran, Saudi Arabia
Journal of Undergraduate Research International 2026;2(3B):67-73
KEYWORDS
TOPICS
ABSTRACT
Traditionally, Arabic natural language processing pipelines apply aggressive preprocessing, including removing punctuation, normalizing
characters, and eliminating emojis, based on the assumption that cleaner inputs yield better model performance. This study
investigates the linguistic features embedded in Arabic transformer models for detecting synthetic product listings in e-commerce
environments. We conducted a systematic ablation study to evaluate the impact of removing individual linguistic feature categories
on the classification performance of four Arabic transformer models. Our results show that preprocessing Arabic e-commerce text
is not simply a matter of removing noise: the punctuation functions as a consistent structural signal across all architectures, numeric
characters and English text behave as model-dependent specification-carrying signals, and emojis have no measurable effect across
the models. These findings provide a practical framework for understanding the linguistic features embedded in Arabic transformers
for e-commerce deepfake detection and suggest that preprocessing pipelines should preserve domain-relevant structures, rather
than aggressively applying uniform cleaning.