TY - JOUR
T1 - Detecting Sarcasm in Multiple Modalities by Leveraging Sarcasm Type Correlations
AU - Chang, Jeremy
AU - Hsu, Chia Yun
AU - Wu, Chung Hsien
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2026
Y1 - 2026
N2 - Sarcasm detection is essential for accurately interpreting communication in applications such as dialogue systems. However, most existing approaches treat sarcasm as a single phenomenon and ignore the linguistic distinction between illocutionary, embedded, and propositional sarcasm, each of which relies on different contextual and emotional cues. In this work, we propose a type-aware multimodal framework that explicitly models these three sarcasm types by training dedicated representations for each and combining them within a unified architecture. To encourage the learning of emotionally informative features, we incorporate explicit and implicit emotion prediction as auxiliary regularization tasks in a multitask learning setting. Experiments on the multimodal sarcasm dataset MUStARD++ show that our system achieves an F1 score of 82.65% in sarcasm detection. These results demonstrate that type-specific modeling improves multimodal sarcasm detection.
AB - Sarcasm detection is essential for accurately interpreting communication in applications such as dialogue systems. However, most existing approaches treat sarcasm as a single phenomenon and ignore the linguistic distinction between illocutionary, embedded, and propositional sarcasm, each of which relies on different contextual and emotional cues. In this work, we propose a type-aware multimodal framework that explicitly models these three sarcasm types by training dedicated representations for each and combining them within a unified architecture. To encourage the learning of emotionally informative features, we incorporate explicit and implicit emotion prediction as auxiliary regularization tasks in a multitask learning setting. Experiments on the multimodal sarcasm dataset MUStARD++ show that our system achieves an F1 score of 82.65% in sarcasm detection. These results demonstrate that type-specific modeling improves multimodal sarcasm detection.
UR - https://www.scopus.com/pages/publications/105027041240
UR - https://www.scopus.com/pages/publications/105027041240#tab=citedBy
U2 - 10.1109/ACCESS.2025.3650719
DO - 10.1109/ACCESS.2025.3650719
M3 - Article
AN - SCOPUS:105027041240
SN - 2169-3536
VL - 14
SP - 3606
EP - 3617
JO - IEEE Access
JF - IEEE Access
ER -