跳到正文
返回论文列表
cs.CL提交于 已译

多任务学习句法增强的极性分类

Polarity Classification with Multitask Learning Syntax Augmentation

Muhammad Imran · Carlos G\'omez-Rodr\'iguez

中文摘要

情感分析(SA)是识别和归类文本中主观信息的基础NLP任务。基于词典的方法透明但难以处理否定和强化等语言现象。将句法分析集成到SA流程可缓解此问题,但传统解析器带来显著计算开销。近期工作表明,将依存句法分析重构为序列标注(SEL)任务可提升效率。提出并比较两种在统一多任务学习(MTL)框架下将句法知识集成到神经情感分析模型的策略:Standard-MTL用共享编码器和两个任务特定头联合学习依存句法分析(通过序列标注)和情感极性分类;Contrastive-MTL通过对比辅助目标和句法偏置注意力池化机制提供隐式句法指导,无需显式标签预测。两者训练时依赖句法标注,推理时无需手工组合规则或外部解析。在覆盖七种语言的11个数据集上评估——MARC语料库(英语、西班牙语、法语、德语)和SemEval-2022 Task 10的7个数据集(英语、西班牙语、挪威语、巴斯克语、加泰罗尼亚语)——使用四种已有SEL编码。采用相对编码时,Contrastive-MTL在11个数据集中的10个上优于无句法基线,并在后者适用的全部6个数据集上超过推理时解析的外部规则流程(SELSP),评估速度快1.5–9倍。Standard-MTL更依赖数据集和编码。结果表明训练时的隐式句法监督可在无计算开销下匹配或超过推理时的显式解析。

关键要点

  1. 01将依存句法分析重构为序列标注,降低传统解析器的计算开销
  2. 02提出Standard-MTL与Contrastive-MTL两种多任务集成策略
  3. 03Contrastive-MTL在11个数据集中10个优于无句法基线,速度快1.5–9倍
  4. 04Standard-MTL性能更依赖数据集与SEL编码选择
  5. 05训练时隐式句法监督可替代推理时显式解析且无额外开销

解读

尚无解读。

原始英文摘要

arXiv:2611.08323v1 Announce Type: new Abstract: Sentiment Analysis (SA) is a fundamental NLP task concerned with the identification and categorization of subjective information in text. While lexicon-based methods offer transparency, they often struggle with linguistic phenomena such as negation and intensification. Syntactic parsing has been integrated into SA pipelines to address this, but conventional parsers introduce significant computational overhead. Recent work shows that reformulating dependency parsing as a Sequence Labeling (SEL) task can improve efficiency. We propose and compare two strategies for integrating syntactic knowledge into a neural sentiment analysis model under unified Multi-Task Learning (MTL). The first, Standard-MTL, jointly learns dependency parsing (via sequence labeling) and sentiment polarity classification using a shared encoder with two task-specific heads. The second, Contrastive-MTL, provides implicit syntactic guidance through a contrastive auxiliary objective and a syntax-biased attention pooling mechanism, without requiring explicit label prediction. Both rely on syntactic annotations during training and eliminate need for hand-crafted compositional rules or external parsing at inference. We evaluate eleven datasets spanning seven languages---the MARC corpus (English, Spanish, French, German) and seven datasets from SemEval-2022 Task 10 (English, Spanish, Norwegian, Basque, Catalan)---using four established SEL encodings. With the relative encoding, Contrastive-MTL outperforms a syntax-naive baseline on 10 of 11 datasets and surpasses the external rule-based pipeline (SELSP) that parses at inference on all six datasets where the latter applies, while being 1.5--9$\times$ faster at evaluation. Standard-MTL is more dataset- and encoding-dependent. These results show implicit syntactic supervision during training can match or exceed explicit parsing at inference without computational overhead.

同方向论文 · cs.CL

查看全部 →