← 返回资源分享
Semantic Specialisation of Distributional Word Vector Spaces using Monolingual and Cross-Lingual Constraints
论文
论文
发布时间2017-06-01
发表arXiv:1706.00374
作者:Steve Young,Nikola Mrkšić,Ivan Vulić,Anna Korhonen,Milica Gašić,Roi Reichart,Diarmuid Ó Séaghdha,Ira Leviant
详细介绍
We present Attract-Repel, an algorithm for improving the semantic quality of
word vectors by injecting constraints extracted from lexical resources.
Attract-Repel facilitates the use of constraints from mono- and cross-lingual
resources, yielding semantically specialised cross-lingual vector spaces. Our
evaluation shows that the method can make use of existing cross-lingual
lexicons to construct high-quality vector spaces for a plethora of different
languages, facilitating semantic transfer from high- to lower-resource ones.
The effectiveness of our approach is demonstrated with state-of-the-art results
on semantic similarity datasets in six languages. We next show that
Attract-Repel-specialised vectors boost performance in the downstream task of
dialogue state tracking (DST) across multiple languages. Finally, we show that
cross-lingual vector spaces produced by our algorithm facilitate the training
of multilingual DST models, which brings further performance improvements.
代码仓库 (2)
nmrksic/attract-repel官方TensorFlow
zliucr/mixed-language-training官方PyTorch
