Moshe Stekel ; Amos Azaria ; Shai Gordin - Word Sense Induction with Attentive Context Clustering

jdmdh:9175 - Journal of Data Mining & Digital Humanities, 8 juin 2022, NLP4DH - https://doi.org/10.46298/jdmdh.9175
Word Sense Induction with Attentive Context ClusteringArticle

Auteurs : Moshe Stekel 1; Amos Azaria 1; Shai Gordin 1

This paper presents ACCWSI (Attentive Context Clustering WSI), a method for Word Sense Induction, suitable for languages with limited resources. Pretrained on a small corpus and given an ambiguous word (a query word) and a set of excerpts that contain it, ACCWSI uses an attention mechanism for generating context-aware embeddings, distinguishing between the different senses assigned to the query word. These embeddings are then clustered to provide groups of main common uses of the query word. We show that ACCWSI performs well on the SemEval-2 2010 WSI task. ACCWSI also demonstrates practical applicability for shedding light on the meanings of ambiguous words in ancient languages, such as Classical Hebrew and Akkadian. In the near future, we intend to turn ACCWSI into a practical tool for linguists and historians.


Volume : NLP4DH
Publié le : 8 juin 2022
Accepté le : 14 avril 2022
Soumis le : 5 mars 2022
Mots-clés : clustering,nlp,wsi,wsd,[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]

Statistiques de consultation

Cette page a été consultée 1836 fois.
Le PDF de cet article a été téléchargé 243 fois.