Moshe Stekel ; Amos Azaria ; Shai Gordin - Word Sense Induction with Attentive Context Clustering

jdmdh:9175 - Journal of Data Mining & Digital Humanities, June 8, 2022, NLP4DH -
Word Sense Induction with Attentive Context Clustering

Authors: Moshe Stekel ; Amos Azaria ; Shai Gordin

This paper presents ACCWSI (Attentive Context Clustering WSI), a method for Word Sense Induction, suitable for languages with limited resources. Pretrained on a small corpus and given an ambiguous word (a query word) and a set of excerpts that contain it, ACCWSI uses an attention mechanism for generating context-aware embeddings, distinguishing between the different senses assigned to the query word. These embeddings are then clustered to provide groups of main common uses of the query word. We show that ACCWSI performs well on the SemEval-2 2010 WSI task. ACCWSI also demonstrates practical applicability for shedding light on the meanings of ambiguous words in ancient languages, such as Classical Hebrew and Akkadian. In the near future, we intend to turn ACCWSI into a practical tool for linguists and historians.

Volume: NLP4DH
Published on: June 8, 2022
Accepted on: April 14, 2022
Submitted on: March 5, 2022
Keywords: clustering,nlp,wsi,wsd,[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]


Consultation statistics

This page has been seen 80 times.
This article's PDF has been downloaded 27 times.