Word Sense Induction with Closed Frequent Termsets

Marek Kozłowski , Henryk Rybiński

Abstract

The article is devoted to the problem of word sense induction. We propose a method for inducing senses from a raw text corpus. The proposed sense induction algorithm (called SenseSearcher, or SnS) is based on closed frequent sets, and as a result, it provides a multilevel sense representation. To a large extent, it is a knowledge-poor approach, as it does not need any kind of structured knowledge base about senses and there is no deep language knowledge embedded. By discovering a hierarchy of senses, the algorithm enables identifying subsenses (fine-grained senses). SnS discovers not only frequent (dominating) senses but also infrequent ones (dominated). The method was evaluated in two main areas: lexicography and information retrieval. With the use of the SnS algorithm, we provide a tool able to induce from a textual corpus a structure of senses, with a varying number of granularity levels. In the area of information retrieval, SnS can be used for clustering search result, according to the discovered senses. The experiments have shown that SnS performs better than the methods participating in the SemEval2013 WSI Task 11 competition, and most of the known search result clustering methods.
Author Marek Kozłowski II
Marek Kozłowski,,
- The Institute of Computer Science
, Henryk Rybiński II
Henryk Rybiński,,
- The Institute of Computer Science
Journal seriesComputational Intelligence, ISSN 0824-7935, e-ISSN 1467-8640
Issue year2016
Noonline: 30 May 2016
Pages1-33
Publication size in sheets1.6
Keywords in Englishword sense induction, information retrieval, search result clustering, semantic processing
DOIDOI:10.1111/coin.12091
URL http://onlinelibrary.wiley.com/doi/10.1111/coin.12091/abstract
projectDevelopment of new algorithms in the areas of software and computer architecture, artificial intelligence and information systems and computer graphics . Project leader: Rybiński Henryk, , Phone: +48 22 234 7731, start date 18-05-2015, end date 30-11-2016, II/2015/DS/1, Completed
WEiTI Działalność statutowa
Languageen angielski
File
Kozlowski_et_al-2016-Computational_Intelligence (2).pdf (file archived - login or check accessibility on faculty) Kozlowski_et_al-2016-Computational_Intelligence (2).pdf 1.3 MB
Score (nominal)20
ScoreMinisterial score = 20.0, 27-03-2017, ArticleFromJournal
Ministerial score (2013-2016) = 20.0, 27-03-2017, ArticleFromJournal
Publication indicators WoS Impact Factor: 2016 = 0.964 (2) - 2016=1.378 (5)
Citation count*0
Cite
Share Share



* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Back