KFU. Card publication. Semantic similarity and analysis of the word frequency dynamics

KAZAN
FEDERAL UNIVERSITY

- RUS
- 中文
- ES

SEMANTIC SIMILARITY AND ANALYSIS OF THE WORD FREQUENCY DYNAMICS

Form of presentation

Articles in international journals and collections

Year of publication

2017

Язык

английский

Authors, employees of KFU

Bochkarev Vladimir Vladimirovich, author

Maslennikova Yuliya Sergeevna, author

Bibliographic description in the original language

Bochkarev V.V, Maslennikova Yu.S, Svetovidov A.A., Semantic similarity and analysis of the word frequency dynamics//Journal of Physics: Conference Series. - 2017. - Vol.936, Is.1. - Art. № 012067.

Annotation

In this study a similarity in changes of frequencies dynamics for semantically related words was analyzed using word statistics extracted from more than 4.5 million books written over a period of 205 years. The approach is based on the correlation analysis of 1-grams frequency dynamics. We analyzed the frequencies correlation of synonym pairs, their corresponding antonymous groups and random words pairs. Also, we compared several metrics to find the most effective for assessing the degree of similarity in the dynamics of use of different words. Comparing differences between logarithmic rank variations in pairs of synonyms and random word pairs, significant differences are found, though they are smaller than it could be expected.

Keywords

Semantic similarity, word frequencies, Google Books Ngram

The name of the journal

Journal of Physics: Conference Series

URL

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85041177829&doi=10.1088%2f1742-6596%2f936%2f1%2f012067&partnerID=40&md5=f7f7f0131a87fed7b322f7b3dc3cc461

Please use this ID to quote from or refer to the card

https://repository.kpfu.ru/eng/?p_id=175042&p_lang=2

Full metadata record

Field DC	Value	Language
dc.contributor.author	Bochkarev Vladimir Vladimirovich	ru_RU
dc.contributor.author	Maslennikova Yuliya Sergeevna	ru_RU
dc.date.accessioned	2017-01-01T00:00:00Z	ru_RU
dc.date.available	2017-01-01T00:00:00Z	ru_RU
dc.date.issued	2017	ru_RU
dc.identifier.citation	Bochkarev V.V, Maslennikova Yu.S, Svetovidov A.A., Semantic similarity and analysis of the word frequency dynamics//Journal of Physics: Conference Series. - 2017. - Vol.936, Is.1. - Art. № 012067.	ru_RU
dc.identifier.uri	https://repository.kpfu.ru/eng/?p_id=175042&p_lang=2	ru_RU
dc.description.abstract	Journal of Physics: Conference Series	ru_RU
dc.description.abstract	In this study a similarity in changes of frequencies dynamics for semantically related words was analyzed using word statistics extracted from more than 4.5 million books written over a period of 205 years. The approach is based on the correlation analysis of 1-grams frequency dynamics. We analyzed the frequencies correlation of synonym pairs, their corresponding antonymous groups and random words pairs. Also, we compared several metrics to find the most effective for assessing the degree of similarity in the dynamics of use of different words. Comparing differences between logarithmic rank variations in pairs of synonyms and random word pairs, significant differences are found, though they are smaller than it could be expected.	ru_RU
dc.language.iso	ru	ru_RU
dc.subject	Semantic similarity	ru_RU
dc.subject	word frequencies	ru_RU
dc.subject	Google Books Ngram	ru_RU
dc.title	Semantic similarity and analysis of the word frequency dynamics	ru_RU
dc.type	Articles in international journals and collections	ru_RU