CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING
The paper presents the results of experiments conducted with the aim of a comparative analysis of the performance of the existing cloud services for natural language processing in Russian. The article provides an overview of 10 cloud services: TextRazor, RosetteTextAnalytics, EurekaEngine, CloudNatu...
Main Authors: | , , , , |
---|---|
Format: | Article in Journal/Newspaper |
Language: | Russian |
Published: |
The Fund for Promotion of Internet media, IT education, human development «League Internet Media»
2018
|
Subjects: | |
Online Access: | https://doi.org/10.25559/SITITO.14.201804.872-880 https://doaj.org/article/8490799abf9a408aaf817d22a88b0cd8 |
id |
ftdoajarticles:oai:doaj.org/article:8490799abf9a408aaf817d22a88b0cd8 |
---|---|
record_format |
openpolar |
spelling |
ftdoajarticles:oai:doaj.org/article:8490799abf9a408aaf817d22a88b0cd8 2023-05-15T18:30:53+02:00 CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING Ravil I. Mukhamediev Adilkhan Symagulov Yan I. Kuchin Sabina Abdullayeva Farida N. Abdoldina 2018-12-01T00:00:00Z https://doi.org/10.25559/SITITO.14.201804.872-880 https://doaj.org/article/8490799abf9a408aaf817d22a88b0cd8 RU rus The Fund for Promotion of Internet media, IT education, human development «League Internet Media» http://sitito.cs.msu.ru/index.php/SITITO/article/view/453 https://doaj.org/toc/2411-1473 doi:10.25559/SITITO.14.201804.872-880 2411-1473 https://doaj.org/article/8490799abf9a408aaf817d22a88b0cd8 Современные информационные технологии и IT-образование, Vol 14, Iss 4, Pp 872-880 (2018) Natural language processing (NLP) Word processing Cloud services Software as a service (SaaS) Natural language texts processing Part of speech tagging Named entity recognition Sentiment analysis Text categorization Accuracy Precision Recall Harmonic average Electronic computers. Computer science QA75.5-76.95 article 2018 ftdoajarticles https://doi.org/10.25559/SITITO.14.201804.872-880 2022-12-31T10:17:32Z The paper presents the results of experiments conducted with the aim of a comparative analysis of the performance of the existing cloud services for natural language processing in Russian. The article provides an overview of 10 cloud services: TextRazor, RosetteTextAnalytics, EurekaEngine, CloudNaturalLanguage, Texterra, Pullenti, NER-ru, UDPipe, AOT, DeepPavlov. Quantitative studies of their performance were made for 6 of them. In the process of evaluating services, the execution of such functions as the part of speech tagging, sentiment analysis, named entity recognition and the categorization of texts were analyzed. For a comparative assessment of the quality of the services, the following competition materials were used: factRuEval-2016 (named entities), AlemResearch (sentiment) and the corpora, Taiga and OpenCorpora (part of speech). The named entities recognition quality was evaluated by calculating Accuracy, Precision, Recall, and F1 parameters. As a result of the study, it was shown that when solving natural language text processing tasks in Russian, the best result is shown by the EurekaEngine service for recognizing named entities and sentiment analysis of the text, RosetteTextAnalytics service proved best in part of speech tagging the and TextRazor service in text categorization. Article in Journal/Newspaper taiga Directory of Open Access Journals: DOAJ Articles Ner ENVELOPE(6.622,6.622,62.612,62.612) |
institution |
Open Polar |
collection |
Directory of Open Access Journals: DOAJ Articles |
op_collection_id |
ftdoajarticles |
language |
Russian |
topic |
Natural language processing (NLP) Word processing Cloud services Software as a service (SaaS) Natural language texts processing Part of speech tagging Named entity recognition Sentiment analysis Text categorization Accuracy Precision Recall Harmonic average Electronic computers. Computer science QA75.5-76.95 |
spellingShingle |
Natural language processing (NLP) Word processing Cloud services Software as a service (SaaS) Natural language texts processing Part of speech tagging Named entity recognition Sentiment analysis Text categorization Accuracy Precision Recall Harmonic average Electronic computers. Computer science QA75.5-76.95 Ravil I. Mukhamediev Adilkhan Symagulov Yan I. Kuchin Sabina Abdullayeva Farida N. Abdoldina CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
topic_facet |
Natural language processing (NLP) Word processing Cloud services Software as a service (SaaS) Natural language texts processing Part of speech tagging Named entity recognition Sentiment analysis Text categorization Accuracy Precision Recall Harmonic average Electronic computers. Computer science QA75.5-76.95 |
description |
The paper presents the results of experiments conducted with the aim of a comparative analysis of the performance of the existing cloud services for natural language processing in Russian. The article provides an overview of 10 cloud services: TextRazor, RosetteTextAnalytics, EurekaEngine, CloudNaturalLanguage, Texterra, Pullenti, NER-ru, UDPipe, AOT, DeepPavlov. Quantitative studies of their performance were made for 6 of them. In the process of evaluating services, the execution of such functions as the part of speech tagging, sentiment analysis, named entity recognition and the categorization of texts were analyzed. For a comparative assessment of the quality of the services, the following competition materials were used: factRuEval-2016 (named entities), AlemResearch (sentiment) and the corpora, Taiga and OpenCorpora (part of speech). The named entities recognition quality was evaluated by calculating Accuracy, Precision, Recall, and F1 parameters. As a result of the study, it was shown that when solving natural language text processing tasks in Russian, the best result is shown by the EurekaEngine service for recognizing named entities and sentiment analysis of the text, RosetteTextAnalytics service proved best in part of speech tagging the and TextRazor service in text categorization. |
format |
Article in Journal/Newspaper |
author |
Ravil I. Mukhamediev Adilkhan Symagulov Yan I. Kuchin Sabina Abdullayeva Farida N. Abdoldina |
author_facet |
Ravil I. Mukhamediev Adilkhan Symagulov Yan I. Kuchin Sabina Abdullayeva Farida N. Abdoldina |
author_sort |
Ravil I. Mukhamediev |
title |
CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
title_short |
CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
title_full |
CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
title_fullStr |
CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
title_full_unstemmed |
CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING |
title_sort |
cloud services for natural language processing |
publisher |
The Fund for Promotion of Internet media, IT education, human development «League Internet Media» |
publishDate |
2018 |
url |
https://doi.org/10.25559/SITITO.14.201804.872-880 https://doaj.org/article/8490799abf9a408aaf817d22a88b0cd8 |
long_lat |
ENVELOPE(6.622,6.622,62.612,62.612) |
geographic |
Ner |
geographic_facet |
Ner |
genre |
taiga |
genre_facet |
taiga |
op_source |
Современные информационные технологии и IT-образование, Vol 14, Iss 4, Pp 872-880 (2018) |
op_relation |
http://sitito.cs.msu.ru/index.php/SITITO/article/view/453 https://doaj.org/toc/2411-1473 doi:10.25559/SITITO.14.201804.872-880 2411-1473 https://doaj.org/article/8490799abf9a408aaf817d22a88b0cd8 |
op_doi |
https://doi.org/10.25559/SITITO.14.201804.872-880 |
_version_ |
1766214494201053184 |