1

Topic: Library for analysis of texts

Greetings! I at all in a subject, and therefore cannot correctly state to unwinding thought, so do not judge too severely. In general, it is necessary  which on an input receives Russian sentences / English, and produces machine representation (probably, in the form of a tree) from which it is possible to understand, what word a verb/adjective/noun, relations between words, ... How this direction generally is called? What  for this purpose exist? Who what used? Thanks.

2

Re: Library for analysis of texts

Hello, niXman, you wrote: X> in general, it is necessary  which on an input receives Russian sentences / English, and produces machine representation (probably, in the form of a tree) from which it is possible to understand, what word a verb/adjective/noun, relations between words, ... It is called syntactic analysis. Good algorithms are not present at anybody. Generally at anybody. The natural language is ambiguous also knows nobody that with it to do. "He met her on a glade with colors". Make analysis of this phrase by natural intelligence.

3

Re: Library for analysis of texts

Hello, alpha21264, you wrote: A> It is called syntactic analysis. Apprx. A> Good algorithms are not present at anybody. Generally at anybody. And what are? Well though any should be. For certain even in ... A> the natural language is ambiguous also knows nobody that with it to do. That it is clear. A> "he met her on a glade with colors". Make analysis of this phrase by natural intelligence. If the algorithm can to me is assured to disassemble at least "It her met on a glade" is already super! There are any translators, , ... Should be and .

4

Re: Library for analysis of texts

Hello, niXman, you wrote: X> there are any translators, , ... Should be and . Is, but quality at them so-so. Machine translation to these is enough curve. And  in a Word permanently drives snowstorm on analysis of sentences.

5

Re: Library for analysis of texts

Hello, niXman, you wrote: X> as this direction generally is called? Natural Language Processing X> what  for this purpose exist? Who what used? alpha21264 somehow pessimistically a state of affairs in this area described. In my opinion, NLP as one of directions AI, now develops, for example  in a type  try to put inside. But I the artificial welder, can be mistaken. And so with NLP it is possible to begin acquaintance with one of awesome lists, we tell https://github.com/keonkim/awesome-nlp

6

Re: Library for analysis of texts

While-that  the such: http://stanfordnlp.github.io/CoreNLP/index.html http://www.nltk.org/ https://opennlp.apache.org/documentation.html https://opensource.com/business/15/7/fi … -nlp-tools

7

Re: Library for analysis of texts

For Russian that it was free and with open source codes probably only aot.ru nlpub.ru/%D0%9E%D0%B1%D1%80%D0%B0%D0%B1%D0%BE%D1%82%D0%BA%D0%B0_%D1%82%D0%B5%D0%BA%D1%81%D1%82%D0%B0 but all is such , not to compare to the closed libraries of Yandex, ABBYY, in Russian localization of Microsoft Office and generally with any commercial decisions

8

Re: Library for analysis of texts

At  is tech.yandex.ru/tomita/ tech.yandex.ru/mystem/ at abbyy ABBYY Compreno

9

Re: Library for analysis of texts

Hello, tehKosh, you wrote: K> but all is such , not to compare to the closed libraries of Yandex, ABBYY, in Russian localization of Microsoft Office and generally with any commercial decisions of Microsoft Office it is faster from discharge pinning, when they wanted to create the spelling instead of continuing to use . As Microsofts decided to "spare" on spell check. And about the remaining I do not know, but too there are doubts.

10

Re: Library for analysis of texts

Hello, niXman, you wrote: X> what  for this purpose exist? Who what used? Only just news about spaCy transversed. But I did not try. P.S. If something you will find for Russian - tell, please. In the long term too it is required to me.

11

Re: Library for analysis of texts

Hello, Nuzhny, you wrote: N> P.S. If something you will find for Russian - tell, please. In the long term too it is required to me. Yesterday on site CoreNLP while wandered, came across section with different additions, and there saw Russian support. I can not already find %)

12

Re: Library for analysis of texts

Hello, niXman, you wrote: X> yesterday on site CoreNLP while wandered, came across section with different additions, and there saw Russian support. I can not already find %) Under Google links resembles and found out different  links with Russian: here, here. It is necessary to understand them long.

13

Re: Library for analysis of texts

Hello, niXman, you wrote: X> greetings! X> I at all in a subject, and therefore cannot correctly state to unwinding thought, so do not judge too severely. X> in general, it is necessary  which on an input receives Russian sentences / English, and produces machine representation (probably, in the form of a tree) from which it is possible to understand, what word a verb/adjective/noun, relations between words, ... Here the interesting muzhik transversed: http://rsdn.org/forum/other/5789079.1 the Author: Prawda Date: 19.09.14 Not absolutely that you want. Well and suddenly? By the way, and that you want? Methods of operation with Russian and with English language should differ considerably. Attempts to stretch English methods come to an end  disappointment.

14

Re: Library for analysis of texts

X> http://www.nltk.org/ the Book is: http://www.nltk.org/book/ Natural Language Processing with Python - Analyzing Text with the Natural Language Toolkit Steven Bird, Ewan Klein, and Edward Loper This version of the NLTK book is updated for Python 3 and NLTK 3. The first edition of the book, published by O'Reilly, is available at http://nltk.org/book_1ed/. (There are currently no plans for a second edition of the book.) 0. Preface 1. Language Processing and Python 2. Accessing Text Corpora and Lexical Resources 3. Processing Raw Text 4. Writing Structured Programs 5. Categorizing and Tagging Words (minor fixes still required) 6. Learning to Classify Text 7. Extracting Information from Text 8. Analyzing Sentence Structure 9. Building Feature Based Grammars 10. Analyzing the Meaning of Sentences (minor fixes still required) 11. Managing Linguistic Data (minor fixes still required) 12. Afterword: Facing the Language Challenge Bibliography

15

Re: Library for analysis of texts

Hello, alpha21264, you wrote: A> Methods of operation with Russian and with English language should differ considerably. I think - is not present. Nouns/adjectives/verbs, I think, is  all languages. CoreNLP, for example - language . Simply you load the necessary DB with rules for specific language.

16

Re: Library for analysis of texts

Hello, niXman, you wrote: X> Hello, alpha21264, you wrote: A>> Methods of operation with Russian and with English language should differ considerably. X> I think - is not present. X> nouns/adjectives/verbs, I think, is  all languages. Aha. Just in English also is not present. open is what part of speech? Here . X> CoreNLP, for example - language . Simply you load the necessary DB with rules for specific language. Aha. Also you receive the full hogwash in half of cases.

17

Re: Library for analysis of texts

Hello, alpha21264, you wrote: A> Aha. Just in English also is not present. open is what part of speech? Here . CoreNLP it is excellent with it consults. And even with much more difficult cases. A> aha. Also you receive the full hogwash in half of cases. You mean checked up, time state? Because I checked up, and all even is better than I thought after perusal docks. Thanks for the help.

18

Re: Library for analysis of texts

Hello, niXman, you wrote: X> Hello, alpha21264, you wrote: A>> Aha. Just in English also is not present. open is what part of speech? Here . X> CoreNLP it is excellent with it consults. And even with much more difficult cases. Perfectly is how many percent? A>> aha. Also you receive the full hogwash in half of cases. X> you mean checked up, time state? X> because I checked up, and all even is better than I thought after perusal docks. Results of check in studio. PS. Certainly, I judge on commercial machine translators of type of Google and Promta. With understanding of structure of a phrase at them the big problems that in Russian that in English.