Innovations in Information and Communication Science and Technology - 3rd Postgraduate Consortsium International Workshop IICST 2013
The 3rd Postgraduate Consortsium International Workshop IICST 2013 was organized by following members, with support from TUSUR University, Russia, and Ritsumeikan University, Japan.
In this article we report some new experiments in the area of words clustering for the Russian language. We introduce a new clustering method that distributes words into classes according to their syntactic relations. We used a large untagged corpus (about 7,2 bln of words) to collect a set of such relations. The corpus was processed using a set of finite state automata that extracts syntactically dependent combinations having explicit structure. These automata were used to process only unambiguous text fragments because of combination of these techniques increases the quality of sampled input data. The modification of group average agglomerative clustering was used to separate words between clusters. The sampled set of clusters was tested using one of the semantic dictionaries of the Russian language. The NMI score calculated in this article is equal to 0.457 and F1-score is 0.607.