Frequent Itemset Mining for Clustering Near Duplicate Web Documents

D. I. Ignatov; S. Kuznetsov

АБВ
АБВ
АБВ

Обычная версия сайта

Priority areas

by year

Subject

News

September 21, 2026

Researchers Develop Methodology to Assess the Quality of Legal Representation in Criminal Proceedings

Having a good defence attorney in criminal proceedings can largely determine whether a defendant retains their freedom, health and good name. Researchers at HSE University propose a method for predicting an attorney’s performance based on the outcomes of their previous cases. The methodology takes into account the severity of the charges, the complexity of the cases, and the most likely outcome, drawing on judicial statistics.

September 21, 2026

Algebra, Geometry, and AI: Russian and Vietnamese Mathematicians Discuss Current Research

A delegation of scientists from Hanoi visited the HSE Faculty of Computer Science and then took part in a Russian-Vietnamese conference in St Petersburg. The events were part of the three-year project ‘Flexibility and Computational Methods.’ Over the course of the project, the researchers have prepared joint publications and obtained new mathematical results.

September 18, 2026

When Pictures Hinder Understanding: Illustrations May Impede Learning of Abstract Ideas

Illustrations can help remember specific actions but do not always make abstract ideas easier to learn. Researchers from HSE University and Humboldt University compared how people learn from texts with different levels of abstractness. They found that participants remembered illustrations better and performed better on related tasks after reading a multimedia text about yoga asanas than after reading an abstract text about the Nash equilibrium. The findings could help improve the selection of illustrations for educational and informational materials. The study has been published in Learning and Instruction.

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications

?

Frequent Itemset Mining for Clustering Near Duplicate Web Documents

P. 185–200.

Ignatov D. I., Kuznetsov S.

A vast amount of documents in the Web have duplicates, which is a challenge for developing efficient methods that would compute clusters of similar documents. In this paper we use an approach based on computing (closed) sets of attributes having large support (large extent) as clusters of similar documents. The method is tested in a series of computer experiments on large public collections of web documents and compared to other established methods and software, such as biclustering, on same datasets. Practical efficiency of different algorithms for computing frequent closed sets of attributes is compared.

Language: English

Full text

Keywords: Clustering Near Duplicate Frequent Itemset Mining Web Documents

In book

Conceptual Structures: Leveraging Semantic Technologies. 17th International Conference on Conceptual Structures, ICCS 2009, Moscow, Russia, July 26-31, 2009, Proceedings

Vol. 5662. , Berlin, Heidelberg: Springer, 2009.

Near-Duplicate Detection for Online-Shops Owners: An FCA-Based Approach

Ignatov D. I., Chubis Y., Konstantinov A. V., Lecture Notes in Computer Science 2013 Vol. 7814 P. 722–725

We proposed a prototype of near-duplicate detection system for web-shop owners. It’s a typical situation for this online businesses to buy description of their goods from so-called copyrighters. Copyrighter can cheat from time to time and provide the owner with some almost identical descriptions for different items. In this paper we demonstrated how we can ...

Added: October 10, 2013