• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Working paper

RESEARCH IMPACT: LEVEL OF RESULTS, CITATION, MERIT

Mirkin B., Orlov M. A.
This report elaborates on an approach to measuring of the level of research results recently proposed by one of the co-authors. The approach involves a taxonomy of the research domain, that is, a hierarchy representing the domain’s structure. The level of results is evaluated according to the taxonomy ranks of the subjects that have emerged or have been crucially transformed due to the results by the scientist under consideration. We also consider two more conventional approaches for scoring the research impact over (a) citation metrics and (b) merit metrics. To aggregate individual criteria in these approaches, we use an in-house automated criteria-weighting method oriented towards as tight a representation of the strata as possible. To compare – and combine – the three approaches empirically, we use a sample of publicly available data of scientists in the areas of data analysis and machine learning. As the domain’s taxonomy, we use a corresponding part of the ACM Computing Classification System 2012 and slightly modify it to better reflect results by the scientists in our sample. The obtained ABC stratifications concur with intuition. Besides, they are rather far from each other. This supports the view that all the three approaches (citations, merits, taxonomic rank) should be considered as different aspects, and, therefore, a good method for scoring research impact should involve all the three.