Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods

NRU Higher School of Economics , 2014. No. WP BRP 27/STI/2014.

Aleskerov F. T., Pislyakov V., Subochev A.

Data on economic, management and political science journals are used to produce quantitative estimates of (in)consistency of evaluations based on seven popular bibliometric indicators. This paper proposes a new approach to the construction of aggregate journal rankings: aggregation is considered to be a multicriteria decision problem and ordinal ranking methods from social choice theory are employed to solve it. We apply either a direct ranking method based on majority rule (e.g. the Copeland rule, the Markovian method) or a multistage procedure of selection and exclusion of the best journals, as determined by a majority rule-based social choice solution concept (tournament solution), such as the uncovered set and the minimal externally stable set. We use the same method to analyze correlations of rankings and demonstrate that aggregate rankings reduce the number of contradictions and represent the set of single-indicator-based rankings better than any of the seven rankings themselves.

Keywords: коллективный выбор, social choice, многокритериальный выбор, импакт-фактор, impact factor, top cycle, uncovered set, externally stable set, максимальный цикл, непокрытое множество, внешнеустойчивое множество, bibliometric indicators, агрегированный рейтинг, правило большинства, правило Коупланда, journal ranking, citedness, Hirsch index, immediacy index, article influence, SNIP, SJR, rank aggregation, aggregate ranking, multicriteria choice, majority rule, Copeland rule, Markovian ranking, tournament solution, рейтинг научных журналов, библиометрический индикатор, индекс Хирша, индекс оперативности, индекс влияния статьи, SNIP, SJR, агрегирование ранжирований, марковское ранжирование, турнирное решение

Publication based on the results of: Theoretical and numerical study of advanced mathematical models in the social, economic, political and financial fields (2014)