Библиометрические индикаторы в ресурсах Thomson Reuters
This chapter examines bibliometric indicators related to citedness of journals, authors, research groups, institutions and whole countries. The introductory section deals with the basics of bibliometric analysis and features of citation databases. The author discusses the usage of various bibliometric indicators: the impact factor, average citedness, share of uncited papers, Eigenfactor and Article Infl uence Scores, Hirsch and Hirsch-type indices, and others. A special section investigates indicators of chronological distribution of references. Particular attention is paid to normalized indicators, including indicators normalized by research disciplines, as well as by publication sources. The fi nal section emphasizes the importance of informed and reasonable use of bibliometric indicators in research policy-making, funding allocation, and faculty and research personnel recruitment.
We use data on economic, management and political science journals to produce quantitative estimates of (in)consistency of evaluations based on seven popular bibliometric indicators (impact factor, 5-year impact factor, immediacy index, article influence score, h-index, SNIP and SJR). We propose a new approach to aggregating journal rankings: since rank aggregation is a multicriteria decision problem, ordinal ranking methods from social choice theory may solve it. We apply either a direct ranking method based on majority rule (the Copeland rule, the Markovian method) or a sorting procedure based on a tournament solution, such as the uncovered set and the minimal externally stable set. We demonstrate that aggregate rankings reduce the number of contradictions and represent the set of single-indicator-based rankings better than any of the seven rankings themselves.
Proceedings of the 21 International Conference on Science and Technology Indicators: Peripheries, frontiers and beyond.
14-16 September 2016
Universitat Politècnica de València
Research evaluation recently became a widely disseminated exercise aimed in the end of the day at improving the cost efficiency of public funding of national R&D sectors. In November 2013, the Government of the Russian Federation initiated a national evaluation exercise of public research institutions (PRIs) to provide information basis for development of S&T policies aimed at increasing effectiveness and strengthening the role of R&D performing institutions in economic and social development. The aim of this paper is that of providing an approach for multidimensional assessment of R&D performance based on quantitative data derived from the national evaluation exercise, specifically looking at its applicability and limitations for further analysis and preliminary differentiation of PRIs as well as for use in policymaking.
This article analyzes the effects of publication language on the international scientific visibility of Russia using the Web of Science (WoS). Like other developing and transition countries, it is subject to a growing pressure to “internationalize” its scientific activities, which primarily means a shift to English as a language of scientific communication. But to what extent does the transition to English improve the impact of research? The case of Russia is of interest in this respect as the existence of many combinations of national journals and languages of publications (namely, Russian and English, including translated journals) provide a kind of natural I experiment to test the effects of language and publisher's country on the international visibility of research through citations as well as on the referencing practices of authors. Our analysis points to the conclusion that the production of original English-language papers in foreign journals is a more efficient strategy of internationalization than the mere translation of domestic journals. If the objective of a country is to maximize the international visibility of its scientific work, then the efforts should go into the promotion of publication in reputed English-language journals to profit from the added effect provided by the Matthew effect of these venues.
In the current context of the globalization of science, excellence is most often associated with internationalization and assessed through high-impact “international” (English-language) publications. Taking Russian economic science as a case study, this paper argues that the strategies of internationalization of national disciplinary fields are primarily determined by the parameters of the global economics itself. My analysis of the Russian publications in economics covered by Web of Science demonstrates that the very repertoire of international publication strategies of Russian authors is determined by the transnational system of communication in economics. Economics papers from peripheral nations are essentially assigned to regional or “area studies” periodicals, which do not belong to the core of the discipline. Publication in top economics journals requires a specific “international” competency usually obtained through doctoral training at Anglo-American or equivalent PhD programs and generally implies a delocalization of research objects and questions.
The Russian Scientometric Handbook is designed to provide an overview of the field of scientometrics. The Handbook describes the history of creation of the breakthrough concept of citation indexing by Dr. Eugene Garfield, and development of the first multidisciplinary scholarly citation index, the Science Citation Index. Application of scientometric tools and methods in research management and resource allocation is discussed. Authors survey various scientometric indicators relevant to individual researchers, journals, research institutions and whole countries. Authors explore new types of indicators, such as altmetrics, relationship between scientometric indicators and the nature of scientific communication, and various methods of visualizing scientometric information. Possibilities and limitations of various scientometric techniques are examined. Authors highlight the need for an informed and reasonable approach to the use of quantitative indicators for research assessment. The Handbook includes the first Russian translations of three articles by Dr. Eugene Garfield.
The Handbook is intended for use by researchers, science analysts, universities and research institutions administrators, libraries and information centers staff, graduate students, and the general public interested in scientometrics and research evaluation.
In the article the classification of indicators of efficiency of scientific activity, and also the list of criteria which they should satisfy are suggested. The indicator of productivity of scientific activity used in Russia (IPSA) is analyzed and its limitation for measurement of the results of scientific activity is proved. New IPSA, the technique of their calculation and the way of calculation of the wages of the faculty on the basis of these indicators are worked out.
scientific activity, a productivity indicator, a citing index, the impact factor