• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • On the choice of measures of reliability and validity in the content-analysis of texts
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2028
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
October 6, 2026
International N5 Symposium ‘Neural Networks and Nonlinearity in Nizhny Novgorod Brings Together Scientists from Russia and Serbia
The International N5 Symposium ‘Neural Networks and Nonlinearity in Nizhny Novgorod’ was held at the Nizhny Novgorod House of Scientists from September 23 to 26. The event was organised by HSE University–Nizhny Novgorod and the Nizhny Novgorod House of Scientists, with the participation of Sberbank and the Institute of Physics Belgrade. The symposium was held for the second time: the first conference took place in 2025 and attracted considerable interest from the academic community.
October 5, 2026
‘The Climate Transition Is Not Necessarily a Limitation for Business
Linara Khadimullina works in the field of low-carbon development. In an interview with the Young Scientists of HSE project, she spoke about why nature is not just a beautiful backdrop, her research on the role of sustainable corporate governance in reducing greenhouse gas emissions, and growing plants as a source of inspiration.
October 5, 2026
Africa, Youth, and Civic Dialogue: Public Diplomacy Discussed at HSE University
In late September, HSE University hosted a roundtable discussion titled Civil Society in African Countries and Youth Participation in Public Diplomacy. Representatives of non-governmental organisations from Ghana, Ethiopia, and Russia, along with students from HSE University’s Bachelor’s Programme in Public Administration, discussed how young people without official diplomatic status can influence relations between countries and how the nonprofit sector can remain sustainable amid declining grant funding.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

On the choice of measures of reliability and validity in the content-analysis of texts

Quality and Quantity. 2013. No. September. P. 1–18.
Anton Oleinik, Irina Popova, Svetlana Kirdina, Tatyana S., Шаталова Т. Ю.

The paper discusses several reliability measures: Scott’s pi, Krippendorff’s alpha, free marginal adjustment (Bennett, Alpert and Goldstein’s S S ), Cohen’s kappa, and Perreault and Leigh’s I I and the assumptions on which they are based. It is suggested that correlation coefficients between, on one hand, the distribution of qualitative codes and, on the other hand, word co-occurrences and the distribution of the categories identified with the help of the dictionary based on substitution complement the other reliability measures. The paper shows that the choice of the reliability measure depends on the format of the text (stylistic versus rhetorical) and the type of reading (comprehension versus interpretation). Namely, Cohen’s kappa and Bennett, Alpert and Goldstein’s S S emerge as reliability measures particularly suited for perspectival reading of rhetorical texts. Outcomes of the content analysis of 57 texts performed by four coders with the help of computer program QDA Miner inform the analysis.

Research target: Sociology (including Demography and Anthropology
Priority areas: sociology
Language: English
Text on another site
Keywords: надежностьreliabilityпониманиеконтент-анализcontent analysisinterpretationпоказателикорреляционный анализcorrelation analysisаутентичная интерпретацияcomprehension
Similar publications
Вторая антикритика на «Дух капитализма» Часть II. Позитивные выводы
Вебер М., Социологическое обозрение 2026 Т. 25 № 3 С. 318–353
In the concluding part of the Second Anti-Critique (1910), Max Weber summarizes the substantive findings of his own contributions to the debate with the historian Felix Rachfahl. In doing so, he uses the response to his relentless critic as an opportunity to articulate once again, in an explicit manner and for both his own benefit and that of the ...
Added: October 4, 2026
Polarization of opinions in the group: a modeling algorithm considering the dynamics of social bonds
Chebotarev V., Andreyuk D., Elizarova Anastasiya et al., Procedia Computer Science 2022 Vol. 213 No. C P. 596–601
The dynamics of opinion in a group are of interest for a number of practical purposes. In particular, consensus helps and polarization of opinions hinders cohesive teamwork. Existing approaches for modeling opinion dynamics mostly do not take into account the dynamism of social relations in a group. This paper proposes an algorithm and a program ...
Added: October 2, 2026
Inclusive education in Nigeria: Current state and multi-stakeholders’ position
Вестник Санкт-Петербургского университета. Серия 12: Социология 2025 Vol. 18 No. 4 P. 494–505
Global educational paradigms are increasingly shifting towards inclusive models, demanding committed participation and collaboration from a diverse range of stakeholders to ensure equitable access and quality for all learners. This article provides a comprehensive review of the current state of inclusive education in Nigeria, synthesizing existing literature to analyze its progress, persistent challenges, and future ...
Added: October 2, 2026
Human Agency and the Problem of Replicability in the Dynamic Neo-Structured World
Sorokin P., Mironenko I. A., Oxford Research Encyclopedia of Science, Technology, and Society, 2026.
Social reality is undergoing rapid transformations, giving rise to new challenges for both social theory and practice. One of these much-discussed challenges is the so-called replicability crisis, a notion that describes the failure of the social sciences and humanities to verify established research findings with new empirical investigations. In the related debates, it is argued ...
Added: October 2, 2026
БУДУЩЕЕ НАУК О ЧЕЛОВЕКЕ (о секции на XVI Грушинской конференции)
Sorokin P., Социологические исследования 2026 Т. 6 № 6 С. 145–147
Статья предлагает обзор междисциплинарной дискуссии, которая состоялась на секции «Будущее наук о человеке» в рамках XVI международной Грушинской социологической конференции и была посвящена перспективам выработки междисциплинарного взгляда на трансформации социально-гуманитарного знания в условиях современных кризисов и контурам возможного образа науки будущего, включая место в ней отдельных дисциплин. Это дискуссия может иметь особое значение для социологического ...
Added: October 2, 2026
Научные традиции как инструмент адаптации исследовательской практики к меняющемуся миру
Sorokin P., Психологический журнал 2026 Т. 47 № 4 С. 124–129
In the context of the discussion initiated by A. L. Zhuravlev and Yu. N. Oleinik on the challenges and prospects of studying scientific traditions in psychology, this commentary examines the importance of viewing such traditions as a tool that enables the research community to respond effectively to radical changes in socio-psychological reality. Such responses must ...
Added: October 2, 2026
Дифференциация занятости и её влияние на социальную структуру российского общества
Tikhonova N. E., Karavay A., Социологическая наука и социальная практика 2026 Т. 14 № 3 С. 12–36
Drawing on data from the 2024 RLMS-HSE, the article shows that employmentrelated risks are increasingly being shifted onto workers in Russia, while employment differentiation already affects more than 40% of employed Russians, even without taking into account deviations from standard working hours, which are typical of most representatives of the mass social strata. Employment differentiation in Russia is characterized, ...
Added: October 2, 2026
Транзит к родительству и миграция: особенности социальных взаимодействий молодых матерей
Kim A., Журнал социологии и социальной антропологии 2026 Т. XXIX. № 29(1).149
Статья посвящена изучению транзита к родительству молодых матерей в миграции с фокусом на особенности социальных взаимодействий. Поскольку обстоятельство миграции усложняет период транзита к родительству, то основной проблемой молодых матерей становится адаптация к новой жизни в качестве и родителя, и мигранта одновременно. Важными аспектами адаптации в миграции и в родительстве — поддержание привычных социальных взаимодействий и ...
Added: October 2, 2026
Скептики или циники: Два лица критики новостей
Kazun A. D., Полития: Анализ. Хроника. Прогноз 2026 № 3 С. 80–98
The article analyzes media skepticism and media cynicism as two forms of critical attitudes toward news. The empirical basis of the study is a nationwide population survey (N = 6,007) conducted in late 2023 and early 2024. The analysis shows that both media skepticism and media cynicism are pronounced in Russian society: while a substantial ...
Added: October 1, 2026
Гуманитарная наука в цифровую эпоху (случай британской устной истории)
Vakhrukova K., Петербургская социология сегодня 2025 № 30 С. 28–51
The digital age has radically changed the landscape of the humanities, introducing new methodologies, tools, and challenges. This has also been reflected in the field of oral history. This transformation has been particularly evident in the UK, where long-standing oral history archives and recent digitization projects have come together to redefine how scholars collect, preserve, ...
Added: October 1, 2026
Научный капитал и научная элита
Katchanov Y. L., Социологическое обозрение 2026 Т. 25 № 3 С. 36–61
В статье предлагается теоретическая рамка анализа научной элиты, исходящая из понимания производства знания как динамической структуры, формируемой внутренними противоречиями. Научная элита рассматривается не как совокупность выдающихся исследователей, а как структурный эффект производства знания — позиция в пространстве науки, концентрирующая максимальный объем научного капитала и задающая смысловой горизонт для всех агентов. Пространство науки трактуется как многомерное ...
Added: September 30, 2026
Устройство, превращающее опасения в явь: три режима работы с будущим
Khestanov R., Социологическое обозрение 2026 Т. 25 № 3 С. 12–35
The article proposes a syntagmatic analysis of three historically constituted regimes for working with the future: linear determination, statistical branching, and loop reconfiguration. A syntagm is understood as an event-operation that exists only in its performance and simultaneously binds material, semiotic, and pragmatic registers. The analysis proceeds not as an intellectual history but as an ...
Added: September 30, 2026
Трансфертная поддержка российской экономики: ретроспективный анализ в контексте параметров национального счетоводства
Nazarova A. G., Журнал Новой экономической ассоциации 2026 № 3(72) С. 87–104
The article explores how results of constructing aggregate national transfer accounts’ (NTA) estimates can be used for macroeconomic analysis and forecasts of current transfers in home economy. It presents the findings of the author’s study of their transfer modules over retrospective period of more than 10 years. The emphasis in the paper is focused on ...
Added: September 30, 2026
Паллиативная помощь в восприятии населения: результаты всероссийского опроса
Mersiyanova I. V., Брюхно А. С., Pallium: паллиативная и хосписная помощь 2026 Т. 1 № 30 С. 26–33
The aim of this study is to identify key features of public perceptions of palliative care, including levels of awareness, attitudes toward the possibility of receiving palliative care, experiences of interaction with the palliative care system, as well as perceptions of the roles of various institutional actors involved in its provision. The empirical basis of ...
Added: September 30, 2026
Как формируется общегражданское «мы»? Анализ инструментов символического включения в интеграционной политике
Grigoreva M., Balakina Y. V., Научный результат. Серия: Социальные и гуманитарные исследования 2026 Т. 12 № 3 С. 100–112
In the context of intense international migration and increasing ethnocultural diversity, the integration of migrants has become an important issue for public policy. While existing research primarily focuses on the socio-economic and legal dimensions of integration, less attention has been paid to the mechanisms through which migrants develop a sense of belonging to the host ...
Added: September 30, 2026
Филантропическая активность российских миллиардеров: структура и институциональные особенности
Shvetsova E., Журнал институциональных исследований 2026 Т. 18 № 3 С. 116–130
This article analyzes the philanthropic activity of Russian billionaires as a mechanism for the institutional legitimization of capital, aimed at its preservation and the transformation of economic capital into symbolic capital. The empirical analysis is based on a self-contained database containing information from public sources on the philanthropic activity of 146 Russian billionaires included in the 2025 Forbes list, ...
Added: September 30, 2026
Уровни понимания и градуальность смысловой организации текста: комплексный подход на стыке психологии и лингвистики
Sherbakova O., Обольская В. А., Культурно-историческая психология 2024 Т. 20 № 4 С. 31–39
The article describes an interdisciplinary framework which we have developed to study verbal text comprehension based on a combination of psychological and linguistic approaches. The comprehension phenomenon is considered to be a result of a reversible transformation between verbal symbols and mental images of the to-be-comprehended material, with the obligatory condition of preserving its semantic ...
Added: September 28, 2026
Продвижение образа Японии как туристической дестинации в русскоязычном сегменте интернета
Решетников А. К., В кн.: Востоковедение.Этнография: материалы 63-й Международной научной студенческой конференцииТ. Востоковедение. Этнография.: Новосибирск: ИПЦ НГУ, 2025.
Туризм как индустрия играет важную роль в «мягкой силе» как инструмент дипломатии, способный сформировать образ страны, чтобы привлечь посетителей и поднять ее экономику. В современный цифровой век интернет играет ключевую роль в формировании представлений путешественников о странах и принятии ими решений о том, куда поехать. Различные блоги о путешествиях могут помочь Японии стать более заметной, ...
Added: September 26, 2026
College Students’ Responses to Automated Feedback on Self-Regulated Learning
Yu E. C., Lui A., Andrade H. et al., Educational Assessment 2026 P. 1–26
Feedback often promotes student learning. Research has focused on delivering high-quality feedback, yet too little is known about how students respond to feedback, and whether and why it serves its intended purposes. This study is an investigation of how college students responded to feedback on their self-regulated learning (SRL). After taking an online assessment of ...
Added: September 8, 2026
Предикторы понимания при чтении: когнитивные характеристики реципиента и имплицитные смыслы текста
Обольская В. А., Sherbakova O., Психологический журнал 2026 Т. 47 № 1 С. 57–68
Our study aimed to identify predictors of reading comprehension, motivated by the growing body of evidence regarding difficulties in semantic reading among healthy adults. We hypothesized that (1) predictors of the text comprehension include both cognitive characteristics of readers — specifically psychometric intelligence (IQ), Theory of Mind (ToM), and “equivalence range” and “field dependence-independence” cognitive ...
Added: September 3, 2026
Vanishing Vanguard: Decline of Leadership in Revolutionary Mass Mobilization since the 19th Century
Ustyuzhanin V., Zinkina J. V., Korotayev A., / Series "SocArXiv". 2026.
“Leaderlessness” is widely held to be a defining feature of contemporary mass mobilization, yet the claim rests on a handful of recent cases. We offer the first systematic cross-national analysis of this phenomenon from 1791 to 2019. We show that the absence of leadership is real but older and more modest than claimed: the share ...
Added: August 29, 2026
ХАРАКТЕРИСТИКИ КОРПУСОВ ТЕКСТОВ ДЛЯ ОБУЧЕНИЯ НЕЙРОСЕТЕЙ
Chepovskiy A., Никитина Н. Ю., В кн.: Международная конференция «Математические идеи академика П.Л. Чебышёва, их приложения в естественных науках и технологи- ях искусственного интеллекта», приуроченная к 205-й годовщине со дня его рождения» : Материалы конференции.: Калуга: Калужский печатный двор, 2026. С. 231–233.
The task of comparison of large text arrays for characteristics selection and comparison of texts in order to form training sets of texts is considered ...
Added: June 20, 2026
Аккультурационный стресс как антецедент психологической безопасности иностранных студентов в России: контент-анализ
Berrios Callejas S. A., Bultseva M. A., Vasilieva E., Мир психологии. Научно-методический журнал 2026 № 2(125) С. 96–113
Acculturative stress is a psychological response to the demands of a new cultural environment. Psychological safety defined as the perceived ability to engage and express oneself openly without fear of negative consequences has traditionally been viewed as a coping resource in 3 Исследование осуществлено в рамках Программы фундаментальных исследований НИУ ВШЭ. 4 This work/article is ...
Added: June 18, 2026
How Universal is the Cool Water Effect? Evidence from the Unlikely Case of Russia
Kravtsova M., Musaev A. U., Welzel C., / Series "SSRN Working Paper Series". 2026.
Elaborating on Welzel et al.'s "Cool Water Theory," our study zooms into the more limited (albeit still varied) framework conditions of Russia's huge territory. Within Russia's confines, we examine how the combination of moderately cool seasons with steady rain (i.e., Cool Water) affects sub-national areas' contemporary societal progress in two modernization indicators: material prosperity in ...
Added: June 3, 2026
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit