• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • On the choice of measures of reliability and validity in the content-analysis of texts
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2028
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
October 7, 2026
‘Our Team Consists of True Leaders in Their Respective Academic Disciplines
The HSE International Centre of Decision Choice and Analysis studies a wide range of methods for analysing decision-making and possible scenarios for the development of natural, socio-economic, and political phenomena using various mathematical models. The application of advanced mathematical methods to forecasting helps to prevent negative outcomes and avoid erroneous decisions. The HSE News Service spoke to the centre’s director, Prof. Fuad Aleskerov, about its work.
October 6, 2026
International N5 Symposium ‘Neural Networks and Nonlinearity in Nizhny Novgorod Brings Together Scientists from Russia and Serbia
The International N5 Symposium ‘Neural Networks and Nonlinearity in Nizhny Novgorod’ was held at the Nizhny Novgorod House of Scientists from September 23 to 26. The event was organised by HSE University–Nizhny Novgorod and the Nizhny Novgorod House of Scientists, with the participation of Sberbank and the Institute of Physics Belgrade. The symposium was held for the second time: the first conference took place in 2025 and attracted considerable interest from the academic community.
October 5, 2026
‘The Climate Transition Is Not Necessarily a Limitation for Business
Linara Khadimullina works in the field of low-carbon development. In an interview with the Young Scientists of HSE project, she spoke about why nature is not just a beautiful backdrop, her research on the role of sustainable corporate governance in reducing greenhouse gas emissions, and growing plants as a source of inspiration.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

On the choice of measures of reliability and validity in the content-analysis of texts

Quality and Quantity. 2013. No. September. P. 1–18.
Anton Oleinik, Irina Popova, Svetlana Kirdina, Tatyana S., Шаталова Т. Ю.

The paper discusses several reliability measures: Scott’s pi, Krippendorff’s alpha, free marginal adjustment (Bennett, Alpert and Goldstein’s S S ), Cohen’s kappa, and Perreault and Leigh’s I I and the assumptions on which they are based. It is suggested that correlation coefficients between, on one hand, the distribution of qualitative codes and, on the other hand, word co-occurrences and the distribution of the categories identified with the help of the dictionary based on substitution complement the other reliability measures. The paper shows that the choice of the reliability measure depends on the format of the text (stylistic versus rhetorical) and the type of reading (comprehension versus interpretation). Namely, Cohen’s kappa and Bennett, Alpert and Goldstein’s S S emerge as reliability measures particularly suited for perspectival reading of rhetorical texts. Outcomes of the content analysis of 57 texts performed by four coders with the help of computer program QDA Miner inform the analysis.

Research target: Sociology (including Demography and Anthropology
Priority areas: sociology
Language: English
Text on another site
Keywords: надежностьreliabilityпониманиеконтент-анализcontent analysisinterpretationпоказателикорреляционный анализcorrelation analysisаутентичная интерпретацияcomprehension
Similar publications
Вышелейские эпифании: концептуальная пересборка случайной этнографии
Rozhdestvenskaya E., Abramov R., Журнал социологии и социальной антропологии 2026 Т. 29 № 3 С. 244–274
The article presents an experimental study at the intersection of social anthropology and qualitative sociology. The empirical basis is a corpus of 18 short biographical sketches of collective farm peasant women from the village of Vysheley, Penza Region, created at the end of the Soviet period by school local historians and discovered by one of the authors during a ...
Added: October 7, 2026
A Just War: From Principles of Theory to Factors of Ordinary Judgments
Gajiyev A., Deviatko I. F., Conflict Resolution Quarterly 2026
This paper explores the factors influencing ordinary judgments of justice in warfare, drawing primarily on normative theories of just war. By examining the alignment between the philosophical principles of just war and ordinary normative judgments, we explore the extent to which lay moral evaluations of war are shaped by the principles articulated in normative just ...
Added: October 7, 2026
Трансформация исследовательских компетенций в условиях междисциплинарности: запрос на новую модель подготовки научных кадров
Nefedova A., Shmatko N., Antonova E., Социологические исследования 2026 № 9 С. 52–69
This article analyzes the transformation of professional competencies of researchers in the context of growing interdisciplinarity and the digitalization of science. The aim of the study is to identify the structural gap between the normative expectations of the scientific community and the actual outcomes of the research personnel training system in Russia. The theoretical framework ...
Added: October 6, 2026
Цифровые платформы в России: состояние, экономические эффекты и перспективы развития
Kuzminov Y., Kruchinskaia E., Koshel A. et al., М.: Издательский дом НИУ ВШЭ, 2026.
В научном докладе цифровые платформы впервые рассмотрены не как частный сегмент цифрового рынка, а как новый институциональный механизм организации экономики. В одной исследовательской рамке соединены экономика, право, социология, компьютерные науки, информационная безопасность, данные бизнеса и регуляторная практика — все то, что позволяет взглянуть на платформы как на институт со своими правилами игры. Особую ценность работе ...
Added: October 6, 2026
De Gruyter Handbook of Eurasian Societies
De Gruyter, 2026.
Post-Soviet Eurasia is one of the world's most geopolitically consequential and rapidly transforming regions. Developments across it increasingly reshape political, economic and social relations far beyond its borders. Understanding these dynamics is therefore both intellectually urgent and analytically demanding, requiring an interdisciplinary approach capable of moving beyond established categories and fragmented national perspectives. This handbook provides ...
Added: October 5, 2026
Вестник Российского мониторинга экономического положения и здоровья населения НИУ ВШЭ (RLMS‑HSE). Вып. 16
М.: Национальный исследовательский университет "Высшая школа экономики", 2026.
В шестнадцатом выпуске электронного издания «Вестник Российского мониторинга экономического положения и здоровья населения НИУ ВШЭ (RLMSHSE)» представлены работы, подготовленные на основании данных лонгитюдного обследования домохозяйств «Российский мониторинг экономического положения и здоровья населения НИУ ВШЭ» (РМЭЗ НИУ ВШЭ) за 1992–2024 гг. В выпуске рассматриваются динамика доходов и расходов российских домохозяйств, тенденции развития рынка труда, социальное самочувствие ...
Added: October 5, 2026
Вторая антикритика на «Дух капитализма» Часть II. Позитивные выводы
Вебер М., Социологическое обозрение 2026 Т. 25 № 3 С. 318–353
In the concluding part of the Second Anti-Critique (1910), Max Weber summarizes the substantive findings of his own contributions to the debate with the historian Felix Rachfahl. In doing so, he uses the response to his relentless critic as an opportunity to articulate once again, in an explicit manner and for both his own benefit and that of the ...
Added: October 4, 2026
Polarization of opinions in the group: a modeling algorithm considering the dynamics of social bonds
Chebotarev V., Andreyuk D., Elizarova Anastasiya et al., Procedia Computer Science 2022 Vol. 213 No. C P. 596–601
The dynamics of opinion in a group are of interest for a number of practical purposes. In particular, consensus helps and polarization of opinions hinders cohesive teamwork. Existing approaches for modeling opinion dynamics mostly do not take into account the dynamism of social relations in a group. This paper proposes an algorithm and a program ...
Added: October 2, 2026
Inclusive education in Nigeria: Current state and multi-stakeholders’ position
Вестник Санкт-Петербургского университета. Серия 12: Социология 2025 Vol. 18 No. 4 P. 494–505
Global educational paradigms are increasingly shifting towards inclusive models, demanding committed participation and collaboration from a diverse range of stakeholders to ensure equitable access and quality for all learners. This article provides a comprehensive review of the current state of inclusive education in Nigeria, synthesizing existing literature to analyze its progress, persistent challenges, and future ...
Added: October 2, 2026
Human Agency and the Problem of Replicability in the Dynamic Neo-Structured World
Sorokin P., Mironenko I. A., Oxford Research Encyclopedia of Science, Technology, and Society, 2026.
Social reality is undergoing rapid transformations, giving rise to new challenges for both social theory and practice. One of these much-discussed challenges is the so-called replicability crisis, a notion that describes the failure of the social sciences and humanities to verify established research findings with new empirical investigations. In the related debates, it is argued ...
Added: October 2, 2026
БУДУЩЕЕ НАУК О ЧЕЛОВЕКЕ (о секции на XVI Грушинской конференции)
Sorokin P., Социологические исследования 2026 Т. 6 № 6 С. 145–147
Статья предлагает обзор междисциплинарной дискуссии, которая состоялась на секции «Будущее наук о человеке» в рамках XVI международной Грушинской социологической конференции и была посвящена перспективам выработки междисциплинарного взгляда на трансформации социально-гуманитарного знания в условиях современных кризисов и контурам возможного образа науки будущего, включая место в ней отдельных дисциплин. Это дискуссия может иметь особое значение для социологического ...
Added: October 2, 2026
Научные традиции как инструмент адаптации исследовательской практики к меняющемуся миру
Sorokin P., Психологический журнал 2026 Т. 47 № 4 С. 124–129
In the context of the discussion initiated by A. L. Zhuravlev and Yu. N. Oleinik on the challenges and prospects of studying scientific traditions in psychology, this commentary examines the importance of viewing such traditions as a tool that enables the research community to respond effectively to radical changes in socio-psychological reality. Such responses must ...
Added: October 2, 2026
Дифференциация занятости и её влияние на социальную структуру российского общества
Tikhonova N. E., Karavay A., Социологическая наука и социальная практика 2026 Т. 14 № 3 С. 12–36
Drawing on data from the 2024 RLMS-HSE, the article shows that employmentrelated risks are increasingly being shifted onto workers in Russia, while employment differentiation already affects more than 40% of employed Russians, even without taking into account deviations from standard working hours, which are typical of most representatives of the mass social strata. Employment differentiation in Russia is characterized, ...
Added: October 2, 2026
Транзит к родительству и миграция: особенности социальных взаимодействий молодых матерей
Kim A., Журнал социологии и социальной антропологии 2026 Т. XXIX. № 29(1).149
Статья посвящена изучению транзита к родительству молодых матерей в миграции с фокусом на особенности социальных взаимодействий. Поскольку обстоятельство миграции усложняет период транзита к родительству, то основной проблемой молодых матерей становится адаптация к новой жизни в качестве и родителя, и мигранта одновременно. Важными аспектами адаптации в миграции и в родительстве — поддержание привычных социальных взаимодействий и ...
Added: October 2, 2026
Скептики или циники: Два лица критики новостей
Kazun A. D., Полития: Анализ. Хроника. Прогноз 2026 № 3 С. 80–98
The article analyzes media skepticism and media cynicism as two forms of critical attitudes toward news. The empirical basis of the study is a nationwide population survey (N = 6,007) conducted in late 2023 and early 2024. The analysis shows that both media skepticism and media cynicism are pronounced in Russian society: while a substantial ...
Added: October 1, 2026
Гуманитарная наука в цифровую эпоху (случай британской устной истории)
Vakhrukova K., Петербургская социология сегодня 2025 № 30 С. 28–51
The digital age has radically changed the landscape of the humanities, introducing new methodologies, tools, and challenges. This has also been reflected in the field of oral history. This transformation has been particularly evident in the UK, where long-standing oral history archives and recent digitization projects have come together to redefine how scholars collect, preserve, ...
Added: October 1, 2026
Научный капитал и научная элита
Katchanov Y. L., Социологическое обозрение 2026 Т. 25 № 3 С. 36–61
В статье предлагается теоретическая рамка анализа научной элиты, исходящая из понимания производства знания как динамической структуры, формируемой внутренними противоречиями. Научная элита рассматривается не как совокупность выдающихся исследователей, а как структурный эффект производства знания — позиция в пространстве науки, концентрирующая максимальный объем научного капитала и задающая смысловой горизонт для всех агентов. Пространство науки трактуется как многомерное ...
Added: September 30, 2026
Устройство, превращающее опасения в явь: три режима работы с будущим
Khestanov R., Социологическое обозрение 2026 Т. 25 № 3 С. 12–35
The article proposes a syntagmatic analysis of three historically constituted regimes for working with the future: linear determination, statistical branching, and loop reconfiguration. A syntagm is understood as an event-operation that exists only in its performance and simultaneously binds material, semiotic, and pragmatic registers. The analysis proceeds not as an intellectual history but as an ...
Added: September 30, 2026
Уровни понимания и градуальность смысловой организации текста: комплексный подход на стыке психологии и лингвистики
Sherbakova O., Обольская В. А., Культурно-историческая психология 2024 Т. 20 № 4 С. 31–39
The article describes an interdisciplinary framework which we have developed to study verbal text comprehension based on a combination of psychological and linguistic approaches. The comprehension phenomenon is considered to be a result of a reversible transformation between verbal symbols and mental images of the to-be-comprehended material, with the obligatory condition of preserving its semantic ...
Added: September 28, 2026
Продвижение образа Японии как туристической дестинации в русскоязычном сегменте интернета
Решетников А. К., В кн.: Востоковедение.Этнография: материалы 63-й Международной научной студенческой конференцииТ. Востоковедение. Этнография.: Новосибирск: ИПЦ НГУ, 2025.
Туризм как индустрия играет важную роль в «мягкой силе» как инструмент дипломатии, способный сформировать образ страны, чтобы привлечь посетителей и поднять ее экономику. В современный цифровой век интернет играет ключевую роль в формировании представлений путешественников о странах и принятии ими решений о том, куда поехать. Различные блоги о путешествиях могут помочь Японии стать более заметной, ...
Added: September 26, 2026
College Students’ Responses to Automated Feedback on Self-Regulated Learning
Yu E. C., Lui A., Andrade H. et al., Educational Assessment 2026 P. 1–26
Feedback often promotes student learning. Research has focused on delivering high-quality feedback, yet too little is known about how students respond to feedback, and whether and why it serves its intended purposes. This study is an investigation of how college students responded to feedback on their self-regulated learning (SRL). After taking an online assessment of ...
Added: September 8, 2026
Предикторы понимания при чтении: когнитивные характеристики реципиента и имплицитные смыслы текста
Обольская В. А., Sherbakova O., Психологический журнал 2026 Т. 47 № 1 С. 57–68
Our study aimed to identify predictors of reading comprehension, motivated by the growing body of evidence regarding difficulties in semantic reading among healthy adults. We hypothesized that (1) predictors of the text comprehension include both cognitive characteristics of readers — specifically psychometric intelligence (IQ), Theory of Mind (ToM), and “equivalence range” and “field dependence-independence” cognitive ...
Added: September 3, 2026
Vanishing Vanguard: Decline of Leadership in Revolutionary Mass Mobilization since the 19th Century
Ustyuzhanin V., Zinkina J. V., Korotayev A., / Series "SocArXiv". 2026.
“Leaderlessness” is widely held to be a defining feature of contemporary mass mobilization, yet the claim rests on a handful of recent cases. We offer the first systematic cross-national analysis of this phenomenon from 1791 to 2019. We show that the absence of leadership is real but older and more modest than claimed: the share ...
Added: August 29, 2026
ХАРАКТЕРИСТИКИ КОРПУСОВ ТЕКСТОВ ДЛЯ ОБУЧЕНИЯ НЕЙРОСЕТЕЙ
Chepovskiy A., Никитина Н. Ю., В кн.: Международная конференция «Математические идеи академика П.Л. Чебышёва, их приложения в естественных науках и технологи- ях искусственного интеллекта», приуроченная к 205-й годовщине со дня его рождения» : Материалы конференции.: Калуга: Калужский печатный двор, 2026. С. 231–233.
The task of comparison of large text arrays for characteristics selection and comparison of texts in order to form training sets of texts is considered ...
Added: June 20, 2026
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit