Классический и современный подходы к измерению валидности заданий на взаимное оценивание в МООК
The article presents the results of research on validity of peer-review assignments in massive open online courses within the framework of classical test theory (CTT) and item response theory (IRT). CTT-based analysis yielded data on convergent validity of the peer-review assignment, the low level of its criterion validity, and rater disagreement. IRT-based analysis revealed rater bias and established that experts largely tend to be lenient and overrate their peers. The findings are used to discuss the advantages and disadvantages of the psychometric theories in question and the opportunities for combining the two.
This paper studies the results of integration of massive open online courses (MOOCs) into curriculum of the ESP (English for specific purposes) course at the department of Business Informatics of the National Research University Higher School of Economics (HSE). The experimental teaching with integration of MOOK component in the ESP course have demonstrated that the educational outcome in this case may be higher than in a traditional course, due to the increase of students motivation provided by individualized learning, the use of modern authentic teaching materials, participation in international educational community. Research findings illustrate that imbedding MOOCs in the university ESP course could become the basis for the integrated study of special subjects and the English language in the international learning community, under the condition that on-campus courses have been re-designed to incorporate MOOC-like components.
E-learning development comes with an increased attention to its quality that is managed via the control over not only the learners’ knowledge but over the learning process, its organization and applied tools. This paper covers Tomsk State University experience in MOOC quality evaluation, in particular popular science MOOCs and specialized ones. The quality evaluation system implies the evaluation of the MOOC materials, the learning process and the results.
Massive open online courses (MOOCs) are increasingly popular among students of various ages and at universities around the world. The main aim of a MOOC is growth in students’ proficiency. That is why students, professors, and universities are interested in the accurate measurement of growth. Traditional psychometric approaches based on item response theory (IRT) assume that a student’s proficiency is constant over time, and therefore are not well suited for measuring growth. In this study we sought to go beyond this assumption, by (a) proposing to measure two components of growth in proficiency in MOOCs; (b) applying this idea in two dynamic extensions of the most common IRT model, the Rasch model; (c) illustrating these extensions through analyses of logged data from three MOOCs; and (d) checking the quality of the extensions using a cross-validation procedure. We found that proficiency grows both across whole courses and within learning objectives. In addition, our dynamic extensions fit the data better than does the original Rasch model, and both extensions performed well, with an average accuracy of .763 in predicting students’ responses from real MOOCs.
INTED2018 Proceedings. 12th International Technology, Education and Development Conference Valencia, Spain. 5-7 March, 2018.
The paper is devoted to the main aspects of using MOOCs as a part of university curriculum. HSE University has the expertise of implementation of blended learning using our own 53 MOOCs on Coursera and 27 MOOCs on Russian National Open Education Platform and courses of other universities. The emphasis will be on institutional decisions, organizational schemes and management solutions that allow to recognize MOOCs’ results and transfer them into university credits (ESTC).
Successful online learning if we look outside the didactics but in the field of personal development, from the anthropological bases, is in learner’s identification as an active subject of the learning process. Activities that online learners perform correlate with the characteristics of the subjectness that researchers revealed: spotting one’s own gaps in the educational environment and one’s educational needs, satisfying them and enhancing one’s competence by means of online learning (ability to change the environment and oneself inside that, reflexive way of life, realizing the principle of development), searching, selecting and studying online courses on one’s own, supported first and foremost by the intrinsic motivation (initiative), ability to plan and analyze one’s activity or inaction in the course, managing the requirements and the deadlines of the assignments, as well as readiness to accept the consequences of one’s choice (responsibility). Therefore, successful online learners (those who study on their own, cope with the tasks in time and in a proper way, achieve expected results) are characterized with such a subjectness that is based on a set of general-cultural and general-professional competencies that should be formed. To define the set of competencies, which an online learner needs to become successful and to study learners’ attitude to them, we have done a competency-based test (self-assessment questionnaire) in September - November 2017. The respondents were 2060 learners from TSU online courses offered on three e-learning platforms (population is 80938). Learners responded that the following general-cultural competencies are of much help for them in online learning: readiness to self-development, self-realization and using one’s own creativity (69,7%), ability to organize and educate oneself (53,3%), ability to acquire new scientific and professional knowledge using modern educational and informational technologies (62,3%), as well as ability to imply means and methods of learning and self-control over one’s intellectual development, increasing one’s cultural level and professional competence (50,2%). Among general-professional competencies the learners replied that the most useful competencies for online learning are computer skills for receiving, processing and managing information (79,5%), ability to work with the main retrieval query systems (60,2%), ability to search for scientific information, perform its critical analysis, to set research objectives and choosing appropriate methods and technologies to achieve them (59,3%), ability to critically analyze the learning process and training materials from the point of view of their effectiveness (54%) and ability to use polite manners in oral and written speech (21,9%). At the same time, the respondents define general-cultural competencies as more significant. Therefore, the survey results proved our idea that successful online learning requires firstly, a set of general-cultural competences (those which are connected to the learner’s personal development and his/ her subjectness in the learning process) and secondly, a set of general-professional competencies to be formed. This led us to the idea that assessing learner’s level of the general-cultural competences we can predict his/ her future success in taking online courses.
This paper studies the results of Massive Open Online Courses (MOOCs) integration into the ESP course curriculum at the department of Business Informatics of the National Research University Higher School of Economics (HSE). The author claims that MOOCs can be effectively integrated into the teaching-learning process and bring significant benefits to students such as developing their linguistic and professional competencies. A survey and the results of the experimental teaching revealed that HSE students highly appreciated their experience of online education and would definitely continue to explore the scope of MOOCs in the future. Research findings illustrate that embedding MOOCs into the university ESP course could become the basis for the integrated study of special subjects and the English language in the international learning community under the condition that on-campus courses have been re-designed to incorporate MOOC-like components. MOOCs can be considered as a valuable educational resource for information technology specialists, which can be beneficially used by both students and ESP instructors.
Institutions affect investment decisions, including investments in human capital. Hence institutions are relevant for the allocation of talent. Good market-supporting institutions attract talent to productive value-creating activities, whereas poor ones raise the appeal of rent-seeking. We propose a theoretical model that predicts that more talented individuals are particularly sensitive in their career choices to the quality of institutions, and test these predictions on a sample of around 95 countries of the world. We find a strong positive association between the quality of institutions and graduation of college and university students in science, and an even stronger negative correlation with graduation in law. Our findings are robust to various specifications of empirical models, including smaller samples of former colonies and transition countries. The quality of human capital makes the distinction between educational choices under strong and weak institutions particularly sharp. We show that the allocation of talent is an important link between institutions and growth.