NMST 570 Selected topics in psychometrics
(Vybraná témata z psychometrie)

Syllabus (last update: October 5, 2021)
Course description in English and in Czech.
Pages of a related course Seminar in Psychometrics.

This is ARCHIVE. Go to pages of current semester.

Course schedule

Lecture: Tuesday, 3:40-4:30pm, K4, Sokolovská 83, Praha 8 - Karlín.
Lab session: Tuesday, 4:30-5:10pm, K4, Sokolovská 83, Praha 8 - Karlín.
Online: Link for ZOOM sessions will be sent to registered students via e-mail.


(Sep 6, 2021) Course starts on October 5, 2021.

Course description

Psychometrics uses statistical models for analysis of educational, psychological, or patient-reported measurements. This course covers computational aspects of main topics in psychometrics including reliability and validity of measurement, traditional item analysis, use of regression models for item description, item response theory (IRT) models, differential item functioning (DIF), computerized adaptive testing (CAT), and an overview of further topics. Methods are demonstrated using data of behavioral measurements from different areas. Exercises are prepared in freely available statistical software R, other psychometric software is also introduced.

Tentative course plan

Welcome! (1.10.2021) Welcome message (via e-mail)
R setupPerusallR code on GitHubProject
Lesson 1 (5.10.2021) Introduction
SlidesDataR codeR tutorial   Exercises html, Rmd
Lesson 2 (12.10.2021) Measurement data
SlidesDataR codeR tutorial   HW html, Rmd (due 18.10.) 
Lesson 3 (19.10.2021) Validity of measurement
SlidesR codeR tutorial   HW html, Rmd (due 25.10.) 
Lesson 4 (26.10.2021) Reliability and measurement error
SlidesR codeR tutorial
Lesson 5 (2.11.2021) Reliability (cont.)
SlidesR codeR tutorial   HW html, Rmd (due 8.11.) 
Lesson 6 (9.11.2021) Item analysis
SlidesR codeR tutorial
Lesson 7 (16.11.2021) Item analysis II. (polytomous)
SlidesR codeR tutorial   HW html, Rmd (due 22.11.) 
Lesson 8 (23.11.2021) Item response theory (IRT) models
SlidesR codeR tutorial
Lesson 9 (30.11.2021) Polytomous IRT models
SlidesR codeR tutorial
Lesson 10 (7.12.2021) Factor analytic approach, multidimensional IRT
SlidesR code   HW html, Rmd (due 13.12.) 
Lesson 11 (14.12.2021) Differential item functioning (DIF)
SlidesR code   HW html, Rmd (due 20.12.) 
Lesson 12 (21.12.2021) Computerized adaptive testing (CAT).
SlidesR code
Lesson 13 (4.1.2022) Further topics in psychometrics, closing.
Slides  Final project pdf, Rmd

Grading policy

Each week, students are expected to be actively present in lecture (45 minutes), and lab session (45 minutes). Lecture may take form of a Zoom meeting and/or video presentation and/or individual work on assignment. Lab session provides hints and solutions for homework assignments which will involve calculations, software implementation, and reading. Part of the assignments will ask students to annotate readings using perusall.com.

Course credit requirements

The credit for the exercise class will be awarded to the student who hands in satisfactory solutions to homework assignments (7 assignments in total, requiring 60% of total points) by the prescribed deadline. It is possible to skip up to 4 assignments and to provide satisfactory feedback (at least 10 relevant annotations) to readings instead. Homework will be assigned during lab sessions and will be due by the end of the week.

Exam and grade

Final project will be assigned during the course. Students can work in teams of size 2 or 3, multidisciplinary teams are preferred. Teams are welcome and encouraged to use their own data for the project in lieu of the data assigned to the class. In such a case, teams are expected to prepare written project proposal and submit it to the lecturer during the first month of the course. Final grade will be assigned during oral examination, which will take into account project (40%), homework assignments (40%, one HW with lowest grade is being dropped), and answers to follow-up question(s) (20%). Project report needs to be submitted at least 2 days before oral exam, one feedback is provided to projects sent to the instructor at least two weeks before the oral exam.

Course texts

Computational aspects of psychometric methods. With R. (Book in preparation)
Rao, C. R. & Sinharay S. (2006). Handbook of statistics. Volume 26: Psychometrics. Amsterdam, NL: Elsevier.
van der Linden, W. J. (2016). Handbook of item response theory: Models, statistical tools, and applications (Vols.1-3). Boca Raton, FL: Chapman & Hall/CRC.

© 2022 Patrícia Martinková / Template design adapted from Andreas Viklund