References

Ackerman, T. A. (1992). A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. Journal of Educational Measurement, 29(1), 67–91. https://doi.org/10.1111/j.1745-3984.1992.tb00368.x

Adams, R. J., Wu, M. L., Cloney, D., & Wilson, M. R. (2020). ACER ConQuest: Generalised Item Response modelling software. Australian Council for Educational Research. https://www.acer.org/au/conquest

Agresti, A. (2002). Categorical data analysis (Second). John Wiley & Sons, Inc. https://doi.org/10.1007/978-3-642-04898-2\_161

Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705

Albano, A. D. (2016). equate: An R package for observed-score linking and equating. Journal of Statistical Software, 74(8), 1–36. https://doi.org/10.18637/jss.v074.i08

American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. American Educational Research Association.

Ames, A. J., & Penfield, R. D. (2015). An NCME instructional module on item-fit statistics for item response theory models. Educational Measurement: Issues and Practice, 34(3), 39–48. https://doi.org/10.1111/emip.12067

Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S. W., Revicki, D. A., Cella, D., Rothrock, N., Keefe, F., & Callahan, L. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150(1), 173–182. https://doi.org/10.1016/j.pain.2010.04.025

Andersen, E. B. (1970). Asymptotic properties of conditional maximum-likelihood estimators. Journal of the Royal Statistical Society: Series B (Methodological), 32(2), 283–301. https://doi.org/10.1111/j.2517-6161.1970.tb00842.x

Andersson, B., Bränberg, K., & Wiberg, M. (2013). Performing the kernel method of test equating with the package kequate. Journal of Statistical Software, 55(6), 1–25. http://www.jstatsoft.org/v55/i06/

Andersson, B., & Xin, T. (2021). Estimation of latent regression item response theory models using a second-order Laplace approximation. Journal of Educational and Behavioral Statistics, 46(2), 244–265.

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/bf02293814

Angoff, W. H., & Ford, S. F. (1973). Item-race interaction on a test of scholastic aptitude. Journal of Educational Measurement, 10(2), 95–105. https://doi.org/10.1111/j.1745-3984.1973.tb00787.x

Arbuckle, J. L. (2011). IBM SPSS Amos 20 user’s guide. Amos Development Corporation, SPSS Inc.

Baker, F. B., & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques. CRC Press.

Bartholomew, D. J., Knott, M., & Moustaki, I. (2011). Latent variable models and factor analysis: A unified approach. John Wiley & Sons.

Bartholomew, D. J., Steele, F., Galbraith, J., & Moustaki, I. (2008). Analysis of multivariate social science data. Chapman; Hall/CRC Press.

Barton, M. A., & Lord, F. M. (1981). An upper asymptote for the three-parameter logistic item-response model. ETS Research Report Series, 1981(1), i–8.

Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01

Battauz, M. (2015). equateIRT: An R package for IRT test equating. Journal of Statistical Software, 68(7), 1–22. https://doi.org/10.18637/jss.v068.i07

Battauz, M. (2019). On Wald tests for differential item functioning detection. Statistical Methods & Applications, 28(1), 103–118. https://doi.org/10.1007/s10260-018-00442-w

Battauz, M. (2020). Regularized estimation of the nominal response model. Multivariate Behavioral Research, 55(6), 811–824.

Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino, CA: Multivariate Software, Inc.

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588. https://doi.org/10.1037/0033-2909.88.3.588

Bernaards, C. A., & Jennrich, R. I. (2005). Gradient projection algorithms and software for arbitrary rotation criteria in factor analysis. Educational and Psychological Measurement, 65, 676–696.

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397–479). Addison-Wesley, Reading, MA.

Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37(1), 29–51. https://doi.org/10.1007/bf02291411

Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/bf02293801

Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35(2), 179–197. https://doi.org/10.1007/BF02291262

Bollen, K. A. (1989). Structural equations with latent variables (Vol. 210). John Wiley & Sons.

Bonifay, W. (2019). Multidimensional item response theory. Sage Publications.

Brennan, R. L. (1992). Generalizability theory. Educational Measurement: Issues and Practice, 11(4), 27–34. https://doi.org/10.1111/j.1745-3992.1992.tb00260.x

Brennan, R. L. (2006). Educational measurement. Praeger.

Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 1904–1920, 3(3), 296–322. https://doi.org/10.1111/j.2044-8295.1910.tb00207.x

Bulut, O. (2020). hemp: Handbook of educational measurement and psychometrics using R companion package. https://github.com/cddesja/hemp

Bürkner, P.-C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80(1), 1–28. https://doi.org/10.18637/jss.v080.i01

Byrd, R. H., Lu, P., Nocedal, J., & Zhu, C. (1995). A limited memory algorithm for bound constrained optimization. SIAM Journal on Scientific Computing, 16(5), 1190–1208. https://doi.org/10.1137/0916069

Cai, L. (2010a). A two-tier full-information item factor analysis model with applications. Psychometrika, 75(4), 581–612. https://doi.org/10.1007/s11336-010-9178-0

Cai, L. (2010b). Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35(3), 307–335. https://doi.org/10.1007/s11336-009-9136-x

Camilli, G., & Geis, E. (2019). Stochastic approximation EM for large-scale exploratory IRT factor analysis. Statistics in Medicine, 38(21), 3997–4012.

Candell, G. L., & Drasgow, F. (1988). An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement, 12(3), 253–260. https://doi.org/10.1177/014662168801200304

Cattell, R. B. (1943). The description of personality: Basic traits resolved into clusters. The Journal of Abnormal and Social Psychology, 38(4), 476. https://doi.org/10.1037/h0054116

Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102\_10

Cella, D., Riley, W. T., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S. W., Cook, K. F., Devellis, R., DeWalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J.-S., Pilkonis, P. A., Revicki, D. A., … PROMIS Cooperative Group. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011

Cervantes, V. H. (2017). DFIT: An R package for Raju’s differential functioning of items and tests framework. Journal of Statistical Software, 76(5), 1–24. https://doi.org/10.18637/jss.v076.i05

Chalmers, R. Philip. (2012b). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

Chalmers, R. Philip. (2012a). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

Chalmers, R. P. (2016). Generating adaptive and non-adaptive test interfaces for multidimensional item response theory applications. In Journal of Statistical Software (5; Vol. 71, pp. 1–39). https://doi.org/10.18637/jss.v071.i05

Chalmers, R. P. (2018). Improving the crossing-SIBTEST statistic for detecting non-uniform DIF. Psychometrika, 83(2), 376–386. https://doi.org/10.1007/s11336-017-9583-8

Chang, W., Cheng, J., Allaire, J., Sievert, C., Schloerke, B., Xie, Y., Allen, J., McPherson, J., Dipert, A., & Borges, B. (2021). Shiny: Web application framework for r. https://CRAN.R-project.org/package=shiny

Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1. https://doi.org/10.18637/jss.v039.i08

Chung, S., & Houts, C. (2020). flexMIRT: A flexible modeling package for Multidimensional Item Response Models. Measurement: Interdisciplinary Research and Perspectives, 18(1), 40–54. https://doi.org/10.1080/15366367.2019.1693825

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284. https://doi.org/10.1037/1040-3590.6.4.284

Clauser, B., Mazor, K., & Hambleton, R. K. (1993). The effects of purification of matching criterion on the identification of DIF using the Mantel-Haenszel procedure. Applied Measurement in Education, 6(4), 269–279. https://doi.org/10.1207/s15324818ame0604\_2

Cohen, A. C., Jr. (1955). Restriction and selection in samples from bivariate normal distributions. Journal of the American Statistical Association, 50(271), 884–893. https://doi.org/10.1080/01621459.1955.10501974

Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Academic Press. https://doi.org/10.4324/9780203771587

Cook, L. L., & Eignor, D. R. (1991). IRT equating methods. Educational Measurement: Issues and Practice, 10(3), 37–45. https://doi.org/10.1111/J.1745-3992.1991.TB00207.X

Cramp, A., & McDougall, J. (2018). Doing theory on education: Using popular culture to explore key debates. Routledge. https://doi.org/10.4324/9781315167039

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.4135/9781412961288.n54

Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. Wiley. https://doi.org/10.2307/1162145

Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281. https://doi.org/10.1037/h0040957

Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16(2), 137–163. https://doi.org/10.1111/j.2044-8317.1963.tb00206.x

Dalgaard, P. (2008). Introductory statistics with R. Springer New York. https://doi.org/10.1007/978-0-387-79054-1

Dalgaard, P. (2020). Introductory statistics with R. Springer.

Davier, A. A. von (Ed.). (2010). Statistical models for test equating, scaling, and linking. Springer.

Davier, A. A. von, Holland, P. W., & Thayer, D. T. (2004). The kernel method of test equating. Springer.

Davier, A. A. von, Mislevy, R. J., & Hao, J. (Eds.). (2021). Computational psychometrics: New methodologies for a new generation of digital learning and assessment. Springer.

Davier, M. von. (2016). Rasch model. In Handbook of item response theory, volume one (pp. 59–76). Chapman; Hall/CRC Press.

De Boeck, P., Bakker, M., Zwitser, R., Nivard, M., Hofman, A., Tuerlinckx, F., & Partchev, I. (2011). The estimation of item response models with the lmer function from the lme4 package in R. Journal of Statistical Software, 39, 1–28. https://doi.org/10.18637/jss.v039.i12

De Boeck, P., & Wilson, M. (2004). Explanatory item response models: A generalized linear and nonlinear approach. Springer Science & Business Media. https://doi.org/10.1198/tech.2006.s428

de Vries, A., & Ripley, B. D. (2020). Ggdendro: Create dendrograms and tree diagrams using ’ggplot2’. https://CRAN.R-project.org/package=ggdendro

Debelak, R., Strobl, C., & Zeigenfuse, M. D. (2022). An introduction to the Rasch model with examples in R. Chapman; Hall/CRC.

Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39(1), 1–38. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x

Dennis, J. E., Jr., Gay, D. M., & Welsch, R. E. (1981). An adaptive nonlinear least-squares algorithm. Transactions on Mathematical Software, 7(3), 348–368. https://doi.org/10.1145/355958.355965

Doob, J. L. (1935). The limiting distributions of certain statistics. The Annals of Mathematical Statistics, 6(3), 160–169. https://doi.org/10.1214/aoms/1177732594

Doolittle, A. E. (1985). Understanding differential item performance as a consequence of gender differences in academic background. Paper presented at the Annual Meeting of the American Educational Research Association; ERIC.

Drabinová, A., & Martinková, P. (2017). Detection of differential item functioning with nonlinear regression: A non-IRT approach accounting for guessing. Journal of Educational Measurement, 54(4), 498–517. https://doi.org/10.1111/jedm.12158

Drasgow, F. (2015). Technology and testing: Improving educational and psychological measurement. Routledge.

Ebel, R. L. (1954). Procedures for the analysis of classroom tests. Educational and Psychological Measurement, 14(2), 352–364. https://doi.org/10.1177/001316445401400215

Efron, B., & Tibshirani, R. J. (1994). An introduction to the bootstrap. CRC Press. https://doi.org/10.1201/9780429246593

Epskamp, S. (2019). semPlot: Path diagrams and visual analysis of  SEM packages’ output. https://CRAN.R-project.org/package=semPlot

Erosheva, E. A., Grant, S., Chen, M.-C., Lindner, M. D., Nakamura, R. K., & Lee, C. J. (2020). NIH peer review: Criterion scores completely account for racial disparities in overall impact scores. Science Advances, 6(23), eaaz4868. https://doi.org/10.1126/sciadv.aaz4868

Erosheva, E. A., Martinková, P., & Lee, C. J. (2021). When zero may not be zero: A cautionary note on the use of inter-rater reliability in evaluating grant peer review. Journal of the Royal Statistical Society: Series A (Statistics in Society), 184(3), 904--919. https://doi.org/10.1111/rssa.12681

Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272.

Ferrando, P. J. (2002). Theoretical and empirical comparisons between two models for continuous item response. Multivariate Behavioral Research, 37(4), 521–542. https://doi.org/10.1207/s15327906mbr3704\_05

Fisher, R. A. (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika, 10(4), 507–521.

Fisher, R. A. (1934). Statistical methods for research workers (5th ed.). Oliver; Boyd.

Fletcher, T. D. (2010). psychometric: Applied psychometric theory. https://CRAN.R-project.org/package=psychometric

French, B. F., & Maller, S. J. (2007). Iterative purification and effect size use with logistic regression for differential item functioning detection. Educational and Psychological Measurement, 67(3), 373–393. https://doi.org/10.1177/0013164406294781

Galton, F. (1879). Psychometric experiments. Brain, 2(2), 149–162. https://doi.org/10.1093/brain/2.2.149

Gay, D. M. (n.d.). Port library documentation. Retrieved http://www.netlib.org/port/

Goldhaber, D., Grout, C., Wolff, M., & Martinková, P. (2021). Evidence on the dimensionality and reliability of professional references’ ratings of teacher applicants. Economics of Education Review, 83, 102130. https://doi.org/10.1016/j.econedurev.2021.102130

Goldstein, G., Allen, D. N., & DeLuca, J. (2019). Handbook of psychological assessment (Fourth). Academic Press. https://doi.org/10.1016/C2014-0-01970-3

González, J. (2014). SNSequate: Standard and nonstandard statistical models and methods for test equating. Journal of Statistical Software, 59(7), 1–30. http://www.jstatsoft.org/v59/i07/

González, J., & Wiberg, M. (2017). Applying test equating methods. Using R. Springer.

Green, S. B., & Hershberger, S. L. (2000). Correlated errors in true score models and their effect on coefficient alpha. Structural Equation Modeling: A Multidisciplinary Journal, 7(2), 251–270. https://doi.org/10.1207/S15328007SEM0702\_6

Greger, D., Straková, J., & Martinková, P. (2022). Extending the ILSA study design to a longitudinal design. TIMSS & PIRLS extension in the Czech Republic: CLoSE study. In T. Nilsen, A. Stancel-Piatak, & J.-E. Gustafsson (Eds.), Springer international handbooks of education. International handbook of comparative large-scale studies in education: Perspectives, methods and findings. Springer. https://doi.org/10.1007\/978-3-030-38298-8\_31-1

Gulliksen, H. (1950). Theory of mental tests. John Wiley & Sons Inc. https://doi.org/10.1037/13240-000

Haigh, R., Tennant, A., Biering-Sørensen, F., Grimby, G., Marincek, C., Phillips, S., Ring, H., Tesio, L., & Thonnard, J.-L. (2001). The use of outcome measures in physical medicine and rehabilitation within Europe. Journal of Rehabilitation Medicine, 33, 273–278. https://doi.org/10.1080/165019701753236464

Hamilton, L. S. (1999). Detecting gender-based differential item functioning on a constructed-response science test. Applied Measurement in Education, 12(3), 211–235. https://doi.org/10.1207/S15324818AME1203\_1

Hastie, T., Tibshirani, R., & Friedman, J. H. (2009). The elements of statistical learning: Data mining, inference, and prediction (Vol. 2). Springer.

Hennig, C., Meila, M., Murtagh, F., & Rocci, R. (Eds.). (2015). Handbook of cluster analysis. Chapman and Hall/CRC Press. https://doi.org/10.1201/b19706

Hester, J., Csárdi, G., Wickham, H., Chang, W., Morgan, M., & Tenenbaum, D. (2021). Remotes: R package installation from remote repositories, including ’GitHub’. https://CRAN.R-project.org/package=remotes

Hladká, A. (2021). Statistical models for detection of differential item functioning [PhD thesis]. Charles University, Faculty of Mathematics; Physics.

Hladká, A., & Martinková, P. (2020). difNLR: Generalized logistic regression models for DIF and DDF detection. The R Journal, 12(1), 300–323. https://doi.org/10.32614/RJ-2020-014

Hladká, A., Martinková, P., & Brabec, M. (2023). Parameter estimation in generalised logistic model with application to DIF detection. arXiv Preprint arXiv:2302.12648. https://doi.org/10.48550/arXiv.2302.12648

Hladká, A., Martinková, P., & Magis, D. (2023). Combining item purification and multiple comparison adjustment methods in detection of differential item functioning. Multivariate Behavioral Research. https://doi.org/10.1080/00273171.2023.2205393

Holland, P. W. (1985). On the study of differential item performance without IRT. Proceedings of the 27th Annual conference of the Military Testing Association, 1, 282–287.

Holland, P. W., & Thayer, D. T. (1985). An alternate definition of the ETS delta scale of item difficulty. ETS Research Report Series, 1985(2), i–10. https://doi.org/10.1002/j.2330-8516.1985.tb00128.x

Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129–145). Routledge.

Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/bf02289447

Hřebı́čková, M., Jelı́nek, M., Květon, P., Benkovič, A., Botek, M., Sudzina, F., Soto, C. J., & John, O. P. (2020). Pětifaktorový dotaznı́k BFI-2: Hierarchický model s 15 subškálami. Československá Psychologie, 64(4), 437–460.

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Ippel, L., & Magis, D. (2020). Efficient standard errors in item response theory models for short tests. Educational and Psychological Measurement, 80(3), 461–475. https://doi.org/10.1177/0013164419882072

Jackson, C. H. (2011). Multi-state models for panel data: The msm package for R. Journal of Statistical Software, 38(8), 1–29. https://doi.org/10.18637/jss.v038.i08

Jackson, J. D., & Dunlevy, J. A. (1988). Orthogonal least squares and the interchangeability of alternative proxy variables in the social sciences. Journal of the Royal Statistical Society: Series D (The Statistician), 37(1), 7–14. https://doi.org/10.2307/2348374

Jodoin, M. G., & Gierl, M. J. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14(4), 329–349. https://doi.org/10.1207/S15324818AME1404\_2

Jones, L. V., & Thissen, D. (2006). A history and overview of psychometrics. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 1–27). Elsevier. https://doi.org/10.1016/S0169-7161(06)26001-2

Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8: User’s reference guide. Scientific Software International.

Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116

Kamata, A., & Bauer, D. J. (2008). A note on the relation between factor analytic and item response theory models. Structural Equation Modeling: A Multidisciplinary Journal, 15(1), 136–153. https://doi.org/10.1080/10705510701758406

Kaplan, D. (2009). Structural equation modeling: Foundations and extensions (2nd ed.). Sage Publications.

Kelley, T. L. (1927). Interpretation of educational measurements. World Book Co.

Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1/2), 81–93. https://doi.org/10.2307/2332226

Kendall, M. G., & Stuart, A. (1967). The advanced theory of statistics, volume 2: Inference and relationship. Charles Griffen & Company Limited.

Kingston, N., Leary, L., & Wightman, L. (1985). An exploratory study of the applicability of item response theory methods to the graduate management admission test. ETS Research Report Series, 1985(2), 1–56. https://doi.org/10.1002/j.2330-8516.1985.tb00119.x

Kolek, L., Šisler, V., Martinková, P., & Brom, C. (2021). Can video games change attitudes towards history? Results from a laboratory experiment measuring short-and long-term effects. Journal of Computer Assisted Learning, 37(5), 1348–1369. https://doi.org/10.1111/jcal.12575

Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking: Methods and practices (3rd ed.). Springer.

Komsta, L., & Novomestky, F. (2015). moments: Moments, cumulants, , kurtosis and related tests. https://CRAN.R-project.org/package=moments

Kopf, J., Zeileis, A., & Strobl, C. (2015). Anchor selection strategies for DIF analysis: Review, assessment, and new approaches. Educational and Psychological Measurement, 75(1), 22–56. https://doi.org/10.1177/0013164414529792

Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria: What did they really say? Organizational Research Methods, 9(2), 202–220. https://doi.org/10.1177/1094428105284919

Lane, S., Raymond, M. R., & Haladyna, T. M. (2015). Handbook of test development. Routledge. https://doi.org/10.4324/9780203102961

Lautenschiager, G. J., & Park, D.-G. (1988). IRT item bias detection procedures: Issues of model misspecification, robustness, and parameter linking. Applied Psychological Measurement, 12(4), 365–376. https://doi.org/10.1177/014662168801200404

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Lee, C. J. (2012). A Kuhnian critique of psychometric research on peer review. Philosophy of Science, 79(5), 859–870. https://doi.org/10.1086/667841

Lesnoff, M., & Lancelot, R. (2012). Aod: Analysis of overdispersed data. https://cran.r-project.org/package=aod

Li, H.-H., & Stout, W. (1996). A new procedure for detection of crossing DIF. Psychometrika, 61(4), 647–677. https://doi.org/10.1007/bf02294041

Linacre, J. M. (2021). Winsteps (version 4.8.0). Winsteps.com. https://www.winsteps.com/

Linden, W. J. van der. (2017). Handbook of item response theory. CRC Press. https://doi.org/10.1201/b19166

Liu, O. L., & Wilson, M. (2009). Gender differences in large-scale math assessments: PISA trend 2000 and 2003. Applied Measurement in Education, 22(2), 164–184. https://doi.org/10.1080/08957340902754635

Lord, F. M. (1977). A broad-range tailored test of verbal ability. Applied Psychological Measurement, 1(1), 95–100. https://doi.org/10.1177/014662167700100115

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Routledge. https://doi.org/10.4324/9780203056615

Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley, Reading, MA.

Magis, D., Beland, S., Tuerlinckx, F., & De Boeck, P. (2010). A general framework and an R package for the detection of dichotomous differential item functioning. Behavior Research Methods, 42, 847–862. https://doi.org/10.3758/brm.42.3.847

Magis, D., & Facon, B. (2012). Angoff’s delta method revisited: Improving DIF detection under small samples. British Journal of Mathematical and Statistical Psychology, 65(2), 302–321. https://doi.org/10.1111/j.2044-8317.2011.02025.x

Magis, D., & Facon, B. (2014). deltaPlotR: An R package for differential item functioning analysis with Angoff’s delta plot. Journal of Statistical Software, 59(1), 1–19. https://doi.org/10.18637/jss.v059.c01

Magis, D., & Raîche, G. (2012). Random generation of response patterns under computerized adaptive testing with the R package catR. Journal of Statistical Software, 48(8), 1–31. https://doi.org/10.18637/jss.v048.i08

Magis, D., Tuerlinckx, F., & De Boeck, P. (2015). Detection of differential item functioning using the lasso approach. Journal of Educational and Behavioral Statistics, 40(2), 111–135. https://doi.org/10.3102/1076998614559747

Magis, D., Yan, D., & Von Davier, A. A. (2017). Computerized adaptive and multistage testing with R: Using packages catR and mstR. Springer.

Mair, P. (2018). Modern psychometrics with R. Springer. https://doi.org/10.1007/978-3-319-93177-7

Mair, P., Hatzinger, R., & Maier, M. J. (2020). eRm: Extended Rasch modeling. https://cran.r-project.org/package=eRm

Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 50–60. https://doi.org/10.1214/aoms/1177730491

Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22(4), 719–748. https://doi.org/10.1093/jnci/22.4.719

Marco, G. L. (1977). Item characteristic curve solutions to three intractable testing problems. Journal of Educational Measurement, 14(2), 139–160. https://doi.org/10.1111/j.1745-3984.1977.tb00033.x

Martinková, P., Bartoš, F., & Brabec, M. (2023). Assessing inter-rater reliability with heterogeneous variance components models: Flexible approach accounting for contextual variables. Journal of Educational and Behavioral Statistics, 48(3), 349–383. https://doi.org/10.3102/10769986221150517

Martinková, P., & Drabinová, A. (2018). ShinyItemAnalysis for teaching psychometrics and to enforce routine analysis of educational tests. The R Journal, 10(2), 503–515. https://doi.org/10.32614/rj-2018-074

Martinková, P., Drabinová, A., Liaw, Y.-L., Sanders, E. A., McFarland, J. L., & Price, R. M. (2017). Checking equity: Why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE-Life Sciences Education, 16(2), rm2. https://doi.org/10.1187/cbe.16-10-0307

Martinková, P., Goldhaber, D., & Erosheva, E. A. (2018). Disparities in ratings of internal and external applicants: A case for model-based inter-rater reliability. PLoS ONE, 13(10), e0203002. https://doi.org/10.1371/journal.pone.0203002

Martinková, P., Hladká, A., & Potužníková, E. (2020). Is academic tracking related to gains in learning competence? Using propensity score matching and differential item change functioning analysis for better understanding of tracking implications. Learning and Instruction, 66, 101286. https://doi.org/10.1016/j.learninstruc.2019.101286

Martinková, P., & Netík, J. (2023). SIAmodules: Modules for ShinyItemAnalysis. http://www.ShinyItemAnalysis.org

Martinková, P., Štěpánek, L., Drabinová, A., Houdek, J., Vejražka, M., & Štuka, Č. (2017). Semi-real-time analyses of item characteristics for medical school admission tests. Proceedings of the 2017 Federated Conference on Computer Science and Information Systems (FedCSIS), 189–194. https://doi.org/10.15439/2017f380

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174. https://doi.org/10.1007/bf02296272

McFarland, J. L., Price, R. M., Wenderoth, M. P., Martinková, P., Cliff, W., Michael, J., Modell, H., & Wright, A. (2017). Development and validation of the homeostasis concept inventory. CBE-Life Sciences Education, 16(2), ar35. https://doi.org/10.1187/cbe.16-10-0305

McFarland, J. L., Wenderoth, M. P., Michael, J., Cliff, W., Wright, A., & Modell, H. (2016). A conceptual framework for homeostasis: Development and validation. Advances in Physiology Education, 40(2), 213–222. https://doi.org/10.1152/advan.00103.2015

Michael, J., Martinková, P., McFarland, J. L., Wright, A., Cliff, W., Modell, H., & Wenderoth, M. P. (2017). Validating a conceptual framework for the core concept of “cell-cell communication.” Advances in Physiology Education, 41(2), 260–265. https://doi.org/10.1152/advan.00100.2016

Moore, C. T. (2016). Gtheory: Apply Generalizability theory with R. https://CRAN.R-project.org/package=gtheory

Mosier, C. I. (1943). On the reliability of a weighted composite. Psychometrika, 8(3), 161–168. https://doi.org/10.1007/BF02288700

Muniz, J., Hambleton, R. K., & Xing, D. (2001). Small sample studies to detect flaws in item translations. International Journal of Testing, 1(2), 115–135. https://doi.org/10.1207/S15327574IJT0102\_2

Muraki, E. (1990). Fitting a polytomous item response model to Likert-type data. Applied Psychological Measurement, 14(1), 59–71. https://doi.org/10.1177/014662169001400106

Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. ETS Research Report Series, 1992(1). https://doi.org/10.1002/j.2333-8504.1992.tb01436.x

Muthén, L. K., & Muthén, B. (2017). Mplus user’s guide: Statistical analysis with latent variables, user’s guide. Muthén & Muthén.

Nagelkerke, N. J. D. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78(3), 691–692. https://doi.org/10.1093/biomet/78.3.691

Nering, M. L., & Ostini, R. (2011). Handbook of polytomous item response theory models. Routledge.

Novick, M. R., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32(1), 1–13. https://doi.org/10.1007/BF02289400

Nunnally, J. C., & Bernstein, I. (1994). Psychometric theory (2nd ed.). McGraw-Hill New York.

Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44(4), 443–460. https://doi.org/10.1007/BF02296207

Paek, I., & Han, K. T. (2013). IRTPRO 2.1 for Windows (Item Response Theory for patient-reported outcomes). Applied Psychological Measurement, 37(3), 242–252. https://doi.org/10.1177/0146621612468223

Paradis, E. (2002). R for beginners. Université Montpellier. https://cran.r-project.org/doc/contrib/Paradis-rdebuts\_en.pdf

Patz, Richard J., & Junker, B. W. (1999a). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24(2), 146–178. https://doi.org/10.3102/10769986024002146

Patz, Richard J., & Junker, B. W. (1999b). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24(4), 342–366. https://doi.org/10.3102/10769986024004342

Pearson, K. (1900). I. Mathematical contributions to the theory of evolution.—VII. On the correlation of characters not quantitatively measurable. Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character, 195(262-273), 1–47. https://doi.org/10.1098/rsta.1900.0022

Penfield, R. D., & Camilli, G. (2006). Differential item functioning and item bias. In C. R. Rao & S. Sinharay (Eds.), Psychometrics (Vol. 26, pp. 125–167). Elsevier. https://doi.org/10.1016/S0169-7161(06)26005-X

Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, anxiety, and anger. Assessment, 18(3), 263–283. https://doi.org/10.1177/1073191111411667

Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., & R Core Team. (2020). nlme: Linear and nonlinear mixed effects models. https://CRAN.R-project.org/package=nlme

R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004). Generalized multilevel structural equation modeling. Psychometrika, 69(2), 167–190.

Raju, N. S. (1988). The area between two item characteristic curves. Psychometrika, 53(4), 495–502. https://doi.org/10.1007/bf02294403

Raju, N. S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14(2), 197–207. https://doi.org/10.1177/014662169001400208

Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517.

Rasch, G. (1960). Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. Nielsen & Lydiche.

Řasová, K., Martinková, P., Soler, B., Freeman, J., Cattaneo, D., Jonsdottir, J., Smedal, T., Romberg, A., Henze, T., Santoyo-Medina, C., et al. (2020). Real-world goal setting and use of outcome measures according to the International Classification of Functioning, Disability and Health: A European survey of physical therapy practice in multiple sclerosis. International Journal of Environmental Research and Public Health, 17(13), 4774. https://doi.org/10.3390/ijerph17134774

Řasová, K., Martinková, P., Vyskotová, J., & Šedová, M. (2012). Assessment set for evaluation of clinical outcomes in multiple sclerosis: Psychometric properties. Patient Related Outcome Measures, 3, 59. https://doi.org/10.2147/prom.s32241

Rečka, K., & Cígler, H. (2020). Height inventory: A psychological attempt at measuring body height [Unpublished manuscript].

Reckase, M. D. (2009). Multidimensional item response theory models (pp. 79–112). Springer. https://doi.org/10.1007/978-0-387-89976-3

Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J., Cella, D., & PROMIS Cooperative Group. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, S22–S31. https://doi.org/10.1097/01.mlr.0000250483.85507.04

Revelle, W. (2015). An introduction to psychometric theory with applications in R.

Revelle, W. (2020). Psych: Procedures for psychological, psychometric, and personality research. Northwestern University. https://CRAN.R-project.org/package=psych

Rijmen, F., Tuerlinckx, F., De Boeck, P., & Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8(2), 185. https://doi.org/10.1037/1082-989x.8.2.185

Rizopoulos, D. (2006a). ltm: An R package for latent variable modeling and item response theory analyses. Journal of Statistical Software, 17(5), 1–25. https://doi.org/10.18637/jss.v017.i05

Rizopoulos, D. (2006b). ltm: An R package for latent variable modelling and item response theory analyses. Journal of Statistical Software, 17(5), 1–25. https://doi.org/10.18637/jss.v017.i05

Robitzsch, A., Kiefer, T., & Wu, M. (2021). TAM: Test analysis modules. https://CRAN.R-project.org/package=TAM

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

Rust, J., & Golombok, S. (2014). Modern psychometrics (3rd ed.). Routledge. https://doi.org/10.4324/9781315787527

Rust, J., Kosinski, M., & Stillwell, D. (2021). Modern psychometrics (4th ed.). Routledge. https://doi.org/10.4324/9781315637686

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34(S1), 1–97. https://doi.org/10.1007/bf03372160

Sarkar, D. (2008). Lattice: Multivariate data visualization with R. Springer. http://lmdvr.r-forge.r-project.org

Schauberger, G., & Mair, P. (2020). A regularization approach for the detection of differential item functioning in generalized partial credit models. Behavior Research Methods, 52(1), 279–294. https://doi.org/10.3758/s13428-019-01224-2

Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464. https://doi.org/10.1214/aos/1176344136

Searle, S. R., Casella, G., & McCulloch, C. E. (2009). Variance components (Vol. 391). John Wiley & Sons. https://doi.org/10.3724/sp.j.1041.2009.00889

Shealy, R., & Stout, W. (1993). A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58(2), 159–194. https://doi.org/10.1007/bf02294572

Silverman, B. W. (1981). Using kernel density estimates to investigate multimodality. Journal of the Royal Statistical Society: Series B (Methodological), 43(1), 97–99. https://doi.org/10.1111/j.2517-6161.1981.tb01155.x

Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Chapman; Hall/CRC.

Soto, C. J., & John, O. P. (2017). The next big five inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113(1), 117. https://doi.org/10.1037/pspp0000096

Spearman, C. (1904a). "General intelligence," objectively determined and measured. The American Journal of Psychology, 15(2), 201–292. https://doi.org/10.2307/1412107

Spearman, C. (1904b). The proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72–101. https://doi.org/10.2307/1412159

Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 1904-1920, 3(3), 271–295. https://doi.org/10.1111/j.2044-8295.1910.tb00206.x

Štěpánek, L., & Martinková, P. (2020). Feasibility of computerized adaptive testing evaluated by Monte-Carlo and post-hoc simulations. Proceedings of the 2020 Federated Conference on Computer Science and Information Systems (FedCSIS), 359–367. https://doi.org/10.15439/2020f197

Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103(2684). https://doi.org/10.1126/science.103.2684.677

Suh, Y., & Bolt, D. M. (2010). Nested logit models for multiple-choice item response data. Psychometrika, 75(3), 454–473. https://doi.org/10.1007/s11336-010-9163-7

Sun, J., Chen, Y., Liu, J., Ying, Z., & Xin, T. (2016). Latent variable selection for multidimensional item response theory models via L1 regularization. Psychometrika, 81(4), 921–939. https://doi.org/10.1007/s11336-016-9529-6

Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27(4), 361–370. https://doi.org/10.1111/j.1745-3984.1990.tb00754.x

Takane, Y., & De Leeuw, J. (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52(3), 393–408. https://doi.org/10.1007/BF02294363

Tělupil, D. (2018). Adaptivní testování pro odhad znalostí (Computerized adaptive testing in knowledge assessment) [Master’s thesis]. Charles University, Faculty of Mathematics; Physics.

Teresi, J. A. (2006). Overview of quantitative measurement methods: Equivalence, invariance, and differential item functioning in health applications. Medical Care, 44(11), S39–S49. https://doi.org/10.1097/01.mlr.0000245452.48613.45

Thissen, D., Cai, L., & Bock, R. D. (2011). The nominal categories item response model. In Handbook of polytomous item response theory models (pp. 53–86). Routledge.

Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. Braun (Eds.), Test validity (pp. 147–169). Hillsdale, NJ: Lawrence Erlbaum Associates.

Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–113). Lawrence Erlbaum Associates, Inc.

Thorndike, R. L. (1949). Personnel selection. Test and measurement techniques. Wiley.

Thorndike, R. M., & Thorndike-Christ, T. M. (2010). Measurement and evaluation in psychology and education (Eighth). Pearson.

Thurstone, L. L. (1947). Multiple factor analysis. University of Chicago Press.

Tukey, J. W. (1949). Comparing individual means in the analysis of variance. Biometrics, 99–114. https://doi.org/10.2307/3001913

Tutz, G., & Schauberger, G. (2015). A penalty approach to differential item functioning in Rasch models. Psychometrika, 80(1), 21–43. https://doi.org/10.1007/s11336-013-9377-6

Urry, V. W. (1977). Tailored testing: A successful application of latent trait theory. Journal of Educational Measurement, 181–196. https://doi.org/10.1111/j.1745-3984.1977.tb00035.x

Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S (Fourth). Springer. http://www.stats.ox.ac.uk/pub/MASS4

Verzani, J. (2004). Using R for introductory statistics. Chapman; Hall/CRC.

Ward, J. H., Jr. (1963). Hierarchical grouping to optimize an objective . Journal of the American Statistical Association, 58(301), 236–244. https://doi.org/10.1080/01621459.1963.10500845

Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54(3), 427–450. https://doi.org/10.1007/BF02294627

Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006). Reliability coefficients and generalizability theory. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 81–124). Elsevier. https://doi.org/10.1016/s0169-7161(06)26004-8

Welch, B. L. (1947). The generalization of Student’s problem when several different population variances are involved. Biometrika, 34(1-2), 28–35. https://doi.org/10.1093/biomet/34.1-2.28

Wiberg, M., & Bränberg, K. (2015). Kernel equating under the non-equivalent groups with covariates design. Applied Psychological Measurement, 39(5), 349–361. https://doi.org/10.1177/0146621614567939

Wiberg, M., & Sundström, A. (2009). A comparison of two approaches to correction of restriction of range in correlation analysis. Practical Assessment, Research & Evaluation, 14(5), 2. https://doi.org/10.7275/as0k-tm88

Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer-Verlag. https://ggplot2.tidyverse.org

Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T. L., Miller, E., Bache, S. M., Müller, K., Ooms, J., Robinson, D., Seidel, D. P., Spinu, V., … Yutani, H. (2019). Welcome to the tidyverse. Journal of Open Source Software, 4(43), 1686. https://doi.org/10.21105/joss.01686

Wickham, H., & Grolemund, G. (2016). R for data science: import, tidy, transform, visualize, and model data. " O’Reilly Media, Inc.".

Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin, 1(6), 80–83. https://doi.org/10.2307/3001968

Wilks, S. S. (1938). The large-sample distribution of the likelihood ratio for testing composite hypotheses. The Annals of Mathematical Statistics, 9(1), 60–62. https://doi.org/10.1214/aoms/1177732360

Yee, T. W. (2015). Vector generalized linear and additive models: With an implementation in R. Springer. https://doi.org/10.1007/978-1-4939-2818-7

Zeileis, A., & Hothorn, T. (2002). Diagnostic checking in regression relationships. R News, 2(3), 7–10. https://CRAN.R-project.org/doc/Rnews/

Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In P. W. Holland & H. Wainer (Eds.), Differential item functioning. Lawrence Erlbaum Associates, Inc.

Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s α, Revelle’s β, and McDonald’s ω H: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70(1), 123–133. https://doi.org/10.1007/s11336-003-0974-7

Zopluoglu, C. (2015). EstCRM: Calibrating parameters for the Samejima’s continuous IRT model. https://CRAN.R-project.org/package=EstCRM

Zumbo, B., & Thomas, D. (1997). A measure of effect size for a model-based approach for studying DIF (Working paper of the Edgeworth laboratory for quantitative behavioral science). Prince George, Canada: University of Northern British Columbia.