Theoretical considerations on scaling methodology in PISA

OECD Programme for International Student Assessment (PISA) scaling methodologies are reviewed from the mathematical perspective. In particular, the paper aims to elucidate the model structures and the model assumptions of item response theory used in the item scaling phase, the latent regression mod...

Full description

Bibliographic Details
Main Author: Okubo, Tomoya
Format: eBook
Language:English
Published: Paris OECD Publishing 2022
Series:OECD Education Working Papers
Subjects:
Online Access:
Collection: OECD Books and Papers - Collection details see MPG.ReNa
LEADER 01989nma a2200229 u 4500
001 EB002138744
003 EBX01000000000000001276871
005 00000000000000.0
007 cr|||||||||||||||||||||
008 230104 ||| eng
100 1 |a Okubo, Tomoya 
245 0 0 |a Theoretical considerations on scaling methodology in PISA  |h Elektronische Ressource  |c Tomoya, Okubo 
260 |a Paris  |b OECD Publishing  |c 2022 
300 |a 31 p.  |c 21 x 28cm 
653 |a Education 
041 0 7 |a eng  |2 ISO 639-2 
989 |b OECD  |a OECD Books and Papers 
490 0 |a OECD Education Working Papers 
024 8 |a /10.1787/c224dbeb-en 
856 4 0 |a oecd-ilibrary.org  |u https://doi.org/10.1787/c224dbeb-en  |x Verlag  |3 Volltext 
082 0 |a 370 
520 |a OECD Programme for International Student Assessment (PISA) scaling methodologies are reviewed from the mathematical perspective. In particular, the paper aims to elucidate the model structures and the model assumptions of item response theory used in the item scaling phase, the latent regression model employed in the student prior estimation phase, and the population modelling and Laplace approximation performed in the multiple imputations phase. It provides insights for maximising the impact of the innovations implemented in PISA while minimising the risk of impairing the reliability and the validity of the assessments, which is essential for maintaining technically sound international assessments. Based on the theoretical considerations, the scale robustness of PISA is confirmed against the growing number of countries/economies; nevertheless, the importance of assessing the model-data fit and investigating residual structures by sub-populations are indicated in this study. Furthermore, analysis procedures for nuisance factors such as testlet effect and locally dependent items are introduced in this paper. In summary, this study provides the theoretical considerations underpinning the stability and extensibility of the PISA scale