Measurement invariance, factor analysis and factorial invarianceMeredith, William
doi: 10.1007/bf02294825pmid: N/A
Abstract Several concepts are introduced and defined: measurement invariance, structural bias, weak measurement invariance, strong factorial invariance, and strict factorial invariance. It is shown that factorial invariance has implications for (weak) measurement invariance. Definitions of fairness in employment/admissions testing and salary equity are provided and it is argued that strict factorial invariance is required for fairness/equity to exist. Implications for item and test bias are developed and it is argued that item or test bias probably depends on the existence of latent variables that are irrelevant to the primary goal of test constructers.
A latent class unfolding model for analyzing single stimulus preference ratingsDe Soete, Geert;Heiser, Willem J.
doi: 10.1007/bf02294826pmid: N/A
Abstract A multidimensional unfolding model is developed that assumes that the subjects can be clustered into a small number of homogeneous groups or classes. The subjects that belong to the same group are represented by a single ideal point. Since it is not known in advance to which group of class a subject belongs, a mixture distribution model is formulated that can be considered as a latent class model for continuous single stimulus preference ratings. A GEM algorithm is described for estimating the parameters in the model. The M-step of the algorithm is based on a majorization procedure for updating the estimates of the spatial model parameters. A strategy for selecting the appropriate number of classes and the appropriate number of dimensions is proposed and fully illustrated on some artificial data. The latent class unfolding model is applied to political science data concerning party preferences from members of the Dutch Parliament. Finally, some possible extensions of the model are discussed.
A monotonically convergent algorithm for factalsKiers, Henk A. L.;Takane, Yoshio;Mooijaart, Ab
doi: 10.1007/bf02294827pmid: N/A
Abstract Takane, Young, and de Leeuw proposed a procedure called FACTALS for the analysis of variables of mixed measurement levels (numerical, ordinal, or nominal). Mooijaart pointed out that their algorithm does not necessarily converge, and Nevels proposed a new algorithm for the case of nominal variables. In the present paper it is shown that Nevels' procedure is incorrect, and a new procedure for handling nominal variables is proposed. In addition, a procedure for handling ordinal variables is proposed. Using these results, a monotonically convergent algorithm is constructed for FACTALS of any mixture of variables.
Ability estimation for conventional testsKim, Jwa K.;Nicewander, W. Alan
doi: 10.1007/bf02294829pmid: N/A
Abstract Five different ability estimators—maximum likelihood [MLE (θ)], weighted likelihood [WLE (θ)], Bayesian modal [BME (θ)], expected a posteriori [EAP (θ)] and the standardized number-right score [Z (θ)]—were used as scores for conventional, multiple-choice tests. The bias, standard error and reliability of the five ability estimators were evaluated using Monte Carlo estimates of the unknown conditional means and variances of the estimators. The results indicated that ability estimates based on BME (θ), EAP (θ) or WLE (θ) were reasonably unbiased for the range of abilities corresponding to the difficulty of a test, and that their standard errors were relatively small. Also, they were as reliable as the old standby—the number-right score.
Fisher transformations for correlations corrected for selection and missing dataMendoza, Jorge L.
doi: 10.1007/bf02294830pmid: N/A
Abstract The validity of a test is often estimated in a nonrandom sample of selected individuals. To accurately estimate the relation between the predictor and the criterion we correct this correlation for range restriction. Unfortunately, this corrected correlation cannot be transformed using Fisher'sZ transformation, and asymptotic tests of hypotheses based on small or moderate samples are not accurate. We developed a Fisherr toZ transformation for the corrected correlation for each of two conditions: (a) the criterion data were missing due to selection on the predictor (the missing data were MAR); and (b) the criterion was missing at random, not due to selection (the missing data were MCAR). The twoZ transformations were evaluated in a computer simulation. The transformations were accurate, and tests of hypotheses and confidence intervals based on the transformations were superior to those that were not based on the transformations.
On quantifying different types of categorical dataNishisato, Shizuhiko
doi: 10.1007/bf02294831pmid: N/A
Abstract In quantifying categorical data, constraints play an important role in characterizing the outcome. In the Guttman-type quantification of contingency tables and multiple-choice data (incidence data), the trivial solution due to the marginal constraints is typically removed before quantification; this removal, however, has the effect of distorting the shape of the total space. Awareness of this is important for the interpretation of the quantified outcome. The present study provides some relevant formulas for those cases that are affected by the trivial solution and those cases that are not. The characterization of the total space used by the Guttman-type quantification and pertinent discussion are presented.