Skip to main content
Log in

Optimal Designs for the Rasch Model

  • Published:
Psychometrika Aims and scope Submit manuscript

Abstract

In this paper, optimal designs will be derived for estimating the ability parameters of the Rasch model when difficulty parameters are known. It is well established that a design is locally D-optimal if the ability and difficulty coincide. But locally optimal designs require that the ability parameters to be estimated are known. To attenuate this very restrictive assumption, prior knowledge on the ability parameter may be incorporated within a Bayesian approach. Several symmetric weight distributions, e.g., uniform, normal and logistic distributions, will be considered. Furthermore, maximin efficient designs are developed where the minimal efficiency is maximized over a specified range of ability parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1.
Figure 2.
Figure 3.
Figure 4.
Figure 5.
Figure 6.
Figure 7.
Figure 8.
Figure 9.

Similar content being viewed by others

References

  • Atkinson, A.C., Donev, A.N., & Tobias, R.D. (2007). Optimum experimental designs, with SAS. Oxford: Oxford University Press.

    Google Scholar 

  • Berger, M.P.F., King, C.Y.J., & Wong, W.K. (2000). Minimax D-optimal designs for item response theory models. Psychometrika, 65, 377–390.

    Article  Google Scholar 

  • Berger, M.P.F., & Wong, W.K. (2009). An introduction to optimal designs for social and biomedical research. Chichester: Wiley.

    Book  Google Scholar 

  • Braess, D., & Dette, H. (2007). On the number of support points of maximin and Bayesian optimal designs. Annals of Statistics, 35, 772–792.

    Article  Google Scholar 

  • Buyske, S. (2005). Optimal design in educational testing. In M.P.F. Berger & W.K. Wong (Eds.), Applied optimal designs (pp. 1–19). New York: Wiley.

    Chapter  Google Scholar 

  • Chaloner, K. (1993). A note on optimal Bayesian design for nonlinear problems. Journal of Statistical Planning and Inference, 37, 229–235.

    Article  Google Scholar 

  • Chaloner, K., & Larntz, K. (1989). Optimal Bayesian design applied to logistic regression experiments. Journal of Statistical Planning and Inference, 21, 191–208.

    Article  Google Scholar 

  • Dette, H. (1997). Designing experiments with respect to ‘standardized’ optimality criteria. Journal of the Royal Statistical Society. Series B, 59, 97–110.

    Article  Google Scholar 

  • Dette, H., & Neugebauer, H.-M. (1996). Bayesian optimal one point designs for one parameter nonlinear models. Journal of Statistical Planning and Inference, 52, 17–31.

    Article  Google Scholar 

  • Firth, D., & Hinde, J.P. (1997). On Bayesian D-optimum design criteria and the equivalence theorem in non-linear models. Journal of the Royal Statistical Society. Series B, 59, 793–797.

    Article  Google Scholar 

  • Graßhoff, U., & Schwabe, R. (2008). Optimal design for the Bradley–Terry paired comparison model. Statistical Methods and Applications, 17, 275–289.

    Article  Google Scholar 

  • Kiefer, J. (1974). General equivalence theory for optimum designs (approximate theory). Annals of Statistics, 2, 849–879.

    Article  Google Scholar 

  • van der Linden, W.J. (2005). Linear models for optimal test design. New York: Springer.

    Google Scholar 

  • van der Linden, W.J., & Pashley, P.J. (2010). Item selection and ability estimation adaptive testing. In W.J. van der Linden & C.A.W. Glas (Eds.), Elements of adaptive testing (pp. 3–30). New York: Springer.

    Chapter  Google Scholar 

Download references

Acknowledgements

This research was supported by the Deutsche Forschungsgemeinschaft (DFG) under grant HO 1286/6-1. The authors would like to thank Norbert Gaffke for helpful discussions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Heinz Holling.

Appendix: Proofs

Appendix: Proofs

For the proofs we may assume throughout that θ 0=0, which can be achieved by a location shift without loss of generality.

Proof of Lemma 1

Let F(z)=1/(1+exp(−z)) be the distribution function of the standard logistic distribution. We will employ that F′(z)=f(z)=F(z)(1−F(z)) and, hence, f′(z)=f(z)(1−2F(z)).

  1. (i)

    We set ψ(σ)=Ψ 1(ξ σ ).

For the derivatives of ψ we obtain ψ′(σ)=∫(1−2F(θσ))f(θσ)−1Π(dθ), which results in ψ′(0)=∫(1−2F(θ))f(θ)−1Π(dθ), where the integration with respect to θ and the differentiation with respect to σ may be interchanged under suitable regularity conditions on the weight distribution Π. Since Π is symmetric around θ 0=0 and since F(z)=1−F(−z), we have \(\int F(\theta) f(\theta)^{-1}\, \varPi( {\mathrm{d}} \theta)=\int (1-F(\theta)) f(\theta)^{-1}\, \varPi( {\mathrm{d}} \theta)=\frac{1}{2} \int f(\theta)^{-1}\, \varPi( {\mathrm{d}} \theta)\), and, hence, ψ′(0)=0. Further ψ″(σ)=ψ(σ)−2>0 implies that ψ is convex, such that ψ(σ)=Ψ 1(ξ σ ) is minimized for σ=θ 0.

  1. (ii)

    For Ψ 2 we obtain \(\frac{\partial}{\partial\sigma} \varPsi_{2}(\xi_{\sigma})= -\int\frac {\partial}{\partial\sigma} \log(f(\theta-\sigma))\, \varPi( {\mathrm{d}} \theta)=1-2 \int F(\theta-\sigma)\, \varPi( {\mathrm{d}} \theta)\).

Similar arguments as used in (i) lead to \(\int F(\theta)\, \varPi( {\mathrm{d}} \theta )=\int F(-\theta)\, \varPi( {\mathrm{d}} \theta)=\frac{1}{2}\) and, consequently, \(\frac{\partial}{\partial\sigma}\varPsi_{2}(\xi_{\sigma })|_{\sigma=0} =0\).

As the second derivative, \(\frac{\partial^{2} }{\partial\sigma^{2}} \varPsi_{2}(\xi_{\sigma})=-\int\frac {\partial^{2} }{\partial\sigma^{2}}\log(f(\theta-\sigma))\, \varPi( {\mathrm{d}} \theta)= 2 \int f(\theta-\sigma)\, \varPi( {\mathrm{d}} \theta)\allowbreak >0\), is positive for all σ, the criterion Ψ 2(ξ σ ) is convex in σ and, hence, Ψ 2(ξ σ ) is minimized for σ=θ 0. □

Proof of Theorem 1

(a) For the sensitivity function d 1(σ;ξ 0), the derivatives are \(d_{1}'(\sigma;\xi_{0})= -c \int(1-2\, F(\theta-\sigma)) f(\theta-\sigma) f(\theta)^{-2}\, \varPi( {\mathrm{d}} \theta)\) and \(d_{1}''(\sigma;\xi_{0})=c \int(1-6 f(\theta-\sigma)) f(\theta-\sigma ) f(\theta)^{-2}\, \varPi( {\mathrm{d}} \theta)\), where c=(∫f(θ)−1Π(dθ))−1. For the point σ=0 we obtain \(d_{1}'(0;\xi_{0})=0\) and \(d_{1}''(0;\xi_{0})= 1-6 c\). Thus, the necessary condition \(d_{2}''(0;\xi_{0})\leq0\) is equivalent to c −1=∫f(θ)−1Π(dθ)≤6.

(b) For the one-point design \(\xi_{\sigma^{*}}=\xi_{0}\) at σ =θ 0=0 the first and the second derivatives of d 2 with respect to σ can be calculated as \(d_{2}'(\sigma;\xi_{0})=-\int(1-2 F(\theta-\sigma)) \frac{f(\theta-\sigma)}{f(\theta)}\, \varPi( {\mathrm{d}} \theta)\) and \(d_{2}''(\sigma;\xi_{0})=\int(1-6 f(\theta-\sigma)) \frac{f(\theta-\sigma)}{f(\theta)}\, \varPi( {\mathrm{d}} \theta)\).

For σ=0 this gives \(d_{2}'(0;\xi_{0})=0\) and \(d_{2}''(0;\xi _{0})=\int(1-6 f(\theta))\, \varPi( {\mathrm{d}} \theta)\). Hence, the necessary condition \(d_{2}''(0;\xi_{0})\leq0\) for a maximum is equivalent to \(\int f(\theta)\, \varPi( {\mathrm{d}} \theta)\geq\frac {1}{6}\). □

Proof of Theorem 2

(i) Let γ 1(τ)=∫f(τθ)−1Π(dθ) and note that ∫f(θ)−1Π τ (dθ)=γ 1(τ). The integrand f(τθ)−1 in γ 1 is strictly continuously increasing in τ for all θ. Therefore, γ 1 is a strictly increasing continuous function in τ with γ 1(0)=4 and γ 1(τ)→∞ for τ→∞. Then τ 1 is the unique solution of γ 1(τ)=6.

Similarly, γ 2(τ)=∫f(τθ) Π(dθ)=∫f(θ) Π τ (dθ) is a strictly decreasing function with \(\gamma_{2} (0) = \frac{1}{4}\) and \(\gamma_{2} (\tau) \to\frac{1}{4} \pi _{0}\) for τ→∞, where π 0 is the weight of Π in θ 0=0. Hence, τ 2 can be chosen as the unique solution of \(\gamma_{2} (\tau) = \frac{ 1}{6}\), if \(\pi_{0} < \frac{ 2}{3}\), and τ 2=∞ otherwise. As γ 1(τ)≥1/γ 2(τ), by Jensen’s inequality, we may conclude that τ 1τ 2.

(ii) For fixed σ let \(g_{\tau} (\theta) = \frac{f(\tau \theta + \sigma) + f (\tau \theta - \sigma)}{ f (\tau \theta)}\). Denote by d 2,τ the sensitivity function when the weight distribution Π τ is used. Then, \(d_{2,\tau} (\sigma; \xi_{0}) = \int^{\infty}_{0} g_{\tau} (\theta) \, \varPi( {\mathrm{d}} \theta)\) due to symmetry considerations.

Now, \(\frac{\partial}{\partial\tau} g_{\tau} (\theta) \geq\theta g_{\tau} (\theta) [( F (\tau \theta) - F( - \tau \theta)) - (F (\tau \theta- \sigma) - F ( -\tau, \theta- \sigma))]\), and the term within the brackets is positive for σσ =0 due to the strict unimodality of f=F′ at zero. Hence, \(d_{2,\tau} (\sigma; \xi_{0}) = \int^{\infty}_{0} g_{\tau} (\theta) \, \varPi( {\mathrm{d}} \theta)\) is increasing continuously in τ for each σ. Thus, max σ d 2,τ (σ;ξ 0) is an increasing continuous function in τ, as long as it is bounded by 1 and \(\tilde{\tau}_{2}\) may be chosen as the largest value for τ satisfying max σ d 2,τ (σ;ξ 0)=1. Obviously, \(\tilde{\tau}_{2}\) cannot exceed τ 2 obtained from the necessary condition. □

Proof of Corollary 1

If Π is symmetric around θ 0=0, it may be represented as a mixture of symmetric two-point weight distributions Π θ , which assign equal weights 1/2 to each of ±θ. Denote by \(\tilde{\varPi}\) the corresponding mixing distribution, which is the image of Π under the mapping of the absolute value, and denote by Ψ i,θ (ξ) the value of the criterion function Ψ i for design ξ when the weight distribution Π θ is used. From Example 4.1 we obtain Ψ i,θ (ξ)≥Ψ i,θ (ξ 0) for every design ξ, if \(|\theta|\leq\tilde{\tau}=\log (2+\sqrt{3}\,)\). As Π is supported within \([-\tilde{\tau},\tilde{\tau }]\) we may conclude

$$\varPsi_i(\xi)=\int \varPsi_{i,\theta}(\xi)\, \varPi( {\mathrm{d}} \theta) \geq \int \varPsi_{i,\theta}(\xi_0)\, \varPi( {\mathrm{d}} \theta)=\varPsi_i(\xi_0), $$

which establishes the optimality of \(\xi_{\sigma^{*}}\) for σ =θ 0=0 with respect to Ψ i . □

Proof of Theorem 3

The assumption \(\theta_{0}=\frac{1}{2} (\theta_{1} + \theta_{2})=0\) implies that the range is centered, i.e. θ 1=−θ 2. Due to invariance considerations we may restrict the search for maximin efficient designs to those which are symmetric around θ 0=0, as for any symmetric region |θ|≤θ 2 we have \(\min_{|\theta| \leq\theta_{2}} \operatorname{eff}(\xi; \theta) \leq \min_{|\theta| \leq\theta_{2}} \operatorname{eff} ( \bar{\xi}; \theta )\) for every design ξ, where \(\bar{\xi} = \frac{1}{2} (\xi+ \xi^{-})\) is its symmetrization and ξ is the image of ξ under sign change (see Graßhoff & Schwabe, 2008).

First we consider symmetric two-point designs \(\bar{\xi}_{\sigma} = \frac{1}{2} (\xi_{\sigma} + \xi_{-\sigma}) \), which assign equal weights 1/2 to ±σ each. The corresponding information \(M (\bar{\xi}_{\sigma} ; \theta) = \frac{1}{2} (f ( \theta-\sigma) + f ( \theta+\sigma))\) equals the Bayesian criterion \(\varPsi_{1} (\xi_{ \sigma} ) = \frac{1}{2} (f ( \theta-\sigma) + f( -\theta-\sigma))\) for the one-point design ξ σ , when the symmetric two-point prior on ±θ is used. According to Example 1 of Section 4 this criterion is majorized by Ψ 1(ξ 0)=f(θ)=M(ξ 0;θ) as long as \(|\theta| \leq\tilde{\tau}= \log(2 + \sqrt{3}\,)\).

Hence, \(M ( \bar{\xi}_{\sigma} ; \theta) \leq M ( \xi_{0} ; \theta)\) uniformly in \(|\theta| \leq\tilde{\tau}\). Note that also ξ 0 is, of course, symmetric around 0. Now every design \(\bar{\xi}\), which is symmetric around 0, can be written as a mixture of symmetric two-point designs \(\bar{\xi}_{\sigma}\) and, hence, \(M( \bar{\xi} ; \theta) = \int M ( \bar{\xi}_{\sigma} ; \theta) \tilde{\xi} ({\mathrm{d}} \sigma)\), where \(\bar{\xi}\) is a suitable mixing measure. This implies \(M ( \bar{\xi} ; \theta) \leq M (\xi_{0} ; \theta )\) for all \(|\theta| \leq\tilde{\tau}\).

Combining the above results yields \(\min_{|\theta| \leq\theta _{2}} \operatorname{eff}(\xi; \theta) \leq\min_{|\theta| \leq\theta _{2}} \operatorname{eff} (\xi_{\sigma^{*}} ; \theta)\) for every \(\theta_{2} \leq\nobreak \tilde{\tau}\), which establishes the result. □

Rights and permissions

Reprints and permissions

About this article

Cite this article

Graßhoff, U., Holling, H. & Schwabe, R. Optimal Designs for the Rasch Model. Psychometrika 77, 710–723 (2012). https://doi.org/10.1007/s11336-012-9276-2

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11336-012-9276-2

Key words

Navigation