An absolutely essential, but often the most misunderstood and opaque, step in developing a defensible test is statistical analysis of response data. It is full of daunting terms like point-biserial correlation, conditional standard error of measurement, test information function, and coefficient alpha. Our PhD psychometricians excel not only in utilizing best practices and leading-edge software to perform these analyses, but providing the results with understandable explanations that allow you and your subject matter experts to truly increase the quality of your test by modifying the content appropriately. Whether using classical test theory or item response theory, we provide the feedback you need to evaluate test score reliability and validity, as well as individual item performance.
Well, suppose that we analyze a test question whose correct answer is A, but find that only 40% of your candidates got it correct (item difficulty). Meanwhile, just as many candidates answered B. This item would be flagged and discussed with your experts, who might point out something like “Only candidates who have completed a special training course would know how to answer this question.” Even though the answer is technically correct, the statistics have helped flag an issue with the item, and it might be retired or rewritten.
Have psychometric talent in-house and just need the world’s best software for conducting these analyses? Iteman and Xcalibre provide user-friendly interfaces and automatically create Microsoft Word reports with all the tables and graphs already embedded for you. Or, start using our best-in-class platform FastTest and have the reports ready-made for you!