TestAssembler – Automated Test Assembly with Anchor Blocks
TestAssembler is a simple, effective tool for automated test assembly (form building or construction) using either classical test theory (CTT) or item response theory (IRT). TestAssembler was designed with one purpose in mind: to save you time and money.
Consider the time that it would take to build 8 test forms from a bank of item statistics where each form
- is equivalent in terms of content distribution and psychometric statistics;
- has internal anchor blocks that are also equivalent in terms of content distribution and psychometric statistics;
- is constrained with additional bounds on the statistics of individual items.
To do this manually would take you hours or even days. TestAssembler can complete this process in seconds and do it more accurately – meaning that TestAssembler can literally pay for itself with a single use!
Automated test assembly (ATA) is widely regarded as a valid and efficient method to the practical problem of creating test forms that are parallel and/or linked via anchor items (Davey and Hendrickson, 2010). TestAssembler is the first publicly available program designed specifically to implement ATA, bringing the power of ATA to every testing organization. It can apply both classical test theory (CTT) and item response theory (IRT).
What does TestAssembler do?
- Produces a high-quality Rich Text File (.rtf) report complete with title page, colored headings, tables, narrative, and explanations of the results
- For CTT assembly: Estimates the mean and standard deviation of raw (number-correct) scores on each form
- For IRT assembly: Provides plots of the test response function(s) and item information function(s) separately for each form
- Allows you to specify a higher minimum discrimination statistic for anchor items, so that better items are selected as anchors
- Simultaneously build up to 9 forms
- For CTT tests there are two options for the psychometric targets of both the internal anchor block and the total form: mean difficulty (P) and a grouped frequency distribution of P
- For IRT tests you can specify a psychometric target based on the mean difficulty (b) parameter
- Allows for item banks up to 1,000 items
- Input of item bank statistics is by a simple text file with item statistics and content codes
- Includes a detailed manual that explains the input, output, and operation of the program