The Classical Item and Test Analysis Spreadsheet (CITAS) is one of our most popular products, for two reasons:

  1.  It is the best software available for basic psychometric analysis, if you don’t want/need to learn complex products like Iteman
  2. It is free.

I recently released a new version of CITAS based on some feedback I’ve received.  It hasn’t been updated for about 5 years, so it was about time.

What’s New?

The biggest change is that it has been expanded from 50 items/examinees to 100 items/examinees.  This allows it to be used for larger samples, such as medium-sized university courses or small credentialing exams.  Classical test theory statistics become more stable as sample sizes approach 100, so this makes sense

I also added a deeper distractor analysis.  Previously, CITAS did not include option point-biserials, which are considered essential by most psychometricians.  I’ve added that, and also have implemented conditional formatting in Excel so that cells <0 are red and values 0<0.2 are yellow.

A score distribution graph has been added to the primary output tab.

A number of smaller changes were implemented, including an update to informational links.

I haven’t used it yet.  What is CITAS?

CITAS is a spreadsheet I built in 2009 as part of a course I was teaching in Measurement and Assessment.  I didn’t want students to have to learn how to run professional-level analysis software like Iteman or SPSS; instead, I wanted them to be able to get results as quickly and easily as possible, so they could focus on learning how to interpret statistics rather than navigate complex software.

CITAS filled this need.  All a user needs to do is paste in their data, and the statistics will automatically populate.  There is no data file formatting or “running” a program with various specifications to choose.  This of course makes CITAS of little use for professionals that need large data files or complex specs, but is perfect for someone who is new to psychometrics or just wants a basic analysis on a small data set.

An example of the output is below.  CITAS calculates essential statistics like item P, item Rpbis, KR-20 reliability, and standard error of measurement (SEM).

classical test theory citas

I’m totally new to assessment.  What is classical test theory?

For starters, psychometrics is the Science of Assessment.  That is, a body of scientific research on how to make assessments better, regardless of whether they are in Education, Credentialing, Employment/HR, or other applications.

There are two dominant paradigms in psychometrics.  Classical test theory (CTT) is, as the name would suggest, much older and based on simple mathematics like means, proportions, and correlations.  Item response theory (IRT) is far more complex, based on sophisticated nonlinear mathematical models.  It is, however, far superior in many respects so most big-time assessment programs rely on IRT.

Want to improve the quality of your assessments?

Sign up for our newsletter and hear about our free tools, product updates, and blog posts first! Don’t worry, we would never sell your email address, and we promise not to spam you with too many emails.

Newsletter Sign Up
First Name*
Last Name*
Email*
Company*
Market Sector*
Lead Source

To learn more about CTT statistics and how to apply them, go ahead and download CITAS - that's what it was designed for!

The following two tabs change content below.

Nathan Thompson, PhD

Chief Product Officer at ASC
I am a psychometrician, software developer, author, and researcher, currently serving as Chief Product Officer for Assessment Systems Corporation (ASC). My mission is to elevate the profession of psychometrics by using software to automate the menial stuff like job analysis and Angoff studies, so we can focus on more innovative work. My core goal is to improve assessment throughout the world. I was originally trained as a psychometrician, doing an undergrad at Luther College in Math/Psych/Latin and then a PhD in Psychometrics at the University of Minnesota. I then worked multiple roles in the testing industry, including item writer, test development manager, essay test marker, consulting psychometrician, software developer, project manager, and business leader. Research and innovation are incredibly important to me. In addition to my own research, I am cofounder and Membership Director at the International Association for Computerized Adaptive Testing, You can often find me at other important conferences like ATP, ICE, CLEAR, and NCME. I've published many papers and presentations, and my favorite remains http://pareonline.net/getvn.asp?v=16&n=1.