I just returned from the 2017 Innovations in Testing conference in Scottsdale, AZ, organized by the Association of Test Publishers. This is one of my favorite conferences because it contains a compelling blend of ingredients – quality psychometrics, innovative technology, and the business of assessment – and the 2017 edition definitely did not disappoint.
This year I was joined by four of my colleagues:
- Dave Saben – CEO
- Tom Padden – Head of Growth
- Andrew Lunstad – VP of Partnerships
- Kat Stanley, MA PMP – Partner Support Manager
Our agenda was quite full, as would be expected with such a gravitational nexus of the testing industry. In addition to sponsoring the conference and holding a booth in the Exhibit Hall, we met with a number of current and future partners, held a BBQ at our AirBnb house, attended plenty of presentations, and gave 4 presentations of our own. Here’s a rundown of this year’s happenings:
Takeaways of the conference
We attended presentations on a variety of topics, and it was evident that AI and Big Data are playing an increasingly impactful role in our field. We are excited to be on the forefront of that; we’ve been doing Machine Learning since the 1970s, long before that term became en vogue. Much of our current innovation effort is focused on automation of psychometrics, such as automated creation of NCCA Accrediation Reports and Classical Test Theory Reports.
ATP organized an exhibit hall for the testing conference on Monday and Tuesday, and we had a great high-traffic location near the center of the room (between two food serving areas, which is always nice!). In addition to the normal handouts, we distributed scorpion suckers and gave away a Google Home device, a nod towards our love of AI and machine learning.
We held an informal dinner at our AirBnb house one night, with about 30 friends and partners. We brought in some of the best BBQ in town (Joe’s) and relaxed by a poolside fire until the desert evening got too cold. It was a great opportunity to chat with old friends and meet some new ones.
ASC was grateful for the opportunity to speak 4 times about the innovations we are making in the testing industry – certainly a great fit, given the title of the conference.
Tech-Enhanced Items: How Can They Provide Better Measurement?
Nathan Thompson and Andrew Lunstad from ASC, and Paul Jaquith from ACTVET, discussed tech-enhanced items from a psychometric and software design perspective, evaluating their impact on the ultimate goal: improving measurement.
Sift & Winnow: Options For Data Forensics
Nathan Thompson from ASC, and Joy Matthews-Lopez from Professional Testing Inc., discussed methodologies and software to help detect instances of test fraud, and what to do about it if you find anything worth investigating.
FastTest: A Configurable System for Cross-Sector Assessment
Andrew Lunstad and Dave Saben demonstrated FastTest, a secure, cloud-based platform uniquely designed to improve any type of assessment, from certification to pre-employment to education to psychology.
SIFT: Innovating Data Forensics
Nathan Thompson demonstrated SIFT, an innovative program designed as a cost-effective option for detecting test fraud and other threats to validity, such as low motivation.
If you are interested in any of these topics and did not connect with us at the conference, please contact firstname.lastname@example.org. We are already looking forward to next year’s conference!
Want to improve the quality of your assessments?
Sign up for our newsletter and hear about our free tools, product updates, and blog posts first! Don’t worry, we would never sell your email address, and we promise not to spam you with too many emails.
Latest posts by Nathan Thompson, PhD (see all)
- What validity threats are relevant to psychometric forensics? - November 10, 2017
- What is classical item difficulty (P value)? - November 6, 2017
- Examinee Collusion: Primary vs Secondary - October 30, 2017