Monday, February 11, 2008

Standard Setting Workshop at ATP in Dallas

The Pearson psychometric and research services team will be presenting a workshop at the annual conference for the Association of Test Publishers (ATP) held in Dallas, Monday, March 3, 2008. The title for the workshp is "Setting Performance Standards on High Stakes Tests."

Pearson has arguably more experience setting performance standards under NCLB than anyone. Most of this research is not published in peer-reviewed journals, but rather, become aspects of statewide technical reports. This workshop will be a great opportunity for customers, researchers and other practicioners to see what standard setting is all about for large-scale, high-stakes assessments required under NCLB.

The conference this year is being held at the Gaylord Texas resort near Grapevine. The workshop will take place on Monday, March 3, 2:00- 4:30 p.m.

The presenters from Pearson include:

Dr. Scott Davies
Dr. Erika Hall
Dr. Paul Nichols
Dr. Kimberly O’Malley
The team will describe basic activities used under common standard-setting methodology, including:

-item mapping
-modified Angoff
-body of work
-ID matching
-contrasting/borderline groups
-judgmental procedures
Facilitators will describe the roles played by psychometricians, meeting coordinators, and data analysts. Then, attendees will participate in a sample item mapping standard setting in which they will set a cut point and describe reasons for their judgments. Throughout the workshop, seasoned facilitators will share lessons learned and will distinguish what should happen in theory from what does happen in practice. Attendees will leave the workshop with a set of practical materials that will help them plan a future standard-setting meeting.

If you had no reason to attend this conference, this workshop should cause you to not only resgister, but show up and participate!

Send your comments to

No comments: