More Pearson at AERA/NCME!

Sometimes I forget how big Pearson really is. Here are additional presentations at both the AERA and NCME national conventions.

NCME Papers and presentations

Chu, Kwang-lee, & Lin, Serena Jie
Distracter Rationale Taxonomy: A Formative Evaluation Utilizing Multiple-Choice Distracters

Jirka, Stephen
Test Accommodations and Item-Level Analyses: Mixture DIF Models to Establish Valid Test Score Inferences

Lau, Allen
Evaluating Equivalence of Test Forms in Test Equating With the Random Group Design

Lin, Serena Jie
Examining the Impact of Omitted Responses on Equating

Seo, Daeryong
Exploring the Structure of Achievement Goal Orientations Using Multidimensional Rasch Models

Stephenson, Agnes
Examining Individual Students’ Growth on Two States’ English Language Learners Proficiency Assessments

Using HLM to Examine Growth of English Abilities for ELL Students and Group Differences

Wang, Jane
Modeling Growth: A Longitudinal Study Based on a Vertical Scaled English-Language Proficiency Test

Wang, Shudong
Vertical Scaling: Design and Interpretation

The Sensitivity of Yen’s Q3 Statistics in Detecting Local Item Dependence

NCME Papers and presentations

Arce-Ferrer, Alvaro & Diaz, Ileana
An Experimental Investigation of Rating Scale Construction Guidelines: Do They Work with Spanish-Speaking Populations

Yi, Qing
Item Pool Characteristics and Test Security Control in CAT

Wang, Shudong; Zhang, Liru; Kersteter, Patsy; Bolig, Darlene; Yi, Qing
An Investigation of Linking a State Assessment to the 2003 National Achievement of Educational Progress (NAEP) for 4th and 8th Grade Reading

Arce-Ferrer, Alvaro & Shin, Seon-Hi
Three Approaches to Measuring Individual Growth

Wang, Shudong; Jiao, Hong; & Hi, Wei
Parameter Estimation of One-Parameter Testlet Model

Wang, Shudong & Jiao, Hong
Empirical Evidences of construct Equivalence of Vertical Scale Across Grades in K-12 Large-Scale Standardized Reading Assessments

Pearson Presentations at AERA & NCME

The contingent of Pearson researchers has, once again, done an admirable job of representing our industry at the annual meeting of the American Educational Research Association (AERA) and the National Council on Measurement in Education (NCME) the week of March 24th in New York City.

The following are the AERA paper and symposium submissions:

Jason Meyers & Xiaojin Kong
An Investigation of the Changes in Item Parameter Estimates for Items Re-field Tested

Leslie Keng, Walter L. Leite, & Natasha Beretvas
Comparing Growth Mixture Models when Measuring Latent Constructs with Multiple Indicators

Leslie Keng, Edward Miller, Kimberly O'Malley, & Ahmet Turhan
Composite Score Reliability Given Correlated Measurement Errors between Subtests and Unknown Reliability for Some Subtests

Ye Tong, Sz-Shyan Wu, & Ming Xu
A Comparison of Pre-Equating and Post-Equating Using Large-Scale Assessment Data

Rob Kirkpatrick & Denny Way
Field Testing and Equating Designs for State Educational Assessments

Lei Wan & Brad Ching-Chow Wu
Person-fit of English Language Learner (ELL) Students in High-Stakes Assessments
Ellen Strain-Seymour
A User-Centered Design Approach for the Refinement of a Computer-Based Testing Interface

Jeff Wilson
A User-Centered Design Approach to Developing an Assessment Management System

Paul Nichols
The Role of User-Centered Design in Building Better Assessments

Michael Harms
An Introduction to User-Centered Design in Large-Scale Assessment

The following are NCME paper and symposium submissions:

Paul Nichols & Natash Williams
Evidence of Test Score Use In Validity: Roles And Responsibility

Denny Way, Chow-Hong Lin, Katie McClarty, & Jadie Kong
Maintaining Score Equivalence as Tests Transition Online: Issues, Approaches and Trends

Denny Way, Paul Nichols, & Daisy Vickers
Influences of Training and Scorer Charactersistics on Human Constructed Response Scoring

Ye Tong & Michael Kolen
Maintenance of Vertical Scales

Leslie Keng, Tusng-Han Ho, Tzu-An Chen, & Barbara Dodd
A Comparison of Item and Testlet Selection Procedures In Computerized Adaptive Testing

Jon S. Twing
Off-the-Shelf Tests and NCLB: Score Reporting Issues

Erika Hall & Timothy Ansley
Exploring the Use of Item Bank Information to Improve IRT Item Parameter Estimation

Canda Mueller
Response Probability Criterion and Subgroup Performance

Tony Thompson
Using CAT To Increase Precision In Growth Scores

Come see us in action. You are bound to go away smarter!

International Objective Measurement Workshop in NYC!

In the olden day, Raschites and 3PL researchers fought with so much vigor that they separated ways. I recall one AERA/NCME conference with Ron Hambleton on the right, Ben Wright on the left, and nothing but a "DMZ" in between. Well, times have changed, and more moderate heads have prevailed. Hence, those of you attending the AERA/NCME national conference in New York City should consider coming early and checking out the International Objective Measurement Workshop (IOMW). The workshop is held the two days prior to AERA and provides an excellent opportunity to hear about the latest developments in measurement.

The preliminary program for IOMW 2008 is now available. The conference will be held March 22 and 23, 2008 at New York University (NYU) in New York City. There are 48 paper presentations and 2 computer demonstrations scheduled. The preliminary program and the conference registration form can be found on the Journal of Applied Measurement (JAM) web site.

Early registration is currently open and in effect until March 14, 2008. Register now and save $10 on the registration fee. Late and onsite registration will also be available.

Hotel information can be found on the NYU web site. But hey, this is NYC, and it is easy to get anywhere from anywhere.

So check it out. If you have to travel all the way to NYC, you should at least take this opportunity to extend your stay over the front-end weekend.

Send your comments on this entry to TrueScores@Pearson.com.

Standard Setting Workshop at ATP in Dallas

The Pearson psychometric and research services team will be presenting a workshop at the annual conference for the Association of Test Publishers (ATP) held in Dallas, Monday, March 3, 2008. The title for the workshp is "Setting Performance Standards on High Stakes Tests."


Pearson has arguably more experience setting performance standards under NCLB than anyone. Most of this research is not published in peer-reviewed journals, but rather, become aspects of statewide technical reports. This workshop will be a great opportunity for customers, researchers and other practicioners to see what standard setting is all about for large-scale, high-stakes assessments required under NCLB.

The conference this year is being held at the Gaylord Texas resort near Grapevine. The workshop will take place on Monday, March 3, 2:00- 4:30 p.m.


The presenters from Pearson include:

Dr. Scott Davies
Dr. Erika Hall
Dr. Paul Nichols
Dr. Kimberly O’Malley

The team will describe basic activities used under common standard-setting methodology, including:

-item mapping
-modified Angoff
-body of work
-ID matching
-contrasting/borderline groups
-judgmental procedures

Facilitators will describe the roles played by psychometricians, meeting coordinators, and data analysts. Then, attendees will participate in a sample item mapping standard setting in which they will set a cut point and describe reasons for their judgments. Throughout the workshop, seasoned facilitators will share lessons learned and will distinguish what should happen in theory from what does happen in practice. Attendees will leave the workshop with a set of practical materials that will help them plan a future standard-setting meeting.

If you had no reason to attend this conference, this workshop should cause you to not only resgister, but show up and participate!

Send your comments to TrueScores@Pearson.com.

Together We Can Change the World...

Well, the long anticipated integration between Pearson and former test publishing giant Harcourt Assessment, Inc. (also known at times in it's history as The Psychological Corporation and the testing division of Harcourt, Brace and Jovonovich) is complete! Senior Pearson leadership were in San Anotonio this week to meet with the new Pearson employees and to celebrate the lengthy process of DOJ approval.

In a previous press release, Pearson CEO, Marjorie Scardino, said:

"We have long admired these businesses. They bring new intellectual property, capabilities and skills to Pearson, and will enable us to accelerate our strategy of leading the personalisation of learning, both in the US and around the world. We know that their people share our commitment to education, and we look forward to welcoming them as colleagues."

For me personally, it was like "old home week" seeing many of the faces I've gotten to know over the years and reviewing the wonderful products, services and staff from Pearson's new "crown jewel."

Make no mistake, while challenges lie ahead in the education and assessment arenas, Pearson's goal to educate, inform and entertain our customers remains our primary motivator and this latest acquisition is another step toward accomplishing that goal.

Welcome aboard!

You can comment on this posting by emailing TrueScores@Pearson.com.