Monday, November 22, 2010

Where Will Innovation Come From?


I have just come from a learning trajectories conference associated with the DELTA Project at North Carolina State University. This conference was supported by the Pearson Foundation. At this event, there was a lot of talk about innovation in how and what we assess, including talk about so-called “innovative” items. Those are items that might use simulation, multimedia and figural response item formats. The Race to the Top consortia want to hire companies to construct these innovative items that will be freely shared across states. But where will innovations in assessment items and tasks come from?

There are people who do research on innovations and where innovations come from. Consider Eric von Hippel, a professor of technological innovation at MIT. In the book, The Sources of Innovation, von Hippel points out that companies that manufacture in a field were innovators in that field if the companies could expect the innovation to become a commercially successful product that would result in an attractive return. These innovative companies gained an enhanced position in the market. But the research by von Hippel raises a question: What motivates companies to invest in developing innovative items if those innovations will then be given away by the consortia to the states? Where is the enhanced market position? Are the consortia taking the best approach to ensuring innovation in how and what we assess?

Some other researchers on innovation, Kevin Boudreau and Karim Lakhani, writing about outside innovation might have an answer. They say that when the technology and the customers’ needs are well understood a company can do internal research and development. But opening up innovation to a collaborative community can work better when the technology and design approaches have not been established and the innovation involves cumulative knowledge, continually building on past advances.

These collaborative communities tend to develop knowledge-sharing and dissemination mechanisms, and converge on common norms with a culture of sharing and cooperation, broad agreement on a technology paradigm, and common technical jargon to support productive collaboration. A good example of this is Apple’s iPhone. Thousands of outside software developers have written complementary applications (the apps we all love so much) that have made the iPhone the center of a thriving business ecosystem. Another but somewhat different example is the Semiconductor Research Corp., a Durham, North Carolina-based nonprofit consortium that includes members from industry, the government, and academia. The Semiconductor Research Corp was established in 1982 to accumulate fundamental knowledge in silicon technology and semiconductor manufacturing.

As the Rolling Stones sang, “You can't always get what you want. But if you try sometimes, yeah, you just might find you get what you need!” I don’t know the best way to guarantee we get the innovation we want in how and what we assess. But after meeting and listening to the researchers and policymakers at the learning trajectories conference, a way to get what we need might be a partnership between companies like Pearson, the government, and academia.

Paul Nichols, Ph.D.
Vice President
Psychometric & Research Services
Assessment & Information
Pearson

Tuesday, November 02, 2010

TrueScores Redux

Welcome to the first blog entry under our new editorial format! In the past, different staff members from Research Services have taken turns writing blog entries. The result was some interesting blogs but not really a consistent voice. So we decided to try something different.

First, we will have a blog writer appointed to a six month term (or sentence). Obviously, I’m the first blogger. If you don’t like my blogs, just wait six months and someone else will take over. But use the comments function and let me know what you think, one way or the other.

And that’s another change. Readers can send comments back to me. But I get to decide if I want to publicly respond to those comments. Some rules about comments:
1. Be polite;
2. Be relevant;
3. And be polite.

Third, I will periodically invite people I believe are interesting to write a blog entry. I will invite guest bloggers for two reasons: One, I want a break once in awhile. Two, I’m not that interesting and the readers need a break once in awhile. For those of you who follow the TMRS Research Newsletter, I will coerce the Newsletter editors to write a blog entry when they begin their one-year term of service and tell us what their vision is over the next year. I will plead with the leaders at the Pearson Global Psychometric Centers at Oxford, the University of Western Australia and The University of Texas at Austin to write blog entries. And I will ask a graduate student participating in Pearson's Summer Research Fellowship Program to write a blog about their experience over the summer with Pearson. So readers who are thinking about applying for Pearson's Summer Research Fellowship, you’ve been warned.

Finally, my picture is posted with the blog. I tried to slip in Brad Pitt’s picture but I was caught. Well, some changes are positive and others …

So, I promise to provide new blog entries on a regular basis. I promise each entry will address something that I care about. I cannot promise more.

"So long as you write what you wish to write, that is all that matters; and whether it matters for ages or only for hours, nobody can say.”
Virginia Woolf

Paul Nichols, Ph.D.
Vice President
Psychometric & Research Services
Assessment & Information
Pearson