Skip to Content

R3: Achieving Efficiency in Rehabilitation Outcomes Data Collection

Overview

Why is this study needed?

Patients would appreciate more flexible ways of providing feedback to rehabilitation programs. Computer adaptive testing (CAT) tailors assessment for individuals without loss of scale precision or content validity, thus making assessments shorter and quicker to administer. Valid, generalizable item banks and CAT can stimulate and standardize clinical data collection across rehabilitation programs; they also may assist rehabilitation programs to assess patient response to interventions and modify treatment plans.

How will this study help patients and rehabilitation stakeholders?

Using modern psychometric methods, the data collected in R2 will be developed into an item bank. Specific algorithms will be developed that select the first item presented to the respondent, match that person’s response level to the next best item from the pool, and determine when to stop the test. Once all of the parameters have been selected, the community participation instrument will then be configured for both online administration and integrated voice response (IVR) administration and the technical team will load all of the item text onto the administration server and commence an extensive alpha and beta testing sequence. Alpha testing will consist of technical staff members serving as pseudo-surveyors and end users to test the system. Beta testing will extend this testing to include professional survey administrators. Over a one year assessment period, sample data will be collected from a representative group of persons with disabilities who have undergone rehabilitation. Some of the sample will be assigned to the CAT version, some will be surveyed using the second, full-length version, and some will be invited to complete the IVR CAT version. At the conclusion of the interview, respondents will be asked a short series of questions aimed at determining general satisfaction with the interview process. Finally, the CAT assessment will be prepared for distribution and evaluation by other rehabilitation programs.

What are the project objectives?

  • Obective 1:
    Administer the community participation instrument using CAT as part of the Rehabilitation Instutute of Chicago's Outcomes Management three-month post-discharge telephone interview, and evaluate user acceptance.
  • Objective 2:
    Develop a patient-initiated, telephone-based CAT administration of the community participation instrument, and evaluate user acceptance.

How will the project objectives be achieved?

Data collected in R2 will be developed into an item bank. Specific algorithms will be developed that select the first item presented to the respondent, match that person's response level to the next best item from the pool and determine when to stop the test. Once all of the parameters have been selected, community participation instrument will then be configured for both online administration and integrated voice response (IVR) administration and the technical team will load all of the item text onto the administration server and commence an extensive alpha and beta testing sequence. At the conclusion of the interview, respondents will be asked a short series of questions aimed at determining general satisfaction with the interview process. Finally, the CAT assessment will be prepared for distribution and evaluation by other rehabilitation programs.

What agency funded the project?

National Institute of Disability and Rehabilitation Research (NIDRR)

NIDDR Grant Number: H133B040032

What is the duration of the project?

December 1, 2004 - November 30, 2009

Project Staff

Co-Principal Investigator:

Richard Gershon, Ph.D., Evanston Northwestern Healthcare
Jin-Shei Lai, Ph.D., Evanston Northwestern Healthcare
Allen Heinemann, Ph.D., Rehabilitation Institute of Chicago

Related Project Research Web Sites

National Institute of Disability and Rehabilitation Research (NIDRR)
National Rehabilitation Information Center (NARIC)

Contact Information

For researchers and students
Allen Heinemann, Ph.D.
312-238-2802

For members of the media
312-238-6044