assessment information

Assessment Instrument Critique Rubric

Score

Comments

Purpose (10 points)

• For what purpose was the instrument developed?

• What population(s) was/were the instrument developed for (i.e., age group, disease or injury categories, ethnicity, culture, language, etc.)?

• If the instrument was developed for reasons other than research, is there at least one research study that has used this instrument?

• Is the stated purpose of the instrument similar to or different than the purpose of the instrument needed for your proposed study?

• If the purpose of the instrument is different than the requirements for your study, discuss how these differences may be compensated for in your proposed study.

• Who are the author(s) or developer(s) of the proposed instrument?

Historical Background (10 points)

• What year was the instrument first developed and/or used?

• Has this instrument been used consistently inpatient care, education and/or research since it was first developed? Describe when and how.

• Has the instrument been modified (or is it considered an original instrument? Yes or No.

• If the instrument has been modified, discuss each modification indicating what was changed, when, why and by whom?

• Were studies conducted after each modification to re-establish the psychometrics (internal consistency, reliability or precision; validity or accuracy) of the instrument?

• Have there been published research using the instrument following each modification?

• What was the design of previous studies that utilized this instrument?

Content (15 points)

• Does the instrument appear to measure what it is reported to measure? Yes or No. If not, why not?

• If this instrument will be used with special populations such as children or immigrants, what kind of cultural (and language) adaptations/modifications will you need to make prior to use?

Reported Internal Consistency, Reliability & Validity (15 points) • What are the reported internal consistency, reliability and validity (content, construct, criterion) of the instrument?

• What population(s) (i.e., age group, disease or injury categories, ethnicity, language, etc.) were used to assess internal consistency, reliability and validity of this instrument?

Measurement & Analysis (25 points)

• What does the instrument measure (e.g., depression, quality of life, etc.)?

• What is/are the level of the data collected (nominal, ordinal, interval or ratio)?

Other Considerations (25 points)

• What is the reported respondent burden (amount of time it takes for a subject to complete the questionnaire or to have the physiological measurement(s) taken)?

• In your opinion can the instrument be used ethically in a research study? If no, why not.

• In your opinion can the instrument be used ethically in a research study with a vulnerable population (e.g., children, pregnant women, incarcerated individuals etc.)? If no, why not?

Total (100 possible points)