Question
Answers
Possible Points
Is the study population identified and described? Are eligibility criteria specified?
–
–
Study Population
5
Eligibility criteria
5
2.
Dependent variable
6
3.
Independent variable
6
What approach do the authors use to establish content validity?
Content validity is the “degree to which an instrument has an appropriate sample of items for the construct being measured and adequately covers the construct domain.” To ensure a “content-valid” instrument, researchers should start with a conceptualization of the construct. This can be based on:
· First-hand knowledge
· Literature review
· Expert consultations
· Preliminary qualitative studies
6
What type of sampling plan was used? Would an alternative sampling plan have been preferable? Was the sampling plan one that could be expected to yield a representative sample?
–
–
Sampling plan.
5
Alternative sampling plan
2
Sampling plan yielding representative sample
2
If sampling was stratified, was a useful stratification variable selected? If a consecutive sample was used, was the time period long enough to address seasonal or temporal variation?
–
–
Stratification
1
Consecutive sampling
1
7.
If cluster sampling was utilized, what were the clusters and how was sampling done within clusters?
2
How were people recruited into the sample? Does the method suggest potential biases?
–
–
Recruitment
4
Potential biases
4
Did some factor other than the sampling plan affect the representativeness of the sample?
5
Are possible sample biases or weaknesses identified by the researchers themselves?
5
Are key characteristics of the sample described (e. g., mean age, percent female)? If yes, please provide detailed information on sample characteristics.
12
Was the sample size justified on the basis of a power analysis or other rationale?
5
13.
What approach do the authors use to check for internal reliability?
5
14.
What approach do the authors use to establish interrater reliability?
2
15.
What approach do the authors use to establish test-retest reliability?
2
16.
What approach do the authors use to establish discriminant validity?
Discriminant validity is “the ability to differentiate a construct from other similar constructs.”
5
Does the sample support inferences about external validity? To whom can the study results reasonably be generalized?
–
–
External validity
5
Generalizability
5