| |
Relevance of the questions
|
Clarity of the questions
|
Meaningfulness of the answers
|
Completeness of the answers
|
|---|
|
No
|
Content of the item
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationad
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
|---|
|
1
|
Diagnosis of dementia
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
9
|
7
|
0.78
|
0.070
|
0.76
|
****
|
|
2
|
Type of dementia
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
10
|
1.00
|
0.001
|
1.00
|
***
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
|
3
|
Dementia stage
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
8
|
6
|
0.75
|
0.109
|
0.72
|
***
|
|
4
|
Memory functions
|
8
|
6
|
0.75
|
0.109
|
0.72
|
***
|
8
|
7
|
0.88
|
0.031
|
0.87
|
****
|
9
|
9
|
1.00
|
0.002
|
1.00
|
****
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
|
5
|
Long-term memory
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
9
|
9
|
1 00
|
0.002
|
1.00
|
****
|
7
|
6
|
0.86
|
0.055
|
0.85
|
****
|
|
6
|
Short-time memory
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
|
7
|
Orientation
|
9
|
9
|
1.00
|
0.002
|
1.00
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
| | |
S-CVI/AVE 0.95
| | | |
S-CVI/AVE 0.85
| | | |
S-CVI/AVE 0.83
| | | |
S-CVI/AVE 0.74
| | | |
| | |
S-CVI/UA 0.71
| | | |
S-CVI/UA 0.14
| | | |
S-CVI/UA 0.33
| | | |
S-CVI/UA 0.00
| | | |
-
a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
-
b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
-
c
k* (modified kappa) = (I-CVI-pc)(1-pc)
-
d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 andk* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)
