|
Relevance of the questions
|
Clarity of the questions
|
Meaningfulness of the answers
|
Completeness of the answers
|
---|
No
|
Content of the items
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pb
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
---|
1
|
Health problems generic
|
9
|
8
|
0.89
|
0.018
|
0.89
|
****
|
9
|
7
|
0.78
|
0.070
|
0.76
|
****
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
2
|
Pain
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
9
|
8
|
0.89
|
0.018
|
0.89
|
****
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
3
|
Depression
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
8
|
8
|
1.00
|
0.004
|
1.00
|
****
|
8
|
7
|
0.88
|
0.031
|
0.87
|
****
|
9
|
7
|
0.78
|
0.070
|
0.76
|
****
|
4
|
Hallucination/delusion
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
5
|
Sleep
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
6
|
Bowel elimination
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
7
|
Urinary elimination
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
8
|
Thirst/hunger
|
8
|
8
|
1.00
|
0.004
|
1.00
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
9
|
Need for movement
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
Breathing/circulatory problems
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
9
|
7
|
0.78
|
0.070
|
0.76
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
11
|
Discomfort
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
10
|
5
|
0.50
|
0.246
|
0.34
|
*
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
12
|
Other relevant health problems
|
9
|
8
|
0.89
|
0.018
|
0.89
|
****
|
8
|
6
|
0.75
|
0.109
|
0.72
|
***
|
8
|
5
|
0.63
|
0.219
|
0.52
|
**
|
8
|
6
|
0.75
|
0.109
|
0.72
|
***
|
13
|
Side effects of medication
|
9
|
9
|
1.00
|
0.002
|
1.00
|
****
|
9
|
6
|
0.67
|
0.164
|
0.60
|
***
|
9
|
9
|
1.00
|
0.002
|
1.00
|
****
|
9
|
8
|
0.89
|
0.018
|
0.89
|
****
|
| |
S-CVI/AVE 0.92
| | | |
S-CVI/AVE 0.81
|
****
| | |
S-CVI/AVE 0.82
| | | |
S-CVI/AVE 0.77
| | | |
| |
S-CVI/UA 0.62
| | | |
S-CVI/UA 0.15
| | | |
S-CVI/UA 0.08
| | | |
S-CVI/UA 0.00
| | | |
-
a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
-
b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
-
c
k* (modified kappa) = (I-CVI-pc)(1-pc)
-
d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 and k* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤ 0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)