| |
Relevance of the questions
|
Clarity of the questions
|
Meaningfulness of the answers
|
Completeness of the answers
|
|---|
|
No
|
Content of the items
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationad
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
Number of experts
|
Number of ratings of 3 or 4
|
I-CVIa
|
pc
b
|
k*
c
|
Evaluationd
|
|---|
|
1
|
Boredom
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
|
2
|
Anxiety
|
10
|
10
|
1.00
|
0.001
|
1.00
|
****
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
|
3
|
Exhaustion
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
|
4
|
Impression of loneliness or isolation
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
|
5
|
Trusting relationships
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
10
|
5
|
0.50
|
0.246
|
0.34
|
*
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
6
|
0.60
|
0.205
|
0.50
|
**
|
|
6
|
Amount of occupation
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
9
|
7
|
0.78
|
0.070
|
0.76
|
****
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
5
|
0.50
|
0.246
|
0.34
|
*
|
|
7
|
Type of occupation
|
10
|
8
|
0.80
|
0.044
|
0.79
|
****
|
10
|
7
|
0.70
|
0.117
|
0.66
|
***
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
10
|
9
|
0.90
|
0.010
|
0.90
|
****
|
| | |
S-CVI/AVE 0.87
| | | |
S-CVI/AVE 0.64
| | | |
S-CVI/AVE 0.80
| | | |
S-CVI/AVE 0.80
| | | |
| | |
S-CVI/UA 0.29
| | | |
S-CVI/UA 0.50
| | | |
S-CVI/UA 0.00
| | | |
S-CVI/UA 0.00
| | | |
-
a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
-
b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
-
c
k* (modified kappa) = (I-CVI-pc)(1-pc)
-
d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 and k* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)
