Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia

Table 6 Content validity of the dimension “Cognition status”

		Relevance of the questions						Clarity of the questions						Meaningfulness of the answers						Completeness of the answers
No	Content of the item	Number of experts	Number of ratings of 3 or 4	I-CVI^a	p_c ^b	k* ^c	Evaluation^d	Number of experts	Number of ratings of 3 or 4	I-CVI^a	p_c ^b	k* ^c	Evaluation^d	Number of experts	Number of ratings of 3 or 4	I-CVI^a	p_c ^b	k* ^c	Evaluation^ad	Number of experts	Number of ratings of 3 or 4	I-CVI^a	p_c ^b	k* ^c	Evaluation^d
1	Diagnosis of dementia	10	10	1.00	0.001	1.00	****	10	9	0.90	0.010	0.90	****	10	8	0.80	0.044	0.79	****	9	7	0.78	0.070	0.76	****
2	Type of dementia	10	10	1.00	0.001	1.00	****	10	10	1.00	0.001	1.00	***	10	8	0.80	0.044	0.79	****	10	7	0.70	0.117	0.66	***
3	Dementia stage	10	10	1.00	0.001	1.00	****	10	8	0.80	0.044	0.79	****	10	6	0.60	0.205	0.50	**	8	6	0.75	0.109	0.72	***
4	Memory functions	8	6	0.75	0.109	0.72	***	8	7	0.88	0.031	0.87	****	9	9	1.00	0.002	1.00	****	9	6	0.67	0.164	0.60	***
5	Long-term memory	10	9	0.90	0.010	0.90	****	10	7	0.70	0.117	0.66	***	9	9	1 00	0.002	1.00	****	7	6	0.86	0.055	0.85	****
6	Short-time memory	10	10	1.00	0.001	1.00	****	10	8	0.80	0.044	0.79	****	10	8	0.80	0.044	0.79	****	9	6	0.67	0.164	0.60	***
7	Orientation	9	9	1.00	0.002	1.00	****	10	9	0.90	0.010	0.90	****	10	8	0.80	0.044	0.79	****	9	6	0.67	0.164	0.60	***
		S-CVI/AVE 0.95						S-CVI/AVE 0.85						S-CVI/AVE 0.83						S-CVI/AVE 0.74
		S-CVI/UA 0.71						S-CVI/UA 0.14						S-CVI/UA 0.33						S-CVI/UA 0.00

^a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
^b p_c (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5^N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
^c k* (modified kappa) = (I-CVI-p_c)(1-p_c)
^d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 andk* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)

ISSN: 1472-6963