Skip to main content

Table 5 Content validity of the dimension “Assessment of behaviour”

From: Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia

  Relevance of the questions Clarity of the questions Meaningfulness of the answers Completeness of the answers
No Content of the items Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationc
1 Type of behaviour 10 10 1.00 0.001 1.00 **** 10 8 0.80 0.044 0.79 **** 9 8 0.89 0.018 0.89 **** 9 7 0.78 0.070 0.76 ****
2 Description of behaviour 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 8 0.89 0.018 0.89 **** 8 6 0.75 0.109 0.72 ***
3 First occurrence of behaviour 10 9 0.90 0.010 0.90 **** 10 10 1.00 0.001 1.00 **** 9 9 1.00 0.002 1.00 **** 8 8 1.00 0.004 1.00 ****
4 Event before the occurrence of the behaviour 10 10 1.00 0.001 1.00 **** 10 10 1.00 0.001 1.00 **** 9 8 0.89 0.018 0.89 **** 8 7 0.88 0.031 0.87 ****
5 Time at which the behaviour occurs 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 9 1.00 0.002 1.00 **** 9 6 0.67 0.164 0.60 ***
6 Duration of the behaviour 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 7 0.78 0.070 0.76 **** 9 7 0.78 0.070 0.76 ****
7 Frequency of the behaviour 10 10 1.00 0.001 1...00 **** 10 10 1.00 0.001 1.00 **** 8 7 0.88 0.031 0.87 **** 9 9 1.00 0.002 1.00 ****
8 Area in which the behaviour occurs 9 8 0.89 0.018 0.89 **** 9 9 1.00 0.002 1.00 **** 9 8 0.89 0.018 0.89 **** 9 7 0.78 0.070 0.76 ****
9 Person present when the behaviour occurs 10 8 0.80 0.044 0.79 **** 10 9 0.90 0.010 0.90 **** 9 7 0.78 0.070 0.76 **** 9 7 0.78 0.070 0.76 ****
10 Events directly before the behaviour 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 8 0.89 0.018 0.89 **** 8 6 0.75 0.109 0.72 ***
11 Events directly after the behaviour 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 9 1.00 0.002 1.00 **** 8 8 1.00 0.004 1.00 ****
12 Helpful interventions 10 8 0.80 0.044 0.79 **** 10 5 0.50 0.246 0.34 * 9 7 0.78 0.070 0.76 **** 8 7 0.88 0.031 0.87 ****
13 Behaviour unpleasant for the resident 10 8 0.80 0.044 0.79 **** 10 9 0.90 0.010 0.90 **** 9 8 0.89 0.018 0.89 **** 9 6 0.67 0.164 0.60 ***
14 Danger for the person with dementia 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 9 9 1.00 0.002 1.00 **** 9 7 0.78 0.070 0.76 ****
15 Behaviour unpleasant for the resident or for other residents 10 8 0.80 0.044 0.79 **** 10 9 0.90 0.010 0.90 **** 8 6 0.75 0.109 0.72 *** 9 9 1.00 0.002 1.00 ****
16 Danger for other residents 10 10 1.00 0.001 1.00 **** 11 9 0.82 0.027 0.81 **** 9 8 0.89 0.018 0.89 **** 9 7 0.78 0.070 0.76 ****
17 Impact on carers 10 8 0.80 0.044 0.79 **** 10 6 0.60 0.205 0.50 ** 9 8 0.89 0.018 0.89 **** 9 7 0.78 0.070 0.76 ****
18 Danger for carers 10 8 0.80 0.044 0.79 **** 8 7 0.88 0.031 0.87 **** 9 9 1.00 0.002 1.00 **** 10 9 0.90 0.010 0.90 ****
   S-CVI/AVE 0.92     S-CVI/AVE 0.87 ****    S-CVI/AVE 0.87     S-CVI/AVE 0.83    
   S-CVI/UA 0.56     S-CVI/UA 0.22     S-CVI/UA 0.28     S-CVI/UA 0.17    
  1. a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
  2. b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
  3. c k* (modified kappa) = (I-CVI-pc)(1-pc)
  4. d Evaluation criteria for the level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 and k* ≤ 0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤ 0.59 (**); and poor validity I-CVI < 0.4 and k* <0.40 (*)
Back to article page

BMC Health Services Research

ISSN: 1472-6963

Contact us