Skip to main content

Table 6 Content validity of the dimension “Cognition status”

From: Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia

  Relevance of the questions Clarity of the questions Meaningfulness of the answers Completeness of the answers
No Content of the item Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationad Number of experts Number of ratings of 3 or 4 I-CVIa pc b k* c Evaluationd
1 Diagnosis of dementia 10 10 1.00 0.001 1.00 **** 10 9 0.90 0.010 0.90 **** 10 8 0.80 0.044 0.79 **** 9 7 0.78 0.070 0.76 ****
2 Type of dementia 10 10 1.00 0.001 1.00 **** 10 10 1.00 0.001 1.00 *** 10 8 0.80 0.044 0.79 **** 10 7 0.70 0.117 0.66 ***
3 Dementia stage 10 10 1.00 0.001 1.00 **** 10 8 0.80 0.044 0.79 **** 10 6 0.60 0.205 0.50 ** 8 6 0.75 0.109 0.72 ***
4 Memory functions 8 6 0.75 0.109 0.72 *** 8 7 0.88 0.031 0.87 **** 9 9 1.00 0.002 1.00 **** 9 6 0.67 0.164 0.60 ***
5 Long-term memory 10 9 0.90 0.010 0.90 **** 10 7 0.70 0.117 0.66 *** 9 9 1 00 0.002 1.00 **** 7 6 0.86 0.055 0.85 ****
6 Short-time memory 10 10 1.00 0.001 1.00 **** 10 8 0.80 0.044 0.79 **** 10 8 0.80 0.044 0.79 **** 9 6 0.67 0.164 0.60 ***
7 Orientation 9 9 1.00 0.002 1.00 **** 10 9 0.90 0.010 0.90 **** 10 8 0.80 0.044 0.79 **** 9 6 0.67 0.164 0.60 ***
   S-CVI/AVE 0.95     S-CVI/AVE 0.85     S-CVI/AVE 0.83     S-CVI/AVE 0.74    
   S-CVI/UA 0.71     S-CVI/UA 0.14     S-CVI/UA 0.33     S-CVI/UA 0.00    
  1. a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
  2. b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
  3. c k* (modified kappa) = (I-CVI-pc)(1-pc)
  4. d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 andk* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)