Skip to main content

Table 3 An example of the calculation of CVR, modified kappa, and face validity for two categories (administrative class and corrosive poisoning subclass)

From: Developing the minimum data set of the corrosive ingestion registry system in Iran

Data items

The number giving a rating of 3 or 4 to the relevancy of the item

CVRa

pcb

Kc

Face validityd

Interpretation

Age

75

1

0/009× \({10}^{-48}\)  ~ 0

1

3.5

Excellent

Gender

75

1

 ~ 0

1

3.5

Excellent

Admission date

70

0.94

 ~ 0

0.94

3.5

Excellent

Residence (housing)

68

0.906

 ~ 0

0.906

3.18

Excellent

Income

75

1

 ~ 0

1

3.5

Excellent

Date of birth

72

0.96

 ~ 0

0.96

3.5

Excellent

Marital status

75

1

 ~ 0

1

3.5

Excellent

Ethnicity

70

0.933

 ~ 0

0.94

2.09

Excellent

Height

69

0.92

 ~ 0

0.92

3.5

Excellent

Weight

74

0.986

 ~ 0

0.986

3.01

Excellent

Religion

72

0.96

 ~ 0

0.96

3.18

Excellent

Education level

75

1

 ~ 0

1

3.5

Excellent

Occupation

70

0.933

 ~ 0

0.933

3.04

Excellent

Type of referring to the hospital

69

0.92

 ~ 0

0.92

3.1

Excellent

Dealing with toxin

75

1

 ~ 0

1

3.3

Excellent

Duration of hospitalization

74

0.986

 ~ 0

0.986

3.1

Excellent

Admission time

75

1

 ~ 0

1

2.89

Excellent

Patients’ status after discharge

67

0.893

 ~ 0

0.893

3.01

Excellent

Date of follow-up

75

1

 ~ 0

1

2.94

Excellent

Discharge outcome

75

1

 ~ 0

1

3.04

Excellent

Corrosive poisoning subclass

Ingested substance

73

0.973

 ~ 0

0.973

3.3

Excellent

Volume of ingestion

75

1

 ~ 0

1

3.2

Excellent

Physical characteristics of substances

70

0.933

 ~ 0

0.933

3.4

Excellent

Amount of substance

75

1

 ~ 0

1

3.5

Excellent

Concentration of substance

72

0.96

 ~ 0

0.96

3.5

Excellent

Duration time between swallowing until arrival at the hospital

75

1

 ~ 0

1

3.5

Excellent

Measures taken before and during transportation to a medical center

65

0.866

 ~ 0

0.866

3.5

Excellent

  1. aThe formula of content validity ratio is CVR = (Ne—N/2)/ (N/2). In which the Ne is the number of panelists indicating "essential" and N is the total number of panelists. The numeric value of content validity ratio is determined by Lawshe Table. if CVR is bigger than 0.49, the item in the instrument with an acceptable level of significance will be accepted
  2. bPc (probability of a chance occurrence) was computed using the formula: pc = [N! /A! (N -A)!] *.5Nwhere N = number of experts and A = number of panelists who agree that the item is relevant
  3. cK (Modified Kappa) was computed using the formula: K = (I-CVI- PC)/ (1- PC). Interpretation criteria for Kappa, using guidelines described in Cicchetti and Sparrow (1981): Fair = K of 0.40 to 0.59; Good = K of 0.60 to 0.74; and Excellent = K > 0.7
  4. dFor calculation, the formula Impact Score = frequency (ratio of raters who scored 3 & 4) * Importance (mean score for the importance on the basis of domains) was used. The Impact Score for each item must be above 1.5 or it will be removed