Skip to main content

Table 4 Results, summary of the judgements made by the 17 evaluators of the quality for each of the outcomes presented in the 12 examples in the pilot study.

From: Systems for grading the quality of evidence and the strength of recommendations II: Pilot study of a new system

Outcome

High

Moderate

Low

Very low

Consensus

Comments

Depression severity

6/17

10/17

-

-

Moderate

 

Transient side effects

7/17

10/17

-

-

High

Changed to little uncertainty

Poisoning fatalities

-

4/17

7/17

6/17

Moderate

Upgraded for very strong association

Stroke

15/17

2/17

-

-

High

 

Extracranial hemorrage

16/16

-

-

-

High

 

All cause mortality

12/17

5/17

-

-

-

Agreed to remove this outcome

Pain at rest

16/17

1/17

-

-

High

 

Pain ay motion

15/17

2/17

-

-

Moderate

Uncertainty about directness of outcome measure

Mobility

3/17

14/17

-

-

Moderate

 

Quality of life

1/17

11/17

5/17

-

Moderate

 

Dropout due to side effects

14/17

3/17

-

-

High

 

Serious gi complications

-

3/17

8/17

6/17

-

Need more information before consensus

All cause mortality

2/17

15/17

-

-

Moderate

 

Non-fatal stroke

17/17

-

-

-

High

 

Non-fatal MI

17/17

-

-

-

High

 

Death

13/17

4/17

-

-

High

 

Non-fatal MI

11/16

5/16

-

-

High

 

All cause death

12/17

5/17

-

-

Moderate

If reporting bias, otherwise high

Major bleeding

15/17

2/17

-

-

High

 

Recurrent thromboembolism

6/17

11/17

-

-

High

 

Clinical cure

-

13/17

4/17

-

Moderate

 

Dropout due to side effects

-

10/17

7/17

-

Moderate

 

Relapse

2/17

11/17

4/17

-

Moderate

 

Tuberculosis

2/17

10/17

5/17

-

Moderate

 

TB death

8/17

8/17

1/17

-

High

 

TB meningitis

1/17

4/17

12/17

-

Moderate

Strong association

Serious adverse events

1/12

-

-

11/12

-

No data, outcome removed

Condition unchanged

5/17

19/17

2/17

-

-

No consensus regarding sparse data

Poor outcome- surgeon rated

9/17

8/17

-

-

-

Need bias information before consensus

2nd procedure needed

9/17

8/17

-

-

Moderate

 

No success – objective rater

5/17

10/17

2/17

-

-

No consensus regarding sparse data

Risks & side effects

1/15

2/15

2/15

10/15

-

No data, outcome removed

Dental caries – start

-

-

8/17

9/17

Very low

 

Dental caries – stop

-

-

5/17

12/17

Very low

 

Dental florosis

-

1/17

3/17

13/17

Very low

 

Bone fracture

-

1/17

3/17

13/17

Very low

 

Cancer mortality

-

1/17

2/17

14/17

Very low

 

All injuries

-

1/17

12/17

4/17

Very low

Question changed

Correct use early

8/17

5/17

4/17

-

High

Question changed

Correct use follow up

2/17

8/17

6/17

1/17

High

Question changed

Possession of seat

7/17

6/17

3/17

-

High

Question changed

CHD

11/13

2/13

-

-

High

 

Breast cancer

11/13

2/13

-

-

High

 

Stroke

11/13

2/13

-

-

High

 

Colorectal cancer

11/13

2/13

-

-

High

 

Endometrial cancer

11/13

2/13

-

-

High

 

Hip fracture

11/13

2/13

-

-

High