JADAD Score: 5 Key Criteria for Evaluating Clinical Study Quality

Introduction

"Lose weight just by drinking this!" "Expert-approved amazing results." We encounter countless advertisements for supplements and health products every day. Often, these claims are supported by "scientific research findings," but how reliable are these studies?

In scientific research, there is significant variation in the quality of study results. While there are many properly designed and highly reliable studies, unfortunately, some research is also conducted with predetermined conclusions. Discerning genuine scientific evidence from this mixed bag of information is critically important not only for medical professionals but also for consumers like ourselves.

When it comes to evaluating this "study quality," one research methodology that holds particular importance is called the "randomized controlled trial" (RCT). Historically, one of the most widely used tools for simplifying RCT quality assessment has been the JADAD score.

In this article, we will clearly explain, from basic concepts to practical evaluation methods and even the limitations of using the JADAD score to assess the reliability of scientific evidence.

What is the JADAD Score?

The JADAD score is a scoring system developed by Alejandro Jadad and colleagues in 1996 to assess the methodological quality of clinical trials (Jadad et al., 1996). Also formally known as the "Oxford Quality Scoring System," it evaluates RCT reports using a quantitative scoring system that ranges from 0 to 5 points based on responses to three key questions and subsequent point adjustments.

Jadad et al., has been cited over 25,000 times and utilized in more than 10,000 systematic reviews (Reference: Google Scholar). Due to its simplicity, the JADAD score has become a standard tool for evaluating RCTs in systematic reviews and meta-analyses.

Evaluation Criteria and Scoring Method

The JADAD score assesses the following three key components:

1. Randomization Evaluation (0-2 points)

• The study is clearly described as randomized: +1 point
• The randomization method is presented and deemed appropriate: +1 point
• The randomization method is either not described or inappropriate: -1 point

Examples of appropriate randomization methods include computer-generated randomization, the use of random number tables, and coin tossing. Examples of inappropriate randomization methods include assignments based on birthdays and those based on arrival orders.

2. Blinding Evaluation (0-2 points)

• The study is clearly described as double-blinded: +1 point
• The blinding method is documented correctly: +1 point
• The blinding method is either not described or inappropriate: -1 point

Examples of appropriate blinding methods include the use of visually identical placebos and medications with similar taste and odor. Examples of inappropriate blinding methods are the use of medications with clearly different appearances, treatments that produce more side effects in one group than the other, etc.

3. Dropout/Exclusion Evaluation (0-1 point)

• The number of dropouts and reasons for dropout are documented: +1 point

This component evaluates whether the number of participants who dropped out after study initiation and their reasons are clearly stated. The implementation of ITT (Intention-to-treat) analysis is also an important point to verify.

Score Interpretation

The JADAD score is generally interpreted as follows:

• 0-2 points: Studies that may carry a high risk of bias and should be interpreted with caution
• 3-5 points: Studies considered reliable

Most systematic reviews typically treat JADAD scores of 3 or higher as "reliable studies." However, this threshold may be adjusted depending on the research field or specific objectives.

Example of Paper Evaluation Using JADAD Score

• Paper: "The effect of vitamin D supplementation on pain: an analysis of data from the D-Health randomized controlled trial."
• Authors: Rahman et al.
• Journal: The British Journal of Nutrition
• Year of publication: 2023
• Link to paper

Study Overview

The D-Health Trial was a large-scale randomized controlled trial conducted in Australia. It enrolled 21,315 adults aged 60-84 years, randomly assigning them to receive either 60,000 IU of vitamin D3 or a matching placebo by oral administration once monthly for five years, with an Evaluation of its effect on pain.

JADAD Score Evaluation

This study achieved a perfect score of 5 on the JADAD scale, indicating that it represents a methodologically high-quality RCT.

Advantages of the JADAD Score

1. Simplicity and Speed: The five-question assessment makes the tool efficient for evaluating numerous papers.
2. High Adoption Rate: Widely recognized internationally, facilitating comparison across studies.

Limitations of JADAD Score

While the JADAD score is a valuable tool, its limitations should also be understood:

Limited Assessment Scope

The JADAD score only evaluates three aspects: randomization, blinding, and dropout reporting. It does not assess the following critical factors:

• Allocation concealment
• Validity of sample size calculation
• Appropriateness of statistical analysis methods
• Validity of outcome measurement
• Pre-registration of study protocol
• Conflict of interest disclosure

Confusion Between Reporting Quality and Implementation Quality

Since the JADAD score primarily evaluates "reporting," it does not assess the underlying research itself. It bases its judgment solely on what is documented in the paper. Therefore, even if proper randomization was conducted, it may still receive a deduction if the method is not adequately described in the paper.

Application Limitations Due to Study Design

Not all clinical trials can be blinded. Studies involving surgical interventions, physical therapy, or strength training may make blinding difficult or impossible.

In such cases, studies may receive low JADAD scores despite having high methodological quality.

More Comprehensive Evaluation Tools

To address the limitations of the JADAD score, more comprehensive evaluation tools have recently been developed:

Score Name	Description
GRADE	Evaluates evidence in four tiers and indicates strength of recommendations
Cochrane Risk of Bias Tool	Assesses risk of bias across six domains
PEDro Scale	11-item evaluation scale used in the physical therapy field

These tools provide more detailed evaluations than the JADAD score but require more time for assessment.

Summary

The JADAD score serves as a valuable tool for quickly evaluating the quality of clinical trials. Its simplicity makes it particularly valuable for systematic reviews and meta-analyses that handle numerous studies. However, it should be noted that its limited scope of assessment and the difficulty in distinguishing between reporting quality and implementation quality are its key limitations.

To make evidence-based decisions, it is essential to understand and utilize these evaluation tools properly. The JADAD score plays a crucial foundational role in this process.