Introduction

Tension-type headache (TTH) is a type of primary headache as defined by the International Classification of Headache Disorders (ICHD) classification1, which was first published in 1988 and updated in 2004 (ICHD-2) and 2018 (ICHD-3), without significant differences. TTH is classified as infrequent episodic, frequent episodic, and chronic TTH1.

The general prevalence of headaches in a person's lifetime is over 90%2. The global prevalence of TTH is 26.1% in the community, affecting 1.89 billion people, making it the most common type of headache worldwide and the third most prevalent disorder, with higher prevalence in females than in males3,4,5. Stress and mental tension are reported to be the most common precipitating factors6. TTH impacts socioeconomic status through medical services cost and sick leave1,3,4,5,7.

TTH is usually self-treated without medical advice, which unfortunately leads to suboptimal management8,9. There are different modalities of treatment, including nonpharmacological (such as relaxation therapy and cognitive therapy) and pharmacological (such as nonsteroidal anti-inflammatory drugs (NSAIDs) and paracetamol) treatments10. Several societies worldwide have tried to standardize the treatment of TTH through their clinical guidelines9,11,12,13,14. Most published guidelines suggest treating episodic tension-type headache (ETTH) with NSAIDs, paracetamol, aspirin + paracetamol + caffeine, or paracetamol + caffeine.

NSAIDs (especially ibuprofen) and paracetamol are recommended as first-line treatments9,11,13,14, with NSAIDs being more effective11,13,14. One guideline recommended combination therapy, including ibuprofen or diclofenac as first-line therapy and paracetamol as second-line therapy12.

As the guidelines and recommendations from multiple societies attempt to define best practices for treating ETTH, there are still issues regarding the quality and methodology of randomized control trials (RCTs)15. There is a paucity of RCTs with a direct comparison between paracetamol and ibuprofen.

Three RCTs directly compared paracetamol with ibuprofen in the treatment of ETTH16,17,18. The first study showed a limited effect of ibuprofen 400 mg compared with paracetamol 1000 mg and placebo. This effect was described as exploratory due to underenrollment and early termination of the study for many reasons16. The second study concluded that paracetamol and ibuprofen are well tolerated and significantly more effective than placebo in symptom relief, with a more significant effect of ibuprofen than paracetamol. This study applied the Ad Hoc Committee on Classification of Headache diagnostic criteria for ETTH for enrolled participants, and the study's primary outcome was not specified17. The third study used first perceptible pain relief and meaningful pain relief as outcomes and showed a significantly earlier time to relief with ibuprofen use than paracetamol use18.

Several studies compared paracetamol with a placebo in the treatment of ETTH, and many of them showed significant superiority of paracetamol 1000 mg regarding efficacy and tolerance8,19,20,21,22,23,24. Some studies showed no significant difference25,26. On the other hand, several studies compared ibuprofen with a placebo, and many of them showed significant superiority of ibuprofen 400 mg regarding efficacy27,28,29,30 and tolerability27,28.

There were two Cochrane reviews and non-Cochrane reviews in the literature. Verhagen et al. included 41 RCTs in their meta-analysis and concluded that NSAIDs were more effective than placebo, with ibuprofen having a favorable side effect profile; paracetamol was considered an alternative. Most of the included studies were published before 1995 and no specific diagnostic criteria were used31. Manzano, Doyon-Trottier, and Bailey found limited evidence in the literature to support the superiority of ibuprofen over paracetamol in benign headache management (including TTH) in children and adults. No specific diagnostic criteria were used32. A low dose of NSAIDs showed a statistically insignificant difference compared with paracetamol in the meta-analysis by Yoon et al.33. They suggested that high doses of NSAIDs may provide more analgesic effects than paracetamol but cause more side effects33. In another comprehensive review of ETTH oral treatment, paracetamol, ibuprofen, and ketoprofen were found to be more effective than placebo, with a high number needed to treat (NNT). No conclusive evidence supports any agent's superiority over other agents34. In the two Cochrane reviews conducted in 2015 and 2016, ibuprofen and paracetamol were significantly superior to placebo in the pain-free 2-h outcome 15,35. A direct comparison between paracetamol and ibuprofen was performed in a limited number of studies (3 studies), which showed no difference between these two medications regarding pain-free status at 2 h. Based on very low-quality evidence, there was a significant difference in pain-free status at 4 h in favor of ibuprofen15.

To the authors' knowledge, the last systematic review was conducted to address ETTH management with these medications in 2015 and 2016 and updated in 2019 without additional studies or changes in outcomes. More RCTs are needed to directly compare the effectiveness of paracetamol and ibuprofen in treating ETTH, which will enable a preliminary conclusion to be drawn from the previous systematic reviews and guidelines. For this reason, we decided to conduct a network meta-analysis to indirectly compare the effectiveness of these medications, which is the first review conducted using network meta-analysis in the ETTH treatment field.

The study aimed to assess the effectiveness difference between paracetamol and ibuprofen in treating ETTH. This aim was achieved by developing a search strategy, screening for relevant RCTs, assessing the eligibility criteria, and directly and indirectly comparing RCTs.

Methods

Literature search

A systematic review was conducted through title and abstract screening, including RCTs published in all languages from 1988 to 1 June 2022 with human subjects, using the following databases: Cochrane Central Register of Controlled Trials (CENTRAL) (via Ovid), EMBASE (via Ovid), MEDLINE (via Clarivate) and Web of Science (via Clarivate).

A search strategy using relevant keywords (see Supplementary note online) was performed by different search modalities, such as medical subject headings (MeSH) and text words using the Boolean operators OR for synonyms of the same concept and AND for combining different concepts. Additionally, we manually searched the reference lists of previous systematic reviews and the included trials for additional studies.

Selection criteria

Types of studies

We included RCTs published from 1988 to 2022, including parallel, crossover, and double-blinded trials, comparing paracetamol with placebo, ibuprofen with placebo, or paracetamol with ibuprofen in the treatment of acute ETTH, regardless of study language or study setting.

We excluded studies without available full text, abstracts only, reviews, and studies without data of interest.

Participants

Study participants included adults (18 years old and older), individuals of both sexes, individuals who met the ICHD criteria for ETTH diagnosis, and individuals who did not have psychiatric disorders that require treatment, significant cognitive disorders, or other significant chronic pain disorders.

We excluded studies with participants with chronic TTH or other headaches, such as migraine.

Types of intervention

All included studies had at least one arm that used oral paracetamol (1000 mg), ibuprofen (400 mg) or either of them compared with a placebo for acute ETTH treatment.

Types of outcomes

The primary outcome was a pain-free status at two hours using any standard pain assessment method and without rescue medication use.

The secondary outcomes were a pain-free status at one hour, the use of rescue medication, and the occurrence of any adverse event and gastrointestinal (GI) adverse events.

Selection of relevant studies:

Two independent authors (A.Y.N. and M.S.F.) reviewed the titles and abstracts to exclude irrelevant articles. The full-text assessment was performed to determine the eligible articles based on the inclusion criteria. Disagreement between the two reviewers was resolved through a discussion with a third author (N.A.B.).

Assessment of methodological quality and risk of bias

As described in the Cochrane Handbook, two independent authors (M.A.H. and H.A.H.) assessed the included studies for risk of bias (RoB). The method used to generate the randomization sequence, allocation concealment, the determination of whether blinding was implemented for participants or staff, and whether there was evidence of selective reporting of the outcomes was recorded. It was judged that 'yes' indicated a low risk of bias, while 'no' indicated a high risk of bias for each item. Subjects were allowed to select 'insufficient' if a judgment could not be made. Review Manager version 5.3.3 was used to generate the RoB table (see Figs. 3 and 4). There was a rereview of the articles and a discussion with a third author (M.S.F.) for any disagreements.

Data abstraction

Two independent authors (A.Y.N. and M.S.F.) abstracted the study design, number and characteristics of participants, medications and their doses, baseline headache intensity, and study outcomes. If a disagreement occurred, a discussion with a third author (N.A.B.) was applied to resolve it.

Statistical analysis

Effect sizes for the network meta-analysis were described with 95% confidence intervals (CIs). Statistical validity was guaranteed when the 95% CI did not include 1.

The efficacy of intervention medications and placebo was measured by calculating the odds ratio (OR) with a 95% CI from the original articles. We used RevMan 5.436 for pairwise meta-analysis and netmetaXL V1.6 for winbug1.4.337 to perform network meta-analysis.

A funnel plot was not created due to the insufficient number of studies.

Results

Identification of relevant studies

The flow diagram shown in Fig. 1 shows how relevant studies were identified. A total of eighty-eight studies were identified by searching four primary databases (Cochrane Library, Embase, MEDLINE, and Web of Science) and by hand searching. After removing duplicates and screening titles and abstracts, we obtained twenty-nine articles to be assessed for eligibility. Among these articles, fifteen were excluded from the final analysis. The following articles were excluded during the final review: articles that did not fit the inclusion criteria, articles that mainly followed the ICHD criteria and had an age group difference (n = 8), review articles (n = 3), articles that did not include data of interest (n = 3), and articles that did not perform a medication comparison (n = 1). The final 14 studies were entered into the meta-analysis.

Figure 1
figure 1

PRISMA flow diagram.

Characteristics of the studies included in the final analysis

In 14 RCTs (parallel and crossover), we identified a total of 6521 participants (2472 received placebo, 3097 received paracetamol, and 952 received ibuprofen), all of whom were adults with ETTH defined by IHS diagnostic criteria (ICHD). The included studies were published between 1988 and 2022. One article reported two studies with different outcomes and methodologies; the first was a crossover study, and the second was a parallel study38. Another article included six studies in one report; the first four studies were pooled together, and the last two were pooled together39. The average headache intensity at baseline in all studies was moderate to severe. One study directly compared paracetamol and ibuprofen in the treatment of ETTH38. Six studies compared paracetamol with a placebo, and the other six compared ibuprofen with a placebo. Table 1 shows the clinical data of the included studies.

Table 1 Clinical data of included studies.

Figure 2 shows the network plot of relevant studies. Circles represent each drug as a node, and lines represent direct comparisons. The extent of the circle indicates the number of included participants receiving each drug, and the line thickness indicates the number of studies included in each comparison. Placebo had the largest node.

Figure 2
figure 2

Network plot for relevant studies.

Methodological quality

For the methodological quality of the included studies, half of the studies had a low risk of bias in random sequence generation, and double blinding was not consistent in all the included studies. Only three studies had a high risk of attrition bias, and another two had a high risk of reporting bias. Most other articles had a low RoB. Details of the quality characteristics of each study are demonstrated in Fig. 3, which provided a summary of the RoB. Overall, studies had a low RoB, as shown in Fig. 4. The inconsistency plot of the included studies showed a fixed effect (Fig. 5).

Figure 3
figure 3

Risk of bias table.

Figure 4
figure 4

Summary of risk of bias.

Figure 5
figure 5

Inconsistency plot of enrolled studies (pain free at 2 h outcome).

Comparative efficacy of paracetamol, ibuprofen, and placebo

Figure 6 shows a forest plot of pain-free status at 2 h. The relative efficacy is plotted as the OR with the 95% CI. Ibuprofen (OR: 1.73, 95% CI 1.17–2.56) showed better efficacy than paracetamol (OR: 1.62, 95% CI 1.24–2.13). Paracetamol (OR: 1.42, 95% CI 0.87–2.30) showed better efficacy than ibuprofen (OR: 1.20, 95% CI 0.58–2.48) in pain-free status at 1 h, as shown in Fig. 7. One study directly compared paracetamol and ibuprofen, and the difference was not statistically significant (P = 0.66). The forest plot in Fig. 8 shows data on the use of rescue medication. Paracetamol was associated with the lowest likelihood of rescue medication use compared with ibuprofen and placebo (OR: 0.49, 95% CI 0.37–0.65).

Figure 6
figure 6

Forest plot of pain free at 2 h.

Figure 7
figure 7

Forest plot of pain free at 1 h.

Figure 8
figure 8

Forest plot of rescue medication used.

Adverse events related to the studied medications:

A variety of adverse events related to the studied medications included any adverse events or GI adverse events. A network meta-analysis was conducted for the occurrence of any adverse events, as shown in Fig. 9, and GI adverse events, as shown in Fig. 10. There was no statistical difference of any adverse and GI adverse events of ibuprofen compared with placebo and paracetamol (OR: 0.95, 95% CI 0.64–1.41 and OR: 0.81, 95% CI 0.44–1.50, respectively). Among all reported adverse events, all of them were considered a mild and no major adverse event were reported. The most reported adverse events for paracetamol are stomach discomfort (112/325) and dizziness (40/325) while the most adverse events related to ibuprofen are nausea (11/72) and dizziness (9/72).

Figure 9
figure 9

Forest plot of any adverse events.

Figure 10
figure 10

Forest plot of GI adverse events.

Discussion

Our study aimed to assess the effectiveness difference between paracetamol and ibuprofen in treating ETTH through direct and indirect RCTs.

There was no statistically significant difference between paracetamol and ibuprofen in pain-free status at 1 and 2 h. There was no heterogeneity. It is difficult to conclude which medication is more effective regarding pain-free status at 1 or 2 h. Ibuprofen showed a better effect on pain-free status at 2 h, while paracetamol showed a better effect on pain-free status at 1 h. Participants taking paracetamol showed less rescue medication use than those taking ibuprofen; this difference was not statistically significant for paracetamol, with no heterogeneity.

Regarding any adverse events, all studies reported mild side effects, including GI adverse events. Analysis of any adverse event and GI adverse events showed a statistically insignificant difference between paracetamol and ibuprofen.

In this review, the decision was made to perform network meta-analysis, even though it has lower quality than pairwise meta-analysis, to overcome the paucity in direct comparisons between paracetamol and ibuprofen based on our search. The ICHD definition, first published in 1988, was chosen because it is widely accepted and the leading definition worldwide. Nevertheless, there were no significant changes regarding the criteria until 20221.

Many of our outcomes agree with several trials and reviews. Paracetamol and ibuprofen are significantly superior to placebo regarding pain-free status at two hours15,17,31,34,35 but not pain-free status at one hour15,35,38. Regarding the head-to-head comparison, a Cochrane review15 showed that there was nonstatistically significant superiority of ibuprofen regarding pain-free status at two hours, and the one-hour outcome was not analyzed due to the small number of events. This conclusion was based on one published trial and two nonpublished trials, with reported apparent heterogeneity between them. In the Cochrane review, the trials included applied IHS diagnostic criteria and other diagnostic criteria. A recent trial38 also found nonstatistically significant superiority of ibuprofen regarding pain-free status at two hours. This result was inconclusive because the study stopped before reaching the planned number of subjects for enrollment due to business and enrollment issues.

Schachtel et al.17 showed better significant efficacy of ibuprofen regarding pain-free status at two hours, but at one hour, there was a limited number of events that could not be analyzed. This trial is the only trial found to be titled as a direct head-to-head comparison, and they used Ad hoc diagnostic criteria in their inclusion criteria. Another trial18 reported statistically significant superiority of ibuprofen but used different outcomes, such as first perceptive pain relief and meaningful pain relief.

EFNS and BASH guidelines recommend ibuprofen as the drug of choice in ETTH treatment and describe paracetamol as less effective. Both guidelines were not based on systematic reviews. The Danish and Canadian guidelines recommend ibuprofen or paracetamol as first-line therapy; they depended on EFNS guidelines in their recommendation.

Paracetamol was favored regarding pain-free status at 1 h and had the lowest likelihood of rescue medication use, but the difference was statistically insignificant. However, a direct study (Yong Yue's 2017–1) favored ibuprofen regarding one-hour pain-free status, but the difference was statistically insignificant.

Regarding the use of rescue medications, our result agrees with the Cochrane review that paracetamol is significantly superior to a placebo. When paracetamol was compared with ibuprofen, it showed insignificant superiority, as the included studies demonstrated the use of rescue medications after 2 h; this result may be associated with the superiority of paracetamol in pain-free status at 1 h.

Regarding all adverse or GI events, the results of the review are not consistent with other reports. Literature shows that ibuprofen has favorable GI adverse events compared with other NSAIDs, but it is not favorable over paracetamol, neither are statistically significant31,40. This inconsistency could be by chance, methodological pitfalls, or other unknown reasons. For individuals with a risk of GI bleeding or using anticoagulants, paracetamol may be preferred over ibuprofen with a caution of liver injury that may associated with a large amount of paracetamol31,40.

Nonetheless, there are some limitations. There was only one study that performed a direct comparison between paracetamol and ibuprofen. Another area for improvement is related to the quality of the included studies, most of which had one or more forms of bias. In addition, a relatively small number of studies was found, and some lacked data of interest. To overcome this issue, the decision was made to include all parallel and crossover RCTs. Additionally, we excluded three studies with missing data; the authors were contacted but did not respond. Regarding excluded studies, we excluded three because they constituted an unethical alteration of the risk—benefit relationship. Additionally, we searched for ongoing studies, and no study was found.

Conclusion

Paracetamol and ibuprofen showed better efficacy than placebo in treating ETTH; there was no statistically significant difference in efficacy between the two drugs. For individuals at a higher risk (like renal insufficiency or risk of GI bleeding), paracetamol may be considered as a preferred option instead of Ibuprofen. Further meta-analyses of head-to-head trials are needed for direct comparisons in the future.