Article | Open | Published:

Persisting disparities between sexes in outcomes of ruptured abdominal aortic aneurysm hospitalizations

Scientific Reportsvolume 7, Article number: 17994 (2017) | Download Citation


We sought to describe and analyze discrepancies between sexes in the outcomes of patients hospitalized for ruptured abdominal aortic aneurysms (rAAA) by conducting a retrospective analysis of the Nationwide Inpatient Sample. The review included all adult patients (≥18 years old) hospitalized with a primary diagnosis of rAAA between January 2002 and December 2014. In-hospital mortality differences between females and males were analyzed overall and separately among those receiving endovascular AAA repair (EVAR) or open AAA repair (OAR). In-hospital mortality for females declined from 61.0% in 2002 to 49.0% in 2014 (P for trend <0.001), while mortality for males declined from 48.6% in 2002 to 32.2% in 2014 (P for trend <0.001). Among those receiving EVAR, females were significantly more likely to die in the hospital than males (adjusted odds ratio [OR], 1.44; 95% CI, 1.12–1.84). In addition, the odds of mortality among those receiving OAR were higher for females than males (adjusted OR, 1.14; 95% CI: 1.00–1.31). These data provide evidence that despite overall decreasing trends in mortality for both sexes, females remain at higher risk of death compared with males regardless of surgical repair procedure.


Abdominal aortic aneurysm (AAA) affects approximately 4–5% of adults over 50 years of age, and is several times more common in men than in women1,2,3. Mortality among patients with AAA is high, primarily due to ruptured abdominal aortic aneurysm (rAAA)4. According to a systematic review and meta-analysis, 32% of patients with rAAA die before reaching the hospital5, and those that do survive long enough to reach medical care have been shown to have a 39% in-hospital mortality rate6.

Females with AAA are more likely to present at older age with rAAA and have higher risk of mortality compared with males7,8,9. Several reviews have found that females are less likely to undergo surgical treatment of rAAA10,11,12, and it has been postulated that the diagnosis of rAAA in females may be delayed and a sex bias may exist in selecting candidates for surgery13.

Females with rAAA tend to be underdiagnosed as well as undertreated, which may be a factor in having worse prognoses. A 10-year inpatient sample study from the Centers for Medicare and Medicaid Services showed the average mortality rate for females with rAAA was 52.8% compared with 44.2% among males14. In a report on national rAAA outcomes from 2001 to 2004, a higher percentage of females with AAA presented with rupture compared with males, and this trend did not decrease over time15.

Despite this wealth of existing information, there is a need for a definitive examination of disparities in rAAA outcomes between females and males in the United States. To that end we have utilized 13 years of all-payer inpatient data, aimed at describing and quantifying trends in rAAA hospitalizations and disparities in outcomes between sexes.


Data Source

This study utilized the 2002–2014 discharge data from the Nationwide Inpatient Sample (NIS), provided by the Agency for Healthcare Research and Quality’s (AHRQ) Healthcare Cost and Utilization Project (HCUP)16. The NIS is the largest publicly-available all-payer inpatient database in the United States. Each year of data contains information from more than 7 million hospitalizations, representing a 20-percent stratified sample of all US inpatient stays in nonfederal hospitals. Included sampling weights were used to calculate national estimates.

This study was approved by the Deerfield Institute Research Review Committee and deemed to be in full compliance of HIPAA (Health Insurance Portability and Accountability Act) guidelines, as it was conducted with publicly available deidentified data.

Study Population and Variables

We identified all hospitalizations among adults ≥18 years or older between January 2002 and December 2014 with a primary diagnosis of rAAA using International Classification of Diseases, Ninth Edition, Clinical Modification (ICD-9-CM) codes 441.3, 441.5, or 441.6. Endovascular AAA repair (EVAR) procedures were identified using ICD-9-CM code 39.71 and open AAA repair (OAR) procedures using codes 38.34, 38.44, 38.64, and 39.52. Perioperative complications were identified using ICD-9-CM codes for acute myocardial infarction (410.01, 410.11, 410.21, 410.31, 410.41, 410.51, 410.61, 410.81), acute renal failure (584.0, 584.5, 584.6, 584.7, 584.8, 584.9), venous thromboembolism (415.11–415.19, 451.11–451.19, 451.81, 451.83, 453.2, 453.40–453.42, 671.30–671.33, 671.40–671.44, 673.20–673.24), gastrointestinal (GI) bleed (578.0, 578.1, 578.9), and bowel obstruction without mention of hernia (560.0–560.2, 560.30–560.32, 560.39, 560.81, 560.89, 560.9). These perioperative complications were selected a priori based on their established clinical significance and relevance to outcomes in patients with rAAA17.

Patient characteristics were extracted from the database, including demographics (age, sex, race, expected primary payer, and income quartile for patient’s ZIP code), hospital characteristics (US geographic region, location and teaching status, and hospital bed size), and 29 Elixhauser comorbidities. The Elixhauser comorbidity index is a validated measure of comorbidities in large administrative databases as defined by AHRQ18. We used the van Walraven modification of the Elixhauser comorbidity measures to calculate a single numeric score for disease burden19.


Our primary outcomes were sex disparities among national temporal trends in rate of hospitalizations, mean charges per hospitalization, in-hospital mortality, and perioperative complications following rAAA repair.

Hospital Charges

Hospital charges included in the NIS are the amount the hospital billed to Medicare, Medicaid, private insurance, and other sources for the entire hospital stay. Mean hospital charges reported have been adjusted to 2014 dollars using the Bureau of Labor Statistics’ inflation calculator.

Statistical Analyses

National weighted estimates were obtained by applying trend weights provided by AHRQ and were used for all statistical analyses. Descriptive statistics were reported as weighted values with mean (standard deviation [SD]) or count with percentages, as appropriate.

National incidence rates of hospitalizations for rAAA were calculated by dividing the annual weighted number of hospitalizations for each sex by the appropriate adult population on July 1 using estimates from the US Census Bureau’s American FactFinder database20, and expressing the result as rate of hospitalizations per 100,000 adults. Univariate between-group differences were analyzed using Pearson χ2 tests for categorical variables and 2-tailed t tests for continuous variables. The Cochran-Armitage test was used for temporal trend analysis of categorical variables and one-way ANOVA was used to assess the significance of differences between means of continuous variables.

Multivariable logistic regression was used to examine differences in in-hospital mortality and perioperative outcomes between females and males. Covariates in the regression models included patient characteristics, comorbidities, and hospital characteristics. All patients were included in the regression models except those with missing data on age, race, expected primary payer, income quartile, and Elixhauser comorbidities.

All analyses were performed with SPSS Complex Samples module version 23.0 (IBM Corp., Armonk, NY) with statistical significance defined as P ≤ 0.05. Complex sample data analysis adjusts for weights, cluster, and stratification of the sampling design to produce unbiased national estimates of population means and frequencies from the sample after taking into account weights for over- or under-sampling of specific groups21. This complex sample analysis method is comparable with a multilevel mixed-effects model with random effects for hospital22. The Taylor-series linearization method was used to calculate standard errors23.


Characteristics of rAAA Hospitalizations

A total of 75,698 weighted records with a primary diagnosis of rAAA were identified in the NIS database from 2002 to 2014. Table 1 summarizes the differences between females and males in patient characteristics, procedure characteristics, and hospital characteristics. Of the 75,698 total hospitalizations examined, 22,177 (29.3%) were females and 53,521 (70.7%) were males. There were significant differences between females and males relating to age, race/ethnicity, expected primary payer, hospital geographic region, hospital location and teaching status, and hospital bed size. Females had significantly shorter mean lengths of stay, 8.2 days (13.2), compared with males, 10.5 days (13.9) (P < 0.001). There were no significant differences in calculated van Walraven Elixhauser comorbidity score between females, 5.4 (5.4), and males, 5.5 (5.6) (P = 0.24).

Table 1 Descriptive characteristics of patients hospitalized with primary diagnosis of rAAA, 2002–2014.

Among females, 13.9% of hospitalizations received EVAR compared with 19.3% among males (P < 0.001). Female hospitalizations also had a significantly lower proportion receive OAR compared with males (44.3% vs 57.2%, respectively; P < 0.001). A significantly higher proportion of females compared with males did not receive any coded rAAA repair procedure (41.7% vs 23.5%, P < 0.001).

Trends in Rate of rAAA Hospitalizations and Mean Charges

Relative to the underlying population, the rate of hospitalizations for rAAA among females decreased from 1.90 per 100,000 in 2002 to 1.04 per 100,000 in 2014 (P for trend <0.001) (Fig. 1). Adjusted mean hospital charges (in 2014 $) for females increased from $95,639 in 2002 to $136,694 in 2014 (P for trend <0.001). The hospitalization rate for males decreased from 5.06 per 100,000 in 2002 to 2.74 per 100,000 in 2014 (P for trend <0.001), while adjusted mean hospital charges increased from $129,717 in 2002 to $207,725 in 2014 (P for trend <0.001).

Figure 1
Figure 1

Temporal trends in rate of hospitalizations per 100,000 adults and adjusted mean charges for stays with primary diagnosis of rAAA. Mean hospitalization charges for each year have been adjusted to 2014 inflation dollars. Error bars indicate SE.

Perioperative Complications and In-Hospital Mortality

In the overall study cohort, 53.5% of females with rAAA died in the hospital compared with 41.9% of males (P < 0.001). In-hospital mortality for females declined from 61.0% in 2002 to 49.0% in 2014 (P for trend <0.001), while mortality for males declined from 48.6% in 2002 to 32.2% in 2014 (P for trend <0.001) (Fig. 2).

Figure 2
Figure 2

Temporal trends for rAAA in-hospital mortality among males and females.

Among patients receiving EVAR, 30.5% of females died in the hospital compared with 23.5% of males (P < 0.001). After adjusting for covariates, females receiving EVAR had 44% higher odds of in-hospital mortality than males receiving EVAR (adjusted OR, 1.44; 95% CI, 1.12–1.84) (Table 2). There were no significant differences between females and males in the odds of perioperative complications among those receiving EVAR, after adjusting for covariates.

Table 2 In-hospital outcomes of patients undergoing repair for rAAA.

Among patients receiving OAR, 45.7% of females died in the hospital compared with 38.4% of males (P < 0.001). The results of the logistic regression model showed that females receiving OAR had 14% higher odds of in-hospital mortality than males receiving OAR (adjusted OR, 1.14; 95% CI, 1.00–1.31). Females receiving OAR were less likely than males to experience certain perioperative complications, including venous thromboembolism (adjusted OR, 0.45; 95% CI, 0.28–0.72) and bowel obstruction without mention of hernia (adjusted OR, 0.58; 95% CI, 0.47–0.70).

Temporal trends in surgical repair utilization and mortality are depicted in Fig. 3. There were significant increasing trends for both females and males in the proportion of rAAA hospitalizations that received EVAR, with concomitant significant decreasing trends for both sexes in the proportion receiving OAR (P for trend <0.001 for both females and males, EVAR and OAR). The in-hospital mortality proportion among females receiving EVAR varied substantially throughout the study period and no significant trend was observed (P for trend = 0.51), while the in-hospital mortality proportion among males receiving EVAR decreased significantly (P for trend <0.001). Among patients receiving OAR, there was a decreasing trend in mortality for females, though it was not statistically significant (P for trend = 0.06), while mortality among males significantly decreased from 41.3% in 2002 to 33.6% in 2014 (P for trend <0.001).

Figure 3
Figure 3

Temporal trends for rAAA surgical repair utilization and mortality. (A) There were significant (P for trend <0.001) increasing trends for both males and females in utilization of EVAR; (B) significant (P for trend <0.001) decreasing trends for both males and females in utilization of OAR; (C) significant (P for trend <0.001) decreasing trend in mortality among males receiving EVAR, and no significant change among females (P for trend =0.51); (D) significant (P for trend <0.001) decreasing trend in mortality among males receiving OAR, and no statistically significant change among females (P for trend =0.06).

Table 3 and Fig. 4 summarize sex differences in in-hospital mortality for each year of data. There was no discernable changing trend in odds of mortality among females versus males, with disparities persisting throughout the study period. Females had the highest odds of in-hospital mortality in 2014, the most recent year of data available (adjusted OR, 1.96; 95% CI, 1.38–2.78).

Table 3 Odds of rAAA mortality by year and gender.

Figure 4
Figure 4

Risk-adjusted mortality odds ratios by year for females vs males.


Previous research has shown disparities between sexes exist related to risk and outcomes of AAA. While females are generally protected from the development of AAAs, the ones that do develop behave more aggressively with higher growth and rupture rates, and are more likely to result in death24,25. However, to our knowledge, there has not been a multiyear comprehensive assessment of the disparities between females and males with regards to outcomes following hospitalization for rAAA. Using 13 years of data from the largest publicly available database of US inpatient stays, we found significant differences between females and males presenting to the hospital with a primary diagnosis of rAAA.

There were significant decreases in the rate of hospitalizations for rAAA among both females and males from 2002 through 2014. However, the hospital charges increased significantly for both sexes during the same time period. These rising charges were not due to increasing time spent in the hospital – the mean length of stay for males with rAAA was 11.3 days in 2002 and 9.5 days in 2014, compared with 9.4 days in 2002 and 6.6 days in 2014 for females (data not shown). Increasing hospital charges are most likely due to a variety of factors, including utilization of new technology and increasing drug prices.

We also investigated potential interaction effects between patient sex and time for dependent variables of adjusted mean charges and hospitalization rate – these analyses were conducted to investigate if the delta between sexes for each dependent variable changed significantly over time. The interaction between sex and time for mean hospital charges resulted in a P value of 0.100, though the interaction effect for hospitalization rate was <0.001. This suggests that while the rate of rAAA hospitalizations decreased over time for both sexes, the delta between the rate for males and that for females decreased significantly over time.

There were also significant decreases over time for both sexes in the proportion of patients dying in the hospital, though in each year females had a higher in-hospital mortality rate than males. After adjusting for potential confounders, we found that overall females had 35% higher odds of mortality than males despite having similar van Walraven Elixhauser comorbidity scores with males and similar perioperative complications. This confirms previous research showing that females with AAA tend to have disproportionately worse outcomes than men14,25. The United States Preventive Services Task Force (USPSTF) has historically not recommended screening for AAA in females regardless of risk factors, though, as of the writing of the manuscript, the USPSTF is considering a revised draft plan for AAA screening that would include asymptomatic adults in both sexes26. It is possible that if this plan is implemented, we may see a reduction in the mortality disparity between males and females with rAAA. Due to the fact that AAAs are often asymptomatic until they rupture, it is not unreasonable to assume that the prevalence is currently underdiagnosed. However, AAA screening can also potentially lead to the opposite problem of overdiagnosis. Most screen-detected AAAs are small (70% are <40 mm in diameter), which, while having low risk of rupture, can lead to other harms for some patients, such as psychological burden and unnecessary surgery27.

We performed separate analyses on sex disparities among those receiving EVAR and OAR. The proportion of rAAA patients who received EVAR increased substantially for both males and females, while the proportion receiving OAR decreased. We also examined the interaction between sex and time for both surgeries to investigate the delta between males and females. The interaction for EVAR yielded a P value of 0.062, while for OAR the interaction P value was 0.118. These results suggest that while clearly the gaps between sexes in terms of the proportions receiving EVAR or receiving OAR have widened and narrowed, respectively, the results were not quite statistically significant.

Females who received EVAR were significantly more likely to die than males, even after adjusting for potential confounders. Interestingly, this disparity in mortality occurred despite no significant differences in any of the perioperative complications studied. Females who received OAR were also significantly more likely to die than males, though the result just met our significance threshold of 0.05. However, among these patients, females were shown to have a significant protective effect in the odds of perioperative venous thromboembolism and bowel obstruction, and no significant differences were shown for the other perioperative complications.

Disparities in mortality between sexes persisted across the study period. We separately calculated adjusted odds of in-hospital death for females vs males in each year, and found that consistently females had higher risk than males. Despite decreasing mortality rates for both sexes, females have remained at higher risk of death compared with males.

There are many potential reasons for these outcome disparities, including differences in diagnosis and treatment rates or inherent anatomic dissimilarities. It is also possible that the lack of recommended one-time screening for AAA in females could be partially responsible. However, it is clear that greater focus is needed on improving rAAA outcomes among females, and additional research is necessary to determine potential underlying pathophysiological explanations for outcome disparities between sexes.

While this study provides valuable information on disparities in outcomes for rAAA between sexes, there are some important limitations that warrant further examination. The NIS database is an administrative data set originally generated for billing purposes and is vulnerable to coding errors and incomplete data. We analyzed 13 years of data, consisting of over 75,000 hospitalizations for rAAA, which should diminish the effect of any potential coding errors. Similarly, due to the nature of administrative data we were unable to discern information on the pathophysiology of each patient’s AAA, including diameter of the ruptured vessel, vessel tortuosity, and site of rupture (intraperitoneal cavity or retroperitoneal cavity). Each of these variables may influence perioperative complications or in-hospital mortality and may have an effect on whether a patient is an appropriate candidate for EVAR or OAR. Finally, the NIS is restricted to in-hospital data and does not provide information on long-term outcomes.

Despite these potential limitations, this study has some notable strengths. Using 13 years of data from the largest publicly-available all-payer inpatient database in the United States, we conducted the first comprehensive study to focus on outcome disparities in hospitalizations for rAAA between females and males. Future research could focus on conducting similar analyses in the emergency department setting, which in conjunction with the results of this study would provide a complete picture of the clinical and economic characteristics of rAAA patients in the ED and hospital.


To our knowledge this is the first comprehensive investigation focusing specifically on sex disparities in hospitalizations for rAAA. We demonstrate that, while overall the incidence and mortality of rAAA have improved over time for both sexes, females remain at higher risk of in-hospital death than males. This risk disparity persisted throughout the study period, despite females and males having similar van Walraven Elixhauser comorbidity scores and similar perioperative complications. Females were also less likely to undergo rAAA repair than males, and among patients who did receive either EVAR or OAR procedures, females were more likely to die in the hospital.

Additional information

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.


  1. 1.

    Lederle, F. A. et al. The aneurysm detection and management study screening program: validation cohort and final results. Aneurysm Detection and Management Veterans Affairs Cooperative Study. Arch. Intern. Med. 160, 1425–1430 (2000).

  2. 2.

    Lederle, F. A., Johnson, G. R. & Wilson, S. E. Abdominal aortic aneurysm in women. J. Vasc. Surg. 34, 122–126 (2001).

  3. 3.

    Lee, E. S., Pickett, E., Hedayati, N., Dawson, D. L. & Pevec, W. C. Implementation of an aortic screening program in clinical practice: implications for the Screen for Abdominal Aortic Aneurysms Very Efficiently (SAAAVE) Act. J. Vasc. Surg. 49, 1107–1111 (2009).

  4. 4.

    Lee, A. M. & Chaikof, E. L. Is the abdominal aortic aneurysm rupture rate decreasing? Adv. Surg. 47, 271–286 (2013).

  5. 5.

    Reimerink, J. J., van der Laan, M. J., Balm, R. & Legemate, D. A. Systematic review and meta-analysis of population-based mortality from ruptured abdominal aortic aneurysm. Br. J. Surg. 100, 1405–1413 (2013).

  6. 6.

    Dua, A., Kuy, S., Lee, C. J., Upchurch, G. R. Jr. & Desai, S. S. Epidemiology of aortic aneurysm repair in the United States from 2000 to 2010. J. Vasc. Surg. 59, 1512–1517 (2014).

  7. 7.

    Lo, R. C. et al. Vascular Study Group of New England. Gender differences in abdominal aortic aneurysm presentation, repair, and mortality in the Vascular Study Group of New England. J. Vasc. Surg. 57, 1261–1268 (2013).

  8. 8.

    Mureebe, L., Egorova, N., McKinsey, J. F. & Kent, K. C. Gender trends in the repair of ruptured abdominal aortic aneurysms and outcomes. J. Vasc. Surg. 51, 9S–13S (2010).

  9. 9.

    Grootenboer, N. et al. Systematic review and meta-analysis of sex differences in outcome after intervention for abdominal aortic aneurysm. Br. J. Surg. 97, 1169–1179 (2010).

  10. 10.

    Dueck, A. D., Johnston, K. W., Alter, D., Laupacis, A. & Kucey, D. S. Predictors of repair and effect of gender on treatment of ruptured abdominal aortic aneurysm. J. Vasc. Surg. 39, 784–787 (2004).

  11. 11.

    Semmens, J. B., Norman, P. E., Lawrence-Brown, M. M. D. & Holman, C. D. A. Influence of gender on outcome from ruptured abdominal aortic aneurysm. Br. J. Surg. 87, 191–194 (2000).

  12. 12.

    Filipovic, M., Seagroatt, V. & Goldacre, M. J. Differences between women and men in surgical treatment and case fatality rates for ruptured aortic abdominal aneurysm in England. Br. J. Surg. 94, 1096–1099 (2007).

  13. 13.

    Starr, J. E. & Halpern, V. Abdominal aortic aneurysms in women. J. Vasc. Surg. 57, 3S–10S (2013).

  14. 14.

    Dillavou, E. D., Muluk, S. C. & Makaroun, M. S. A decade of change in abdominal aortic aneurysm repair in the United States: have we improved outcomes equally between men and women? J. Vasc. Surg. 43, 230–238 (2006).

  15. 15.

    McPhee, J. T., Hill, J. S. & Eslami, M. H. The impact of gender on presentation, therapy, and mortality of abdominal aortic aneurysm in the United States, 2001–2004. J. Vasc. Surg. 45, 891–899 (2007).

  16. 16.

    National Inpatient Sample (NIS). Healthcare Cost and Utilization Project (HCUP). Agency for healthcare research and quality. Rockville, MD (2002–2014).

  17. 17.

    Edwards, S. T. et al. Comparative effectiveness of endovascular versus open repair of ruptured abdominal aortic aneurysm in the Medicare population. J. Vasc. Surg. 59, 575–582 (2014).

  18. 18.

    Elixhauser, A., Steiner, C., Harris, D. R. & Coffey, R. M. Comorbidity measures for use with administrative data. Med. Care. 36, 8–27 (1998).

  19. 19.

    van Walraven, C., Austin, P. C., Jennings, A., Quan, H. & Forster, A. J. A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med. Care. 47, 626–633 (2009).

  20. 20.

    U.S. Census Bureau, Population Division. American FactFinder. Annual Estimates of the Resident Population. Available from:

  21. 21.

    Saylor, J., Friedmann, E. & Lee, H. J. Navigating complex sample analysis using national survey data. Nurs. Res. 61, 231–237 (2012).

  22. 22.

    Hicks, C. W. et al. Comprehensive assessment of factors associated with in-hospital mortality after elective abdominal aortic aneurysm repair. JAMA Surg. 151, 838–845 (2016).

  23. 23.

    Bieler, G. S., Brown, G. G., Williams, R. L. & Brogan, D. J. Estimating model-adjusted risks, risk differences, and risk ratios from complex survey data. Am. J. Epidemiol. 171, 618–623 (2010).

  24. 24.

    Lo, R. C. & Schermerhorn, M. L. Abdominal aortic aneurysms in women. J. Vasc. Surg. 63, 839–844 (2016).

  25. 25.

    Stuntz, M. Modeling the burden of abdominal aortic aneurysm in the USA in 2013. Cardiology. 135, 127–131 (2016).

  26. 26.

    Draft Research Plan: Abdominal Aortic Aneurysm: Primary Care Screening. U.S. Preventive Services Task Force. August 2017. Available from:

  27. 27.

    Johansson, M., Hansson, A. & Brodersen, J. Estimating overdiagnosis in screening for abdominal aortic aneurysm: could a change in smoking habits and lowered aortic diameter tip the balance of screening towards harm? BMJ. 350, h825 (2015).

Download references


Financial support for this research was funded by Deerfield Management, a healthcare investment firm dedicated to advancing healthcare through investment, information and philanthropy. The funder provided support in the form of salaries for the authors, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information


  1. Deerfield Institute, New York, NY, USA

    • Mark Stuntz
    • , Céline Audibert
    •  & Zheng Su


  1. Search for Mark Stuntz in:

  2. Search for Céline Audibert in:

  3. Search for Zheng Su in:


M.S. conceived and designed the study. M.S., C.A., and Z.S. wrote the main manuscript text. M.S., C.A., and Z.S. calculated statistics and analyzed the data. M.S. supervised the project. All authors reviewed the manuscript.

Competing Interests

The authors declare that they have no competing interests.

Corresponding author

Correspondence to Mark Stuntz.

About this article

Publication history






By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.