Abstract
In this study, we compared the dichotomous and 5-scale grading systems for point-of-care immunoassay of tear matrix metalloproteinase (MMP)-9 in dry eye disease (DED) patients and identified the optimal dichotomous system to correlate with DED parameters. We included 167 DED patients without primary Sjogren's syndrome (pSS) (Non-SS DED) and 70 DED patients with pSS (SS DED). We graded MMP-9 expression in InflammaDry® (Quidel, San Diego, CA, USA) using a 5-scale grading system and dichotomous grading systems with four different cut-off grades (D1 to D4 systems). The only DED parameter that showed a significant correlation with the 5-scale grading method was tear osmolarity (Tosm). In both groups, subjects with positive MMP-9 had lower tear secretion and higher Tosm than those with negative MMP-9 according to the D2 dichotomous system. Tosm determined D2 positivity at cutoffs > 340.5 and > 317.5 mOsm/L in the Non-SS DED and SS DED groups, respectively. Tear secretion < 10.5 mm or tear break-up time < 5.5 s stratified D2 positivity in the Non-SS DED group. In conclusion, the dichotomous grading system of InflammaDry reflects ocular surface indices better than the 5-scale grading system and may be more practical in real clinical circumstances.
Similar content being viewed by others
Introduction
Matrix metalloproteinases (MMPs) are proteolytic enzymes that play an important role in inflammation-induced wound healing. MMP-9, in particular, has been known to degrade tight junctions, leading to disruption of barrier function in the corneal epithelium1. As such, MMP-9 may contribute to the pathogenesis of various conditions, including dry eye disease (DED), blepharitis, sterile corneal ulceration, ocular allergy, fungal keratitis, burns, advanced keratoconus with an irregular surface, active pterygia, and conjunctivochalasis2,3,4,5,6,7,8,9.
Fortunately, a commercial point-of-care immunoassay for MMP-9 measurement in tears is now available, known as InflammaDry® (Quidel, San Diego, CA, USA), which was introduced in 201310. The InflammaDry test is a disposable and semi-quantitative test that displays the level of MMP-9 through a red-colored band within 10 min of its application to the inferior conjunctival fornix tear film, and is widely used for evaluating dry eye disease (DED). It has demonstrated high positive and negative agreement for confirming suspected DED11, and was found to be useful in verifying the effectiveness of topical anti-inflammatory cyclosporin A12. Additionally, the InflammaDry test results correlated well with those of other dry eye tests in confirmed dry eye patients13.
Although it was recently discovered that the 5-scale grading system is sensitive to changes in MMP-9 concentrations in tears and has favorable reliability and accuracy14, such semi-quantitative grading of results remains controversial. Additionally, many clinicians still intuitively judge the results using a dichotomous approach, distinguishing between negative and positive results15,16. Nevertheless, determining the optimal single thickness of a red line to distinguish positive from negative results and correlate well with various pre-established dry eye parameters remains a challenge.
To address this issue, we conducted a comparative analysis of dichotomous interpretation with varying cut-off thicknesses of readout lines and a 5-scale grading system in InflammaDry tests. Our goal was to identify the optimal system that would enable us to effectively correlate the test results with objective dry eye parameters in patients with DED.
Results
Demographics, MMP-9, and clinical parameters of DED
Table 1 presents the demographics, MMP-9 levels, and clinical parameters of DED in each group. The study included a total of 464 eyes from 237 patients with DED, of which 167 had DED without primary Sjogren’s syndrome (pSS) (i.e. non-SS DED group), and 70 had DED with pSS (i.e. SS DED group). The mean age in the non-SS DED and SS DED groups was 59.7 ± 15.0 years and 54.1 ± 12.7 years, respectively (P = 0.002). The female gender was more prevalent in the SS DED group (92.9%) than in the non-SS DED group (69.5%, P < 0.001). Among the DED parameters, corneal erosion score, Sjogren’s International Collaborative Clinical Alliance (SICCA) ocular staining score (OSS), Schirmer I, and tear break-up time (BUT) were significantly worse in the SS DED group (P < 0.001, P < 0.001, P < 0.001, and P = 0.003, respectively). However, the ocular surface disease index (OSDI) score was higher in the non-SS DED group (P = 0.001). Corneal sensitivity, meibomian gland dysfunction (MGD) grades, and tear osmolarity (Tosm) did not differ significantly between the two groups. In terms of the InflammaDry test, the grades according to the 5-scale grading system were significantly higher in the SS DED group (P < 0.001). Moreover, positive patients by D2, D3, and D4 dichotomous systems were significantly higher in the SS-DED group (P < 0.001, P < 0.001, and P = 0.030, respectively).
Difference of ocular surface indices according to the expression of MMP-9 in tear
We evaluated ocular surface indices for DED depending on the positivity of tear MMP-9 expression by the D1 to D4 dichotomous system in both groups, as shown in Tables 2, 3, 4 and 5. All ocular surface indices were not different between positive and negative MMP-9 in tears by D1 and D4 systems in both groups (Tables 2 and 5). However, according to the D2 system, subjects with positive tear MMP-9 had lower tear secretion and higher Tosm in both groups and had a shorter BUT in the Non-SS DED group compared to subjects with negative tear MMP-9 (Table 3). According to the D3 system, subjects with positive tear MMP-9 in the SS DED group had higher tear osmolarity than those with negative tear MMP-9 (P = 0.020, Table 4).
In addition, we verified the relationship between MMP-9 expression grades in tears according to the 5-scale grading system and each ocular surface index of DED. Only Tosm showed a significant correlation with the grades of tear MMP-9 in both groups (Non-SS DED group: r = 0.139 and P = 0.041; SS DED group: r = 0.297 and P = 0.027, Table 6).
ROC curve analysis for the positive tear MMP-9 by D2 system
Using the D2 system, we stratified the most ocular surface indices according to the positivity of tear MMP-9 (Table 3). We then performed ROC curve analysis of positive tear MMP-9 by D2 system with Tosm, tear secretion, and/or tear BUT in both groups. The ROC curves showed that Tosm best distinguished patients with positive MMP-9 by D2 system from those with negative MMP-9 in both groups (AUC = 0.599 in the Non-SS DED group and AUC = 0.657 in the SS DED group, Table 7 and Fig. 1). A Schirmer I value of 10.5 mm and a tear BUT value of 5.5 s also stratified patients by the predictability of positive tear MMP-9 by D2 system (Table 7 and Fig. 1).
Receiver operating characteristic (ROC) curve analysis of tear osmolarity (Tosm), Schirmer I without anesthesia, and/or tear break-up time (BUT) in dry eye disease (DED) patients with and without primary Sjogren’s syndrome (pSS) and their association with positive tear matrix metalloproteinase (MMP)-9 by D2 dichotomous grading system.
Discussion
In this study, we compared the 5-scale grading system and the dichotomous grading system of the point-of-care immunoassay for tear MMP-9. Furthermore, we suggested the optimal dichotomous system and identified the relevant cut-off values of Tosm, tear wettability length by Schirmer I, and tear BUT to specify positive MMP-9 expression in tear samples. The grade 2 density by the 5-scale grading system distinguished the ocular surface indices the most. Therefore, we suggested using such a D2 dichotomous grading system as a useful method to reflect the desiccating stress and tear secretion in DED patients.
Previously, MMP-9 in tears has been suggested as a reliable indicator for inflammation in DED, using experimental methods such as MMP activity assay kits, real-time polymerase chain reaction for RNA level of expression, double sandwich enzyme-linked immunosorbent assay kits, and SDS-gelatin polyacrylamide gel electrophoresis9,17,18,19. Fortunately, InflammaDry was recently released to evaluate tear MMP-9 in clinical circumstances. It is easy to use and takes only a few minutes to get results. Like many other immunoassays, InflammaDry offers useful information on the current ocular surface inflammatory status and provides guidance on when to start anti-inflammatory treatment13,20. Because InflammaDry has high sensitivity and specificity and high agreement with other diagnostic tools for DED10,11,12,13, it is now accepted as one of the favorable test modalities for DED.
Although it is easy to identify the redline in the readout window of the kit, there is still a debate on which thickness is proper for the positive interpretation of the significant existence of MMP-9 in tear. In our recent study, the band density continued to increase up to a maximal concentration of 5000 ng/mL according to the calibration curve. The difference of grades reflected the change of MMP-9 concentrations sensitively, especially between grade 2 and 4 according to the 5-scale grading system14. Although the subjective 5-scale grading system in the point-of-care MMP-9 immunoassay is a reliable method with acceptable accuracy as such14, in this study, the gradient of 5-scale grades of tear MMP-9 did not reflect the gradients of well-established ocular surface indices in both groups, except tear osmolarity (Table 6). On the other hand, the D2 dichotomous system of tear MMP-9 stratified tear secretion as well as Tosm in both groups. Tear BUT was significantly different between negative and positive MMP-9 by D2 system in the SS DED group. This was a different result compared to the results according to D1, D3, D4 systems. Although we proposed the cut-off values of Tosm to predict positive MMP-9 by D2 system in the Non-SS DED group with high specificity, the sensitivity was very low, and the cut-off value of 340.5 mOsm/L seems too high to offer helpful clinical guidance to evaluate DED. Moreover, the significant AUC values for the stratification of ocular surface indices were quite low with unfavorable validity values. We suggest that it might be because DED is a multifactorial disease, and the alteration of various parameters may follow one after another.
Nevertheless, this study is significant as it identified the D2 system as the most reliable grading system of InflammaDry, reflecting changes in Tosm and tear secretion more accurately than diverse ocular surface indices used to evaluate the severity of DED. The D2 system may be advantageous as it only requires one standard photograph to distinguish positive results. Although it is unclear why the D2 system discriminated only a few indices, it is established that high tear osmolarity caused by reduced tear production from the lacrimal gland or excessive evaporation on the ocular surface initiates inflammatory cascades21.
The manufacturer defines a positive MMP-9 result as ≥ 40 ng/mL, even if the test strip's red line is faint, incomplete, or uneven. However, a positive result does not always indicate altered DED clinical parameters. In this study, we propose a modified positive cut-off value of MMP-9 for the D2 system based on tear secretion and instability. Although we do not indicate the actual cut-off value of MMP-9 concentration in the D2 system, our previous study showed that the positive cut-off range for recombinant human pro-MMP-9 concentration in the D2 system relevant to grade 2 on a 5-scale grading system was 100 to 2500 ng/mL14. Thus, we suggest that clinical parameter changes for DED occur at MMP-9 concentrations much higher than 40 ng/mL.
In conclusion, we compared the grading system with different cut-off values of InflammaDry and identified that the positive tear MMP-9 by the D2 dichotomous grading system of InflammaDry reflected the hyperosmolar and desiccating stress on the ocular surface. As the InflammaDry test is semi-quantitative, the dichotomous grading rather than the 5-scale grading reflects the ocular surface indices more accurately and may be more practical in real clinical circumstances.
Methods
This was a retrospective cross-sectional study that aimed to correlate various tear MMP-9 grading systems with clinical ocular surface parameters in subjects with DED. The study was approved by the Chung-Ang University Hospital Institutional Review Board (IRB) and the informed consent was waived by an IRB (Approval No.: 2004-003-19308). It properly followed the tenets of the Declaration of Helsinki.
Study design
Our study design was outlined as follows:
-
1.
Collect objective dry eye parameters in DED patients, both with and without primary Sjogren's syndrome.
-
2.
Grade the results of tear MMP-9 in InflammaDry using a 5-scale grading system and a dichotomous grading system (D1 to D4).
-
3.
Analyze the differences in collected objective dry eye parameters (1) based on the tear MMP-9 grades (2).
-
4.
Identify cut-off values of objective dry eye parameters that reflect the positivity of tear MMP-9 in InflammaDry.
Subjects
We included the medical records of 237 patients (464 eyes) who visited the Department of Ophthalmology at Chung-Ang University Hospital between March 2019 and January 2020 and were diagnosed with DED based on the TFOS DEWS II diagnostic criteria22. PSS was diagnosed according to the 2016 American College of Rheumatology (ACR)/European League Against Rheumatism (EULAR) classification criteria23. The subjects were divided into two groups: non-SS DED group and SS DED group.
DED parameters
As part of our assessment of DED parameters, we evaluated corneal sensitivity scores using the Cochet-Bonnet esthesiometer, Tosm, tear MMP-9 levels, tear secretion with Schirmer I without anesthesia, tear BUT, SICCA OSS, corneal erosion scores according to the National Eye Institute/Industry (NEI) grading scale, meibomian gland (MG) expressibility, and meibum quality of the secreted meibum. Additionally, we used the OSDI questionnaire to assess the subjective ocular symptoms of dry eye disease and its effect on vision-related function24.
Corneal sensitivity was assessed using a Cochet-Bonnet esthesiometer (Luneau Ophthalmology, Chartres Cedex, France). Starting at the longest length of 6 cm, the test involved gradually decreasing the length of the monofilament that touched the center of the cornea by 0.5 cm until the patient felt discomfort. Tosm was measured using an I-PEN (I-MED Pharma Inc., Montreal, QC, Canada) that was soaked with tear at the lower conjunctival fornix and then assembled into an analyzer that displayed test results in digits. Tear secretion was evaluated using the Schirmer I test, which involved placing a Schirmer standard strip (Eagle Vision, Memphis, TN, USA) on the outer 1/3 point of the lower conjunctival fornix and allowing tear fluid to be absorbed for 5 min, without using any analgesic eyedrops. The tear BUT was measured more than 15 min after the Schirmer I test, following established procedures25. A drop of normal saline was placed on a strip paper coated with fluorescein dye (Haag-Streit International, Koniz, Switzerland), which was then shaken off. The strip was gently applied to the lower lid margin to stain the tear film, and the time when the first tear film break was observed under a cobalt blue filter after the last blink was considered the BUT. The measurement was repeated three times using a stopwatch, and the average value was used.
The ocular staining score was evaluated by examining each eye with a slit-lamp under a yellow filter after fluorescein instillation26. The SICCA score27 and NEI score28 were obtained using established standards. Evaluation for MGD was performed in two ways: assessing MG expressibility of five glands in the central upper lid and the quality of secreted meibum. The MG expressibility of meibum from five glands was graded from 0 to 3, with 0 indicating all glands expressible, 1 indicating 3–4 glands expressible, 2 indicating 1–2 glands expressible, and 3 indicating no glands expressible. The quality of meibum was also graded from 0 to 3, with each score corresponding to clear, cloudy, cloudy particulate fluid, and toothpaste-like consistency according to previously established benchmarks29.
All DED clinical parameters were measured and evaluated consistently by a single experienced researcher (K.W.K).
InflammaDry assay for tear MMP-9 and its grading systems
The tear MMP-9 test was performed using InflammaDry, following the instructions provided in the product documentation10. A sterile sample collector was used to dab multiple areas along the lower palpebral conjunctiva to collect tear fluid, which was then assembled into the immunoassay test cassette. After 20 s of activation in buffer solution, the intensity of the red line in a readout window was verified.
To determine the diagnostic value of the MMP-9 assay, we analyzed it using both a 5-scale grading method and a dichotomous grading method. The 5-scale grading system involved grading the depth of the red readout band of the MMP-9 on-site inspection, with grade 0 indicating a negative result, grade 1 indicating a trace result, grade 2 indicating a weak positive result, grade 3 indicating a positive result, and grade 4 indicating a strong positive result, based on previously established standard photographs (Fig. 2A)14. To eliminate possible interobserver variation, the 5-scale grading was performed by a single experienced researcher (K.W.K).
Standard photographs for tear matrix metalloproteinase (MMP)-9 expression, graded using a 5-scale grading and a dichotomous grading system (D1 to D4). (A) The 5-point scale ranges from 0 to 4 and is represented by the color density of the red line in the readout window of the point-of-care MMP-9 immunoassay. (B) The dichotomous grading system defines positive results as grades 1, 2, 3, and 4 of the 5-point scale (D1, D2, D3, and D4, respectively).
The dichotomous grading systems included D1, D2, D3, and D4, with the cut-off grade for a positive result being grade 1, 2, 3, and 4 by the 5-scale grading system, respectively (Fig. 2B).
Statistical analysis
The data are presented as mean ± standard deviation. Statistical analysis was performed using GraphPad Prism v.8.1.2 (GraphPad Software, La Jolla, CA, USA). To compare variables between groups, either parametric Student’s t-test or non-parametric Mann–Whitney U test and Chi-square test were used. Pearson’s correlation test was used to analyze the correlation of 5-scale grades with age and ocular surface indices. Receiver operating characteristic (ROC) curve analysis was applied, and the area under the ROC curve (AUC) was calculated. A p-value less than 0.05 was considered statistically significant.
Data availability
The datasets generated and analyzed in the current study are available from the corresponding author on reasonable request.
References
Bron, A. J. et al. TFOS DEWS II pathophysiology report. Ocul. Surf. 15, 438–510 (2017).
Shetty, R. et al. Elevated expression of matrix metalloproteinase-9 and inflammatory cytokines in keratoconus patients is inhibited by cyclosporine A. Invest. Ophthalmol. Vis. Sci. 56, 738–750 (2015).
Aragona, P. et al. Matrix metalloproteinase 9 and transglutaminase 2 expression at the ocular surface in patients with different forms of dry eye disease. Ophthalmology 122, 62–71 (2015).
Sakimoto, T., Ohnishi, T. & Ishimori, A. Simultaneous study of matrix metalloproteinases, proinflammatory cytokines, and soluble cytokine receptors in the tears of noninfectious corneal ulcer patients. Graefes Arch. Clin. Exp. Ophthalmol. 252, 1451–1456 (2014).
Horwitz, V. et al. The beneficial effects of doxycycline, an inhibitor of matrix metalloproteinases, on sulfur mustard-induced ocular pathologies depend on the injury stage. Curr. Eye. Res. 39, 803–812 (2014).
Acera, A., Vecino, E. & Duran, J. A. Tear MMP-9 levels as a marker of ocular surface inflammation in conjunctivochalasis. Invest. Ophthalmol. Vis. Sci. 54, 8285–8291 (2013).
Petznick, A., Madigan, M. C., Garrett, Q., Sweeney, D. F. & Evans, M. D. Contributions of ocular surface components to matrix-metalloproteinases (MMP)-2 and MMP-9 in feline tears following corneal epithelial wounding. PLoS ONE 8, e71948 (2013).
Iovieno, A. et al. In vivo characterization of doxycycline effects on tear metalloproteinases in patients with chronic blepharitis. Eur. J. Ophthalmol. 19, 708–716 (2009).
Chotikavanich, S. et al. Production and activity of matrix metalloproteinase-9 on the ocular surface increase in dysfunctional tear syndrome. Invest. Ophthalmol. Vis. Sci. 50, 3203–3209 (2009).
Sambursky, R. et al. Sensitivity and specificity of a point-of-care matrix metalloproteinase 9 immunoassay for diagnosing inflammation related to dry eye. JAMA Ophthalmol. 131, 24–28 (2013).
Sambursky, R., Davitt, W. F. 3rd., Friedberg, M. & Tauber, S. Prospective, multicenter, clinical evaluation of point-of-care matrix metalloproteinase-9 test for confirming dry eye disease. Cornea 33, 812–818 (2014).
Park, J. Y., Kim, B. G., Kim, J. S. & Hwang, J. H. Matrix metalloproteinase 9 point-of-care immunoassay result predicts response to topical cyclosporine treatment in dry eye disease. Transl. Vis. Sci. Technol. 7, 31 (2018).
Messmer, E. M., von Lindenfels, V., Garbe, A. & Kampik, A. Matrix metalloproteinase 9 testing in dry eye disease using a commercially available point-of-care immunoassay. Ophthalmology 123, 2300–2308 (2016).
Kim, M. et al. Assessment of reliability and validity of the 5-scale grading system of the point-of-care immunoassay for tear matrix metalloproteinase-9. Sci. Rep. 11, 12394 (2021).
Ryu, K. J., Kim, S., Kim, M. K., Paik, H. J. & Kim, D. H. Short-term therapeutic effects of topical corticosteroids on refractory dry eye disease: clinical usefulness of matrix metalloproteinase 9 testing as a response prediction marker. Clin. Ophthalmol. 15, 759–767 (2021).
Jun, J. H., Lee, Y. H., Son, M. J. & Kim, H. Importance of tear volume for positivity of tear matrix metalloproteinase-9 immunoassay. PLoS ONE 15, e0235408 (2020).
Pflugfelder, S. C. et al. Matrix metalloproteinase-9 knockout confers resistance to corneal epithelial barrier disruption in experimental dry eye. Am. J. Pathol. 166, 61–71 (2005).
De Paiva, C. S. et al. Corticosteroid and doxycycline suppress MMP-9 and inflammatory cytokine expression, MAPK activation in the corneal epithelium in experimental dry eye. Exp. Eye. Res. 83, 526–535 (2006).
Acera, A., Rocha, G., Vecino, E., Lema, I. & Duran, J. A. Inflammatory markers in the tears of patients with ocular surface disease. Ophthalmic. Res. 40, 315–321 (2008).
Soifer, M., Mousa, H. M., Stinnett, S. S., Galor, A. & Perez, V. L. Matrix metalloproteinase 9 positivity predicts long term decreased tear production. Ocul. Surf. 19, 270–274 (2021).
Li, D. Q. et al. Regulation of MMP-9 production by human corneal epithelial cells. Exp. Eye Res. 73, 449–459 (2001).
Craig, J. P. et al. TFOS DEWS II definition and classification report. Ocul. Surf. 15, 276–283 (2017).
Le Goff, M. et al. Comparison of 2002 AECG and 2016 ACR/EULAR classification criteria and added value of salivary gland ultrasonography in a patient cohort with suspected primary Sjogren’s syndrome. Arthritis Res. Ther. 19, 269 (2017).
Miller, K. L. et al. Minimal clinically important difference for the ocular surface disease index. Arch. Ophthalmol. 128, 94–101 (2010).
Yokoi, N. et al. Classification of fluorescein breakup patterns: A novel method of differential diagnosis for dry eye. Am. J. Ophthalmol. 180, 72–85 (2017).
Eom, Y., Lee, J. S., KeunLee, H., MyungKim, H. & SukSong, J. Comparison of conjunctival staining between lissamine green and yellow filtered fluorescein sodium. Can. J. Ophthalmol. 50, 273–277 (2015).
Whitcher, J. P. et al. A simplified quantitative method for assessing keratoconjunctivitis sicca from the Sjögren’s Syndrome International Registry. Am. J. Ophthalmol. 149, 405–415 (2010).
Lemp, M. A. Report of the national eye institute/industry workshop on clinical trials in dry eyes. CLAO J. 21, 221–232 (1995).
Tomlinson, A. et al. The international workshop on meibomian gland dysfunction: Report of the diagnosis subcommittee. Invest. Ophthalmol. Vis. Sci. 52, 2006–2049 (2011).
Funding
This research was supported by the Chung-Ang University Research Grants in 2022 and by a fund from the research program of the Korea Medical Institute in 2022.
Author information
Authors and Affiliations
Contributions
K.W.K designed the study. J.Y.O and K.W.K. analyzed the data and wrote the manuscript. Y.S.C. and K.W.K. revised the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Oh, J.Y., Chun, Y.S. & Kim, K.W. Dichotomous versus 5-scale grading system for the interpretation of the point-of-care immunoassay for tear matrix metalloproteinase-9 in dry eye. Sci Rep 13, 6085 (2023). https://doi.org/10.1038/s41598-023-32928-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-32928-3
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
