To evaluate the Dutch-English Lambert-Eaton Myasthenic Syndrome (LEMS) Tumour Association Prediction (DELTA-P) score in a prospective cohort of patients with newly diagnosed LEMS to assess the clinical validity of this tool in a real-world setting. Clinical features from 87 patients with LEMS, occurring within three months from disease onset, were collated to produce a DELTA-P score for each patient. Lung cancer was detected in 44/87 (51%) LEMS patients. Weight loss ≥ 5%, tobacco use at LEMS onset and age at onset ≥ 50 years were independent predictors for the development of small-cell lung cancer (SCLC) in LEMS patients in multivariable analysis. Median DELTA-P scores were significantly higher in SCLC-LEMS patients (3.5, 95% CI 3 to 4) compared to non-tumour-LEMS (2, 95% CI 1 to 2) (P < 0.0001). Higher DELTA-P scores increased the risk of SCLC stepwise (score 0 = 0%, 1 = 18.8%, 2 = 45%, 3 = 55.5%, 4 = 85.7%, 5 = 87.5%, 6 = 100%). The area under the curve of the receiver operating curve was 82.5% (95% CI 73.9% to 91%). The DELTA-P cancer prediction score, calculated at the time of LEMS diagnosis, is an effective tool for cancer screening in an independent, prospective study setting.
Lambert-Eaton myasthenic syndrome (LEMS) is a presynaptic autoimmune disorder of neuromuscular transmission characterised by proximal muscle weakness and autonomic disturbance1. Antibodies to P/Q-type voltage-gated calcium channels (VGCCs) can be detected in over 90% of patients and are responsible for reduction in nerve-evoked release of neurotransmitter at the neuromuscular junction2,3. Approximately 60% of LEMS patients have an associated small-cell lung cancer (SCLC), and it is thought that autoantibodies, directed against VGCCs expressed on the tumour surface4, cross-react with VGCCs on the presynaptic terminals causing the neurological dysfunction observed. The immune trigger for VGCC antibody production in non-tumour LEMS (NT-LEMS) is unknown.
SCLC is associated with significant morbidity and mortality5, and early diagnosis of these lung tumours, in limited stage, is associated with improved cancer survival6. Therefore, prompt and intensive screening for SCLC is mandatory in a patient presenting with LEMS7. Using this screening protocol, SCLC is detected within 12 months of LEMS diagnosis in over 95% of patients7.
We have previously developed and validated a cancer prediction clinical scoring system in Dutch and UK cohorts of LEMS patients from retrospectively collected data (Dutch-English LEMS Tumour Association Prediction, or DELTA-P, score), which discriminated highly between SCLC-LEMS and NT-LEMS, applicable at the time of LEMS diagnosis8. The objective of this current study was to evaluate the DELTA-P score for cancer prediction in a new, prospective cohort of patients with newly diagnosed LEMS to assess the clinical validity of this tool in a real-world setting.
Clinical and demographic details of the 87 prospectively enrolled LEMS patients are shown in Table 1. Forty-three patients (49.4%) had SCLC, and one additional patient (classified in analyses as SCLC-LEMS) had PET/CT evidence of lung cancer in the absence of histological confirmation. Median duration of follow-up in the remaining 43 patients with NT-LEMS was 59 months (range 36 to 100 months). All patients had a pure LEMS phenotype except for two SCLC-LEMS patients who also developed ataxia. The median time between LEMS diagnosis and SCLC confirmation was 0.5 months: the tumour was diagnosed within six months in 91% and within 12 months in 98% of SCLC-LEMS patients. Four SCLC-LEMS patients whose lung tumours were diagnosed more than six months after their LEMS had DELTA-P scores of 1, 2, 4 and 5.
Univariable analysis revealed significant differences between SCLC-LEMS and NT-LEMS for: bulbar symptoms, weight loss ≥ 5% (within 3 months of LEMS onset), tobacco use at LEMS onset, age at onset ≥ 50 years and Karnofsky performance score (Table 1). Weight loss ≥ 5%, tobacco use at LEMS onset and age at onset ≥ 50 years remained significant in multivariable analysis (Table 2).
Median DELTA-P scores were higher in SCLC-LEMS patients (3.5) compared to NT-LEMS (2) (P < 0.0001). From all 87 patients, a DELTA-P score of 0 or 1 was associated with a null or low risk of developing SCLC (0% and 18.8% respectively); higher DELTA-P scores increased the risk of SCLC stepwise (score 2 = 45%, 3 = 55.5%, 4 = 85.7%, 5 = 87.5%, 6 = 100%)(Fig. 1). The AUC of the ROC curve was 82.5% (95% CI 73.9% to 91%) (Supplementary Fig. 1), with higher AUC values in males (85.3%, 95% CI 71.6% to 98.9%) compared to females (82.01%, 95% CI 70.9% to 93.1%) (P = 0.71). AUC for patients in the Dutch cohort (89.7%, 95% CI 78.6% to 100%) (12/29, 41.4% male; 17/29, 58.6% SCLC) was slightly higher than in the UK cohort (81.1%, 95% CI 70.2% to 92.1%)(21/58, 36.2% male; 27/58, 46.6% SCLC) (P = 0.28). Outcome scores from the second item, “male erectile dysfunction”, showed that this factor was the poorest predictor of SCLC when compared to other components of the DELTA-P score (P = 0.009, Table 3). Eliminating item two to create a 5-point DLTA-P score improved the AUC to 84.5% (95% CI 76.4% to 92.6%) (risk of SCLC: score 0 = 0%, 1 = 18.3%, 2 = 55.6%, 3 = 64.7%, 4 = 81.25%, 5 = 100%), although this was not significantly different from the 6-point DELTA-P score (P = 0.51).
We have previously developed a highly effective clinical scoring system (DELTA-P) for predicting SCLC development in patients with newly diagnosed LEMS8, given that approximately half of all patients with LEMS develop this type of lung cancer. As both the derivation and validation cohorts used to derive the DELTA-P score were analysed retrospectively, we aimed to assess the performance of this score in a new, prospective cohort of LEMS patients.
We found that the DELTA-P score was a very effective tool in predicting SCLC in this new cohort as well, although the score dichotomised less effectively than in the initial study, with poorer discrimination between SCLC-LEMS and NT-LEMS especially in patients with mid-range scores of 2 (45% vs 27% risk) and 3 (55.5% vs 83.9% risk). We found fewer patients with a low risk of SCLC, scoring 0 or 1, compared to the initial DELTA-P study (18.8% vs 35%), but similar numbers of patients at high risk of SCLC, scoring 3, 4, 5 or 6 (53.3% vs 51%). In practice, from our prospective data, this would mean fewer low-risk patients would benefit from a short, two-stage 6 month cancer screening protocol, but similar numbers of high risk patients would require early, intensive screening7,8. Of note, almost all SCLC cases were detected using previously published screening guidelines. Three patients with SCLC-LEMS had a DELTA-P score of less than 2. One patient with a DELTA-P score of 1 was diagnosed with SCLC 25 months after LEMS diagnosis highlighting the importance of continued, close clinical vigilance for symptoms and signs of lung cancer even beyond the scheduled tumour screening regimen7,8. Although unconfirmed in LEMS, spontaneous tumour regression has been reported in patients with SCLC and Hu-antibody-associated paraneoplastic sensory neuronopathy9,10, which could account for delayed tumour detection in other paraneoplastic neurological presentations, perhaps due to an anti-tumour immune response.
It is not unexpected that prognostic scoring systems work less well in subsequent prospective cohorts (real life practice) than in the original datasets11,12: derivation cohort analyses that are data-dependent rather than pre-specified give optimistic assessments of future predictive performance in new datasets, and variations in case-mix between study centres can affect score performance, as we found between our NL and UK cohorts.
Differences in the demographic and clinical features (case-mix) of the new cohort compared to the datasets used to define the DELTA-P score may have affected the score’s performance: this new cohort were older (median age 62 years vs 56.8 years, P = 0.011), with more female SCLC patients (64% vs 32.8%, P = 0.002), and a lower frequency of male sexual impotence in SCLC-LEMS patients (20% vs 44%, P < 0.001), although the frequency of cancer occurrence was very similar (51% vs 54.2%)8. Nevertheless, the clinical validity of the prognostic DELTA-P score was maintained by studying a similar-sized, relatively large, dataset with a high percentage of outcomes (occurrence of SCLC) per scoring item13. The new assessment of DELTA-P performance also benefitted from external validation, where the UK LEMS cohort was assessed by a new assessor (PM) in a new location (Nottingham) compared to the original study.
We found that the performance of the DELTA-P scoring parameter “E”, erectile dysfunction (males), was significantly poorer than the other items, such that removal of this from the DELTA-P score to generate a 5-item classification improved the ROC AUC, albeit non-significantly. In our experience, determining the time of onset of this clinical parameter was difficult, particularly in a cohort where most male patients were aged > 60 years. This would be particularly relevant for patients with co-morbid illness affecting erectile function. Thus, at LEMS diagnosis, if precise data for erectile dysfunction are not available, the prediction of SCLC from a 5-point score would still be accurate.
Using clinically validated data from a large prospective cohort, we have confirmed that the use of the DELTA-P scoring system at LEMS diagnosis is a robust measure of the risk of developing SCLC. However, as a small minority of SCLC-LEMS patients have DELTA-P scores of less than two, the clinical score cannot be used in isolation, and consideration must be made for cancer screening beyond 6 months in patients with low scores (e.g. DELTA-P of 1), particularly for those with co-morbid illness (affecting erectile function) who have previously been smokers. Confirmation of the validity of the DELTA-P scoring system by other international investigators would be of great clinical value.
Between 2011 and 2017, 87 patients with LEMS were recruited prospectively at the time of neurological diagnosis across two centres in Leiden, Netherlands and Nottingham, UK. All patients were examined by two of the authors (AL, PM). The diagnosis of LEMS was based on characteristic clinical features of proximal limb weakness, attenuated tendon reflexes and autonomic dysfunction, and also either typical neurophysiological findings (low resting compound muscle action potential amplitude in hand muscles, with incremental responses of over 60% after maximal voluntary contraction) or positive P/Q-type voltage gated calcium channel antibodies1,14,15,16. Tumour surveillance with PET/CT imaging was performed as per published guidelines7. Briefly, all patients underwent integrated PET/CT imaging at the time of LEMS diagnosis; repeated after three months, then every six months for two years in patients with DELTA-P scores of 3–6; or repeated once after six months in patients with DELTA-P scores of 0–1; or repeated every six months for two years in patients with a DELTA-P score of 2. Beyond this, high clinical vigilance was maintained for symptoms or signs suggestive of SCLC during further clinic visits. All patients with SCLC-LEMS had histological or cytological evidence of SCLC, except one patient without biopsy-proven SCLC whose PET/CT imaging was typical of lung cancer. The remaining patients were classified as NT-LEMS if cancer screening had failed to demonstrate malignancy after three years or more follow-up. Patients without detectable cancer, but follow-up of less than three years were excluded. Demographic details, clinical features and symptoms occurring within three months from disease onset were collated to produce a DELTA-P score for each patient8. Written, informed consent was obtained from all patients (Nottingham Research Ethics Committee 04/Q2404/100 and Medical Ethics Committee of the Leiden University Medical Center P13.106). All methods were carried out in accordance with relevant guidelines and regulations and all experimental protocols were approved by an institutional committee (Oxford University, UK, and Leiden University, NL).
Autoantibodies to P/Q-type VGCCs were measured in all patients by either immunoprecipitation of VGCCs extracted from rabbit cerebellum and labelled with 125I-ω-CmTx MVIIC as previously described3, or by a radioimmunoassay kit using the same assay principle (from either RSR Ltd., Cardiff, UK, or DLD, Hamburg, Germany) for all Dutch patients. All samples were taken at the time of initial LEMS diagnosis.
Group comparisons were analysed using Fisher’s exact test for frequency distribution, and Mann–Whitney U test for median numerical values. The ability of the DELTA-P score to discriminate between SCLC-LEMS and NT-LEMS was quantified using the area under the curve (AUC) of the receiver operating characteristic (ROC). Area under ROC curve comparisons were made using between-area correlations17,18. The covariates for multivariable analysis were selected based on the six individual items of the original DELTA-P score8. The probability of developing SCLC for each calculated DELTA-P score was calculated by dividing the number of SCLC-LEMS patients by the total number of LEMS patients with that score (Fig. 1). For individual item performance (Table 3), in each LEMS patient, a correct score of 0 (for each of the six items of the DELTA-P score, in turn) meant the patient had no SCLC; a correct score of 1 meant the patient had SCLC; an incorrect score of 0 meant the patient had SCLC; an incorrect score of 1 meant the patient had no SCLC.
The authors are happy to make materials, data and associated protocols promptly available to readers without undue qualifications in material transfer agreements.
O’Neill, J. H., Murray, N. M. & Newsom-Davis, J. The Lambert-Eaton myasthenic syndrome. A review of 50 cases. Brain 111, 577–596 (1988).
Lang, B., Newsom-Davis, J., Peers, C., Prior, C. & Wray, D. W. The effect of myasthenic syndrome antibody on presynaptic calcium channels in the mouse. J. Physiol. 390, 257–270 (1987).
Motomura, M. et al. Incidence of serum anti-P/O-type and anti-N-type calcium channel autoantibodies in the Lambert-Eaton myasthenic syndrome. J. Neurol. Sci. 147, 35–42 (1997).
Benatar, M. et al. Presynaptic neuronal antigens expressed by a small cell lung carcinoma cell line. J. Neuroimmunol. 113, 153–162 (2001).
Khakwani, A. et al. Small-cell lung cancer in England: trends in survival and chemotherapy using the National Lung Cancer Audit. PLoS ONE 9, e89426 (2014).
van Meerbeeck, J. P., Fennell, D. A. & De Ruysscher, D. K. Small-cell lung cancer. Lancet 378, 1741–1755 (2011).
Titulaer, M. J. et al. Screening for small-cell lung cancer: a follow-up study of patients with Lambert-Eaton myasthenic syndrome. J. Clin. Oncol. 26, 4276–4281 (2008).
Titulaer, M. J. et al. Clinical Dutch-English Lambert-Eaton Myasthenic syndrome (LEMS) tumor association prediction score accurately predicts small-cell lung cancer in the LEMS. J. Clin. Oncol. 29, 902–908 (2011).
Gill, S., Murray, N., Dalmau, J. & Thiessen, B. Paraneoplastic sensory neuronopathy and spontaneous regression of small cell lung cancer. Can. J. Neurol. Sci. 30, 269–271 (2003).
Mawhinney, E., Gray, O. M., McVerry, F. & McDonnell, G. V. Paraneoplastic sensorimotor neuropathy associated with regression of small cell lung carcinoma. BMJ Case Rep https://doi.org/10.1136/bcr.01.2009.1486 (2010).
Altman, D. G. & Royston, P. What do we mean by validating a prognostic model?. Stat. Med. 19, 453–473 (2000).
Yan, A. T. et al. Clinical trial–derived risk model may not generalize to real-world patients with acute coronary syndrome. Am. Heart J. 148, 1020–1027 (2004).
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B. & Rosati, R. A. Regression modelling strategies for improved prognostic modelling. Stat. Med. 3, 143–152 (1984).
Titulaer, M. J., Lang, B. & Verschuuren, J. J. Lambert-Eaton myasthenic syndrome: from clinical characteristics to therapeutic strategies. Lancet Neurol. 10, 1098–1107 (2011).
Oh, S. J., Kurokawa, K., Claussen, G. C. & Ryan, H. F. Jr. Electrophysiological diagnostic criteria of Lambert-Eaton myasthenic syndrome. Muscle Nerve 32, 515–520 (2005).
Chiou-Tan, F. Y. & Gilchrist, J. M. Repetitive nerve stimulation and single-fiber electromyography in the evaluation of patients with suspected myasthenia gravis or Lambert-Eaton myasthenic syndrome: Review of recent literature. Muscle Nerve 52, 455–462 (2015).
Hanley, J. A. & McNeil, B. J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148, 839–843 (1983).
McNeil, B. J. & Hanley, J. A. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med. Decis. Making 4, 137–150 (1984).
The study was funded by Myaware, UK, through Clinical Research Fellowships to PG, GS and PAA.
The authors Maddison, Lipka, Gozzard, Sadalage and Ambrose declare no competing interests. Dr Lang is a co-applicant and receives royalties on patent application WO/2010/046716 entitled 'Neurological Autoimmune Disorders'. The patent has been licensed to Euroimmun AG for the development of assays for LGI1 and other VGKC-complex antibodies.Professor Verschuuren reports involvement in a National Institutes of Health-sponsored thymectomy trial (ClinicalTrials.gov, number NCT00294658), reports a FP7 European MG grant (602420); and is a consultant for Alexion Pharmaceuticals and arGEN-X.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Maddison, P., Lipka, A.F., Gozzard, P. et al. Lung cancer prediction in Lambert-Eaton myasthenic syndrome in a prospective cohort. Sci Rep 10, 10546 (2020). https://doi.org/10.1038/s41598-020-67571-9