Skip to main content
Download PDF

Predicting mortality in adult patients with sepsis in the emergency department by using combinations of biomarkers and clinical scoring systems: a systematic review

BMC Emergency Medicine volume 21, Article number: 70 (2021) Cite this article

Abstract

Background

Sepsis can be detected in an early stage in the emergency department (ED) by biomarkers and clinical scoring systems. A combination of multiple biomarkers or biomarker with clinical scoring system might result in a higher predictive value on mortality. The goal of this systematic review is to evaluate the available literature on combinations of biomarkers and clinical scoring systems on 1-month mortality in patients with sepsis in the ED.

Methods

We performed a systematic search using MEDLINE, EMBASE and Google Scholar. Articles were included if they evaluated at least one biomarker combined with another biomarker or clinical scoring system and reported the prognostic accuracy on 28 or 30 day mortality by area under the curve (AUC) in patients with sepsis. We did not define biomarker cut-off values in advance.

Results

We included 18 articles in which a total of 35 combinations of biomarkers and clinical scoring systems were studied, of which 33 unique combinations. In total, seven different clinical scoring systems and 21 different biomarkers were investigated. The combination of procalcitonin (PCT), lactate, interleukin-6 (IL-6) and Simplified Acute Physiology Score-2 (SAPS-2) resulted in the highest AUC on 1-month mortality.

Conclusion

The studies we found in this systematic review were too heterogeneous to conclude that a certain combination it should be used in the ED to predict 1-month mortality in patients with sepsis. Future studies should focus on clinical scoring systems which require a limited amount of clinical parameters, such as the qSOFA score in combination with a biomarker that is already routinely available in the ED.

Peer Review reports

Background

Sepsis is a life threatening condition, and is the leading cause of in-hospital mortality in Europe [1]. Early detection of sepsis is essential to timely start appropriate treatment [2, 3]. Early stage sepsis, in patients with a suspected infection, is often undiagnosed, causing a delay in treatment and increased mortality [4, 5]. The emergency department (ED) is often the first setting during hospital stay where patients with a suspected infection are systematically evaluated, where early stages of sepsis can be detected. However, there is a limited timeframe in the ED in which decisions about treatment and patient disposition must be made. Identifying patients in the ED with a high risk of mortality is important, not only to start antibiotic treatment early, but also to decide if patients require admission, high level care and monitoring.

Multiple organ systems and pathways are involved in the pathophysiology of sepsis [6]. After a microorganism infects the body, multiple immune responses are activated [7]. Different immune cells are activated, which express a series of membrane receptors, endothelial and tissue factors are released, and the complement system is activated [8]. In sepsis, this immune response is dysregulated and excessive, ultimately resulting in multi-organ failure [9]. This response involves dysregulation by both hyperinflammation and immune suppression [10, 11]. In these different stages of sepsis, different cytokines, peptides and other signaling molecules are elevated and can be detected in the bloodstream as biomarkers.

Clinical scoring systems, which are often used to detect sepsis, rely on vital parameters. Clinical scoring systems should require only a limited amount of clinical parameters to be useful in the ED to rapidly assess the severity of disease. Different clinical scoring systems have been validated for use in the ED, including the Quick Sequential Organ Failure Assessment (qSOFA) [9], the Mortality in Emergency Department Sepsis (MEDS) [12] score and National Early Warning Score (NEWS) [13]. (Supplemental Table 1) These clinical scoring systems mostly rely on the use of abnormal vital parameters. However, when vital parameters are abnormal, the patient might already be in an advanced stage of sepsis. Using biomarkers to detect sepsis, early stages of sepsis could be detected before vital signs turn abnormal. Adding biomarkers to clinical scoring systems might therefore improve these clinical scoring systems. A large variety of biomarkers in patients with sepsis have been studied. Pierrakos et al. reviewed the literature on biomarkers in sepsis in 2010 and in 2020 and found that there are over 100 different biomarkers studied, of which none have made it to clinical practice except C-reactive protein (CRP) and procalcitonin (PCT) [14, 15]. Even 10 years after their initial study, no specific other biomarker was identified as “most promising” biomarker [15]. The authors concluded that a combination of several biomarkers may be more effective. Several studies support this claim and show that combining biomarkers with clinical scoring systems or combining multiple biomarkers result in a more accurate prediction of mortality in patients with infectious diseases in the ED. [16, 17]

With the large number of biomarkers already studied, the potential number of combinations of biomarkers and clinical scoring systems is even greater.

The goal of this review is to systematically assess the available literature on combinations of biomarkers and clinical scorings systems in patients with sepsis in the ED to predict 1-month mortality.

Methods

We conducted this systematic review and reported this following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines [18]. The study was registered on PROSPERO, the register for systematic reviews under reference number 165580.

Literature search

We performed a systematic search of literature by an information specialist using MEDLINE, EMBASE and Google Scholar. The search included articles in English published up to June 2020. We started with a broad search using both infectious diseases and sepsis in the initial search in combination with biomarkers and ED. The full search strategy can be found in the Appendix.

Outcome definitions

Biomarkers were considered as any laboratory blood test performed in the ED. A clinical scoring system was defined as any scoring system using a combination of patient characteristic with or without laboratory testing used for prognostic purpose. We did not use a single definition of sepsis in this review. Sepsis criteria changed multiple times in the previous decades and we did not want to miss any potential useful article in our initial search strategy We used 1-month mortality as outcome, which was defined as either 28 or 30-day mortality.

Study selection

After the initial search, two reviewers independently screened the studies by title and abstract from each other. The results were compared and discrepancies were resolved by discussion. If no consensus was achieved, a third reviewer acted as referee. The remaining studies were screened on inclusion and exclusion criteria using the full text (Fig. 1).

Fig. 1
figure 1

Flow chart of included articles

Full size image

Selection criteria

During title and abstract screening, articles were included if they evaluated at least one biomarker or clinical scoring system in any infectious disease. During full text screening, articles were included if they evaluated at least one biomarker combined with another biomarker or clinical scoring system and reported the prognostic accuracy on 28 or 30 day mortality by AUC in patients with sepsis. Other measurements of the studied prediction models were recorded, such as sensitivity, specificity and Hosmer-Lemeshow test statistic, if they were reported by the authors. However, articles were not excluded if these values were missing.

Studies in children and studies of which the full text was not available in English were excluded.

Data collection and quality assessment

Data was extracted in a predefined spreadsheet, which included the biomarkers and clinical scoring system used, AUC of the combination of biomarkers and clinical scoring system, age, inclusion and exclusion criteria and moment of blood collection. The quality of each study was assessed using Prediction model Risk Of Bias ASsessment Tool (PROBAST) [19]. This risk of bias was assessed and reported during the PROBAST assessment.

Results

We found 5826 articles after conducting our search in PubMed, EMBASE, Medline Ovid, Web of Science, Cochrane Central and Google Scholar. After removal of duplicates, 3771 articles remained. These articles were screened on title and abstract, after which 83 articles were included for full text screening. After full text screening, 65 articles were excluded. This resulted in 18 articles included for final data synthesis. (Fig. 1).

In the 18 articles that were included in this systematic review, a total of 35 combinations of biomarkers and clinical scoring systems were studied of which 33 unique combinations. In total, seven different clinical scoring systems and 21 different biomarkers were investigated. (Table 1).

Table 1 Overview of included studies
Full size table

The Mortality in Emergency Department Sepsis (MEDS) score was the most used clinical scoring system, which was studied in 9 articles. The second most commonly used scoring system was the Acute Physiology and Chronic Health Evaluation II (APACHE II) score, which was studied in 6 articles. The most commonly studied biomarker was PCT, which was studied in 7 articles. The combination of PCT with the MEDS score was the most studied combination of biomarker and clinical score and was studied in 3 different articles. There were no other combinations of biomarkers that were used by more than a single article.

The number of patients included in the studies ranged from 114 to 1318. The AUC of the combinations of biomarkers and clinical scoring systems ranged from 0.637 to 0.939. The highest AUC was achieved by the combination of Simplified Acute Physiology Score (SAPS II), PCT, lactate and interleukine-6 (IL-6), which yielded an AUC of 0.939 by Viallon et al. [35], followed by the combination of SAPS-2 and soluble urokinase-type plasminogen activator receptor (suPAR) with an AUC 0.930 by Kofoed et al. [34]

Different inclusion criteria were used to classify patients as having sepsis. The most common criteria used were two SIRS criteria in combination with an infection, used by eight articles [25, 28, 31,32,33,34,35,36]. The second most used inclusion criterion was the 2001 International Sepsis Definitions [38], which was used by seven articles [22,23,24, 27, 29, 30, 32]. One article used the sampling of blood cultures as inclusion criterion [21]. One article included patients with symptoms of systemic infection in which PCT or blood cultures were taken within 24 h of admission [20]. One article used the Sepsis-3 definition [9] as inclusion criterion [37].

Eight studies reported other characteristics of the studied prediction models besides the AUC. The Hosmer-Lemeshow statistic was reported in five studies and ranged from 0.245 to 0.892. Four studies reported sensitivity, specificity, negative predictive value or positive predictive value and preselected cut-off values.

PROBAST quality assessment

The quality assessment using the PROBAST criteria can be found in Table 2 and the extended checklist with the signaling questions used in Supplemental Table 2 and 3. The majority of the studies were at risk of bias: 12 out of 18 studies [22, 23, 25,26,27,28, 30, 31, 33,34,35,36,37] scored high at any of the items of the PROBAST checklist.

Table 2 PROBAST assessment
Full size table

One study [26] was at risk of bias in the participant domain due to multiple exclusion criteria, leading to only a selected group of patients with sepsis enrolled in the study. There was no risk of bias in any of the studies in the domains predictors and outcome. In the domain analysis, 11 studies were considered at high risk of bias [22, 23, 25, 27, 28, 30, 31, 33,34,35,36,37]. The number of fatal cases was low in seven studies, leading to risk of overfitting of the studied prediction model [30, 31, 33,34,35,36,37]. Eleven studies did not report any missing data or did not report how missing data was handled [22, 23, 25, 27, 29, 30, 32, 34,35,36,37]. These items were not scored as high risk of bias, because all enrolled patients were included in the final analysis.

Discussion

Biomarkers and clinical scoring systems help physicians to detect sepsis in an early stage in the ED. In this systematic review we investigated the combinations of both biomarkers and clinical scoring systems with biomarkers to predict 1-month mortality in patients with sepsis. We found 18 different studies in which 33 combinations of biomarkers and clinical scoring system were investigated. The combination of PCT, lactate, IL-6 and SAPS-2 resulted in the highest AUC on 1-month mortality [35]. Despite the high AUC found in this study, this specific combination has not been adopted in the latest guidelines for surviving sepsis [2]. The SAPS-2 score is a clinical scoring system, using four vital parameters, seven laboratory tests and four other patient characteristics and was originally developed for patients in the ICU or general wards to predict in-hospital mortality. Combining this clinical scoring system with another three biomarkers results in a total of 18 variables used to predict 30-day mortality in this study. This large amount of data needed for this combination results in only limited usefulness for clinical practice. Furthermore, this study enrolled 131 subjects, of which 23 died. Therefore, the high AUC found in this study may possibly be due to overfitting by using too many predictors in the multivariate logistic regression analysis [39, 40].

To introduce a new combination of biomarkers and clinical scoring system to clinical practice, the biomarker should be available as routine test in the clinical laboratory and available together with the standard laboratory tests. Furthermore, the clinical scoring system should require only a limited amount of variables, because of the limited timeframe in which patients stay in the ED. In our study, only a limited amount of articles met those criteria. Many articles investigated experimental biomarkers such as NGAL, cell free DNA or sPD-1, making these combinations less feasible for clinical practice. Following these criteria, only a few articles we found would qualify for potential use in clinical practice. Yamamoto et al. combined the CURB-65 score with CRP. CURB-65 was originally developed for disposition decisions in patients with pneumonia, but was in this study used in suspected sepsis patients. This resulted in an AUC of 0.77 on 1-month mortality. However, the authors concluded that adding CRP to the CURB-65 only had limited clinical value, because the CURB-65 score alone showed a similar predictive value. Yu et al. investigated the combination of PCT and the qSOFA and showed that adding PCT improved the performance of the qSOFA score. This was the only study using the most recent Sepsis-3 criteria and incorporating the qSOFA score. The qSOFA score is validated for early detection of adverse outcomes in patients with infectious diseases and requires only 3 vital parameters. Combining it with PCT, a biomarker that is already available as routine measurement in many ED, makes this combination practical to use in the ED.

We found four studies using PCT combined with another biomarker or clinical scoring system. PCT has been studied as biomarker for bacterial infections and disease severity in infectious diseases. PCT is the precursor of calcitonin and physiologically produced by thyroid cells. In bacterial infections it is also synthesized outside of the thyroid, and rises rapidly in systemic infections. It is often referred to as the biomarker with most potential of replacing or substituting CRP [41]. However, PCT has yet to establish a role in routine care in the ED. [42] Combining PCT with other biomarkers or clinical scoring systems, we found an increase in predictive value on 30-day mortality. From all available sepsis biomarkers, PCT is probably the most well-known among physicians in the ED. Combining PCT with clinical scoring systems, as done in many studies, might therefore be the key in being adopted as part of regular care.

Lactate is a product of anaerobic glycolysis and is often elevated in patients with sepsis. It has been adopted as criterion for septic shock in the Sepsis-3 definitions [9]. We found two studies using lactate in combination with other biomarkers or clinical scoring system, both with a high predictive value on 1-month mortality [32, 35]. Unlike many novel biomarkers, lactate is widely available as a standard measurement during the workup in the ED. Therefore, lactate is an important biomarker in assessing the severity of sepsis in the ED. IL-6 is an inflammatory cytokine and plays an important role in the early phase of sepsis [43]. However, the prognostic values of IL-6 are controversial due to the short window in which IL-6 rises and falls during inflammation and infection [44].

The SAPS-2 score was also used in combination with suPAR by Kofoed et al. [34], resulting in an AUC of 0.930, which was the second highest AUC we found in our study. These findings suggest that the SAPS-2 is a clinical scoring system with a high prognostic accuracy on 30-day mortality, although it has not been validated for assessing severity of disease in the ED. However, the limitation of an overfitted prediction model in a relatively small cohort is also present in the study of Kofoed et al., with only 161 patients enrolled of which 9 patients died. suPAR is a biomarker which has been investigated as general disease severity biomarker, mostly in the ED. A large study showed that suPAR is an accurate predictor of mortality, but does not influence disposition or clinical outcome when it was used in the ED. [45] In a meta-analysis, suPAR showed similar results as PCT in diagnosing sepsis [46].

The MEDS score was the most used clinical scoring system used in combination with biomarkers. The MEDS score is a risk prediction score specifically for patients with suspected sepsis in the ED. [12] It consists of nine items which can easily be scored in the ED setting and results in a total score, categorized in 5 groups, which corresponds to a certain mortality risk. The AUC of the MEDS score combined with different biomarkers ranged from 0.731 to 0.891, indicating a moderate to good predictive value on 30-day mortality. Other clinical scoring systems we found in combination with biomarkers were the APACHE-2 and SAPS-2 score. These clinical scoring systems are mainly developed for use in the ICU and general wards. Despite being accurate predictors of disease severity, these clinical scoring systems may be less feasible for use in the ED, due to their complexity and large number of clinical parameters needed. In a prospective study comparing different clinical scoring systems individually in the ED, the MEDS score resulted in an AUC of 0.94 on 30-day mortality, which was higher than the SOFA or PIRO score [47]. However, another study which also compares different clinical scoring systems concluded that the APACHE-2 score is superior to the MEDS and SOFA score [48].

Three studies investigated biomarkers which are otherwise known as hormones and other functional circulating peptides, including IgE, cortisol, cell free DNA and nucleosomes [23, 29, 33]. Zhang et al. [29] studied IgE in combination with the MEDS score and found that adding IgE to the MEDS score resulted in a higher AUC than the MEDS score alone. This study emphasizes the multifactorial entity of sepsis, hypothesizing that IgE either plays a role in general immune activation during sepsis or is a marker of cytokine regulation/dysregulation. Another study by Zhang et al. [23] investigated hormones and biomarkers from the hypothalamic–pituitary–adrenal axis and showed that cortisol and copeptin are associated with 30-day mortality and that combining these biomarkers with the MEDS score resulted in added value over using each biomarker individually. Cortisol has been identified as essential hormone in the immune response in sepsis and elevated levels of cortisol are associated with severity of sepsis [49]. Extracellular cell free DNA and nucleosomes, basic units of DNA packaging, reflect cellular apoptosis and are therefore tested as predictors of severity of sepsis in the study of Duplessis et al. [33] In this study the authors show that adding nucleosomes to the APACHE-2 score improved the AUC on predicting mortality. Adding cell free DNA to the APACHE-2 score did not result in a better predictive value. These studies emphasize that biomarkers originating from different pathways in sepsis can be used as predictor of disease severity.

Limitations

Our study has several limitations. We acknowledge that there are many studies available in a similar setting and research field, which were not included in this review because these articles did not exactly match our inclusion criteria. We included articles that investigated the predictive value of biomarkers combined with clinical scoring systems on disease severity in sepsis. We used 1-month mortality as endpoint for severity of sepsis as this is the most commonly used endpoint in these kind of studies. However, there are many more biomarkers that have been investigated using other endpoints as marker of disease severity of sepsis. These endpoints to define severity of sepsis range from ICU admission to long term mortality. Despite the fact that these endpoints also are a surrogate marker of disease severity, these articles were not included because a comparison of these endpoints would not be possible.

The definition of sepsis has changed over time, which is also reflected by the different inclusion criteria used by the studies we found. Most studies used the sepsis criteria as defined in 2001 [38], and only a few studies used the latest Sepsis-3 criteria [9]. The majority of the studies we analyzed in this systematic review were published before 2016 and do not use the latest sepsis criteria. However, even after 2016, multiple studies still used the old sepsis criteria. These studies may have been designed and conducted before 2016, but this also emphasizes that it takes much time before new criteria are adopted in clinical practice.

All but three studies did not use predefined cut-off values for the biomarkers. This makes translating these results to clinical practice challenging. Using a predefined cutoff, categorizing the biomarker or clinical scoring system in a high or low risk category, is preferred when using such a system in practice.

In the PROBAST quality assessment, we considered the majority of included studies of high risk of bias. This was mainly due to the high risk of overfitting. The study population size of the included studies ranged from 114 to 1318. When there are less than 10 fatal cases per predictor, the risk of overfitting of prediction models is high, resulting in an unrealistically high AUC [40]. When also including clinical scoring systems, this problem is even bigger, since the clinical scoring system already consists of multiple predictors. The findings of our study can therefore not directly be translated into clinical practice and need to be validated in larger and external cohorts.

Conducting a meta-analysis to compare the outcomes of different studies would be preferred, but was not feasible. The variety in biomarkers and clinical scoring systems used was too large to compare one to another. We selected the use of an AUC as indicator of performance of the prediction models as inclusion criterion. Only a limited number of studies reported other qualities such as Hosmer-Lemshow statistic. Furthermore, the disease severity may have differed between the different studies at time of presentation at the ED. We did not systematically collect data on triage scores nor exact time or moment of biomarker measurement in the ED, because these details are often not reported. This would further limit comparison between different prediction models.

Conclusion

The studies we found in this systematic review were too heterogeneous to conclude that a certain combination it should be used in the ED to predict 1-month mortality in patients with sepsis. The combination of PCT, IL-6, lactate and the SAPS-2 score had the highest AUC on 1-month mortality in patients with sepsis in the ED, but this finding may be overfitted and requires external validation. Future studies should focus on clinical scoring systems which require a limited amount of clinical parameters, such as the qSOFA score in combination with a biomarker that is already routinely available in the ED.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

APACHE-2:

Acute Physiologic Assessment and Chronic Health Evaluation II

SOFA:

Sequential Organ Failure Assessment

AUC:

Area under the curve

CRP:

C-reactive protein

ED:

Emergency department

H-FABT:

Heart fatty acid binding protein

IL-6:

Interleukin-6

MEDS:

Mortality in Emergency Department Sepsis

MMP9:

Matrix metallopeptidase 9

NEWS:

National Early Warning Score

NGAL:

Neutrophil gelatinase-associated lipocalin

PCT:

Procalcitonin

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-analyses

PROBAST:

Prediction model Risk Of Bias Assessment Tool

PTX3:

Pentraxin 3

qSOFA:

Quick Sequential Organ Failure Assessment

SAPS-2:

Simplified Acute Physiology Score 2

sPD-1:

Soluble programmed death 1

sTM:

Soluble thrombomodulin

suPAR:

Soluble urokinase-type plasminogen activator receptor

TIMP-1:

Tissue inhibitor of metalloproteinase-1

References

  1. Vincent JL, Jones G, David S, Olariu E, Cadwell KK. Frequency and mortality of septic shock in Europe and North America: a systematic review and meta-analysis. Crit Care. 2019;23(1):196. https://0-doi-org.brum.beds.ac.uk/10.1186/s13054-019-2478-6.

    Article  PubMed  PubMed Central  Google Scholar 

  2. De Backer D, Dorman T. Surviving Sepsis guidelines: a continuous move toward better Care of Patients with Sepsis. JAMA. 2017;317(8):807–8. https://0-doi-org.brum.beds.ac.uk/10.1001/jama.2017.0059.

    Article  PubMed  Google Scholar 

  3. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345(19):1368–77. https://0-doi-org.brum.beds.ac.uk/10.1056/NEJMoa010307.

    Article  CAS  PubMed  Google Scholar 

  4. Hayden GE, Tuuri RE, Scott R, Losek JD, Blackshaw AM, Schoenling AJ, et al. Triage sepsis alert and sepsis protocol lower times to fluids and antibiotics in the ED. Am J Emerg Med. 2016;34(1):1–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2015.08.039.

    Article  PubMed  Google Scholar 

  5. Husabo G, Nilsen RM, Flaatten H, Solligard E, Frich JC, Bondevik GT, et al. Early diagnosis of sepsis in emergency departments, time to treatment, and association with mortality: an observational study. PLoS One. 2020;15(1):e0227652. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0227652.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Angus DC, van der Poll T. Severe sepsis and septic shock. N Engl J Med. 2013;369(9):840–51. https://0-doi-org.brum.beds.ac.uk/10.1056/NEJMra1208623.

    Article  CAS  PubMed  Google Scholar 

  7. Wiersinga WJ, Leopold SJ, Cranendonk DR, van der Poll T. Host innate immune responses to sepsis. Virulence. 2014;5(1):36–44. https://0-doi-org.brum.beds.ac.uk/10.4161/viru.25436.

    Article  PubMed  Google Scholar 

  8. Remick DG. Pathophysiology of sepsis. Am J Pathol. 2007;170(5):1435–44. https://0-doi-org.brum.beds.ac.uk/10.2353/ajpath.2007.060872.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for Sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10. https://0-doi-org.brum.beds.ac.uk/10.1001/jama.2016.0287.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Hotchkiss RS, Karl IE. The pathophysiology and treatment of sepsis. N Engl J Med. 2003;348(2):138–50. https://0-doi-org.brum.beds.ac.uk/10.1056/NEJMra021333.

    Article  CAS  PubMed  Google Scholar 

  11. Tsirigotis P, Chondropoulos S, Gkirkas K, Meletiadis J, Dimopoulou I. Balanced control of both hyper and hypo-inflammatory phases as a new treatment paradigm in sepsis. J Thorac Dis. 2016;8(5):E312–6. https://0-doi-org.brum.beds.ac.uk/10.21037/jtd.2016.03.47.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sankoff JD, Goyal M, Gaieski DF, Deitch K, Davis CB, Sabel AL, et al. Validation of the mortality in emergency department Sepsis (MEDS) score in patients with the systemic inflammatory response syndrome (SIRS). Crit Care Med. 2008;36(2):421–6. https://0-doi-org.brum.beds.ac.uk/10.1097/01.CCM.0B013E3181611F6A0.

    Article  PubMed  Google Scholar 

  13. Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84(4):465–70. https://0-doi-org.brum.beds.ac.uk/10.1016/j.resuscitation.2012.12.016.

    Article  PubMed  Google Scholar 

  14. Pierrakos C, Vincent JL. Sepsis biomarkers: a review. Crit Care. 2010;14(1):R15. https://0-doi-org.brum.beds.ac.uk/10.1186/cc8872.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Pierrakos C, Velissaris D, Bisdorff M, Marshall JC, Vincent JL. Biomarkers of sepsis: time for a reappraisal. Crit Care. 2020;24(1):287. https://0-doi-org.brum.beds.ac.uk/10.1186/s13054-020-02993-5.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Schuetz P, Hausfater P, Amin D, Amin A, Haubitz S, Faessler L, et al. Biomarkers from distinct biological pathways improve early risk stratification in medical emergency patients: the multinational, prospective, observational TRIAGE study. Crit Care. 2015;19(1):377. https://0-doi-org.brum.beds.ac.uk/10.1186/s13054-015-1098-z.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Travaglino F, De Berardinis B, Magrini L, Bongiovanni C, Candelli M, Silveri NG, et al. Utility of Procalcitonin (PCT) and mid regional pro-Adrenomedullin (MR-proADM) in risk stratification of critically ill febrile patients in emergency department (ED). A comparison with APACHE II score. BMC Infect Dis. 2012;12:184.

    Article  CAS  Google Scholar 

  18. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. https://0-doi-org.brum.beds.ac.uk/10.1186/2046-4053-4-1.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: a tool to assess the risk of Bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51–8. https://0-doi-org.brum.beds.ac.uk/10.7326/M18-1376.

    Article  PubMed  Google Scholar 

  20. Yu H, Nie L, Liu A, Wu K, Hsein YC, Yen DW, et al. Combining procalcitonin with the qSOFA and sepsis mortality prediction. Medicine (Baltimore). 2019;98(23):e15981. https://0-doi-org.brum.beds.ac.uk/10.1097/MD.0000000000015981.

    Article  CAS  Google Scholar 

  21. Yamamoto S, Yamazaki S, Shimizu T, Takeshima T, Fukuma S, Yamamoto Y, et al. Prognostic utility of serum CRP levels in combination with CURB-65 in patients with clinically suspected sepsis: a decision curve analysis. BMJ Open. 2015;5(4):e007049. https://0-doi-org.brum.beds.ac.uk/10.1136/bmjopen-2014-007049.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Liu B, Chen YX, Yin Q, Zhao YZ, Li CS. Diagnostic value and prognostic evaluation of Presepsin for sepsis in an emergency department. Crit Care. 2013;17(5):R244. https://0-doi-org.brum.beds.ac.uk/10.1186/cc13070.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Zhang Q, Dong G, Zhao X, Wang M, Li CS. Prognostic significance of hypothalamic-pituitary-adrenal axis hormones in early sepsis: a study performed in the emergency department. Intensive Care Med. 2014;40(10):1499–508. https://0-doi-org.brum.beds.ac.uk/10.1007/s00134-014-3468-4.

    Article  CAS  PubMed  Google Scholar 

  24. Chen YX, Li CS. Arterial lactate improves the prognostic performance of severity score systems in septic patients in the ED. Am J Emerg Med. 2014;32(9):982–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2014.05.025.

    Article  PubMed  Google Scholar 

  25. Yin Q, Liu B, Chen Y, Zhao Y, Li C. The role of soluble thrombomodulin in the risk stratification and prognosis evaluation of septic patients in the emergency department. Thromb Res. 2013;132(4):471–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.thromres.2013.08.011.

    Article  CAS  PubMed  Google Scholar 

  26. Zhao Y, Jia Y, Li C, Fang Y, Shao R. The risk stratification and prognostic evaluation of soluble programmed death-1 on patients with sepsis in emergency department. Am J Emerg Med. 2018;36(1):43–8. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2017.07.002.

    Article  PubMed  Google Scholar 

  27. Nino ME, Serrano SE, Nino DC, McCosham DM, Cardenas ME, Villareal VP, et al. TIMP1 and MMP9 are predictors of mortality in septic patients in the emergency department and intensive care unit unlike MMP9/TIMP1 ratio: multivariate model. PLoS One. 2017;12(2):e0171191. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0171191.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Zhao Y, Li C, Jia Y. Evaluation of the mortality in emergency department Sepsis score combined with procalcitonin in septic patients. Am J Emerg Med. 2013;31(7):1086–91. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2013.04.008.

    Article  PubMed  Google Scholar 

  29. Zhang Q, Dong G, Zhao X, Li CS. High immunoglobulin E values at admission predict mortality in ED patients with sepsis. Am J Emerg Med. 2016;34(8):1589–94. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2016.05.062.

    Article  PubMed  Google Scholar 

  30. Wang M, Zhang Q, Zhao X, Dong G, Li C. Diagnostic and prognostic value of neutrophil gelatinase-associated lipocalin, matrix metalloproteinase-9, and tissue inhibitor of matrix metalloproteinases-1 for sepsis in the emergency department: an observational study. Crit Care. 2014;18(6):634. https://0-doi-org.brum.beds.ac.uk/10.1186/s13054-014-0634-6.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Henning DJ, Bhatraju PK, Johnson NJ, Kosamo S, Shapiro NI, Zelnick LR, et al. Physician judgment and circulating biomarkers predict 28-day mortality in emergency department patients. Crit Care Med. 2019;47(11):1513–21. https://0-doi-org.brum.beds.ac.uk/10.1097/CCM.0000000000003899.

    Article  PubMed  Google Scholar 

  32. Chen YX, Li CS. The prognostic and risk-stratified value of heart-type fatty acid-binding protein in septic patients in the emergency department. J Crit Care. 2014;29(4):512–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jcrc.2014.03.026.

    Article  CAS  PubMed  Google Scholar 

  33. Duplessis C, Gregory M, Frey K, Bell M, Truong L, Schully K, et al. Evaluating the discriminating capacity of cell death (apoptotic) biomarkers in sepsis. J Intensive Care. 2018;6(1):72. https://0-doi-org.brum.beds.ac.uk/10.1186/s40560-018-0341-5.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Kofoed K, Eugen-Olsen J, Petersen J, Larsen K, Andersen O. Predicting mortality in patients with systemic inflammatory response syndrome: an evaluation of two prognostic models, two soluble receptors, and a macrophage migration inhibitory factor. Eur J Clin Microbiol Infect Dis. 2008;27(5):375–83. https://0-doi-org.brum.beds.ac.uk/10.1007/s10096-007-0447-5.

    Article  CAS  PubMed  Google Scholar 

  35. Viallon A, Guyomarc'h S, Marjollet O, Berger C, Carricajo A, Robert F, et al. Can emergency physicians identify a high mortality subgroup of patients with sepsis: role of procalcitonin. Eur J Emerg Med. 2008;15(1):26–33. https://0-doi-org.brum.beds.ac.uk/10.1097/MEJ.0b013e3280ec539b.

    Article  PubMed  Google Scholar 

  36. Carpio R, Zapata J, Spanuth E, Hess G. Utility of presepsin (sCD14-ST) as a diagnostic and prognostic marker of sepsis in the emergency department. Clin Chim Acta. 2015;450:169–75. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cca.2015.08.013.

    Article  CAS  PubMed  Google Scholar 

  37. Song J, Park DW, Moon S, Cho HJ, Park JH, Seok H, et al. Diagnostic and prognostic value of interleukin-6, pentraxin 3, and procalcitonin levels among sepsis and septic shock patients: a prospective controlled study according to the Sepsis-3 definitions. BMC Infect Dis. 2019;19(1):968. https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-019-4618-7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS international Sepsis definitions conference. Crit Care Med. 2003;31(4):1250–6. https://0-doi-org.brum.beds.ac.uk/10.1097/01.CCM.0000050454.01978.3B.

    Article  PubMed  Google Scholar 

  39. Ranganathan P, Pramesh CS, Aggarwal R. Common pitfalls in statistical analysis: logistic regression. Perspect Clin Res. 2017;8(3):148–51. https://0-doi-org.brum.beds.ac.uk/10.4103/picr.PICR_87_17.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–9. https://0-doi-org.brum.beds.ac.uk/10.1016/S0895-4356(96)00236-3.

    Article  CAS  PubMed  Google Scholar 

  41. Vijayan AL, Vanimaya, Ravindran S, Saikant R, Lakshmi S, Kartik R, et al. Procalcitonin: a promising diagnostic marker for sepsis and antibiotic therapy. J Intensive Care. 2017;5:51.

    Article  Google Scholar 

  42. van der Does Y, Limper M, Jie KE, Schuit SCE, Jansen H, Pernot N, et al. Procalcitonin-guided antibiotic therapy in patients with fever in a general emergency department population: a multicentre non-inferiority randomized clinical trial (HiTEMP study). Clin Microbiol Infect. 2018;24(12):1282–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cmi.2018.05.011.

    Article  PubMed  Google Scholar 

  43. Spittler A, Razenberger M, Kupper H, Kaul M, Hackl W, Boltz-Nitulescu G, et al. Relationship between interleukin-6 plasma concentration in patients with sepsis, monocyte phenotype, monocyte phagocytic properties, and cytokine production. Clin Infect Dis. 2000;31(6):1338–42. https://0-doi-org.brum.beds.ac.uk/10.1086/317499.

    Article  CAS  PubMed  Google Scholar 

  44. Ma L, Zhang H, Yin YL, Guo WZ, Ma YQ, Wang YB, et al. Role of interleukin-6 to differentiate sepsis from non-infectious systemic inflammatory response syndrome. Cytokine. 2016;88:126–35. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cyto.2016.08.033.

    Article  CAS  PubMed  Google Scholar 

  45. Schultz M, Rasmussen LJH, Andersen MH, Stefansson JS, Falkentoft AC, Alstrup M, et al. Use of the prognostic biomarker suPAR in the emergency department improves risk stratification but has no effect on mortality: a cluster-randomized clinical trial (TRIAGE III). Scand J Trauma Resusc Emerg Med. 2018;26(1):69. https://0-doi-org.brum.beds.ac.uk/10.1186/s13049-018-0539-5.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Huang Q, Xiong H, Yan P, Shuai T, Liu J, Zhu L, et al. The diagnostic and prognostic value of suPAR in patients with Sepsis: a systematic review and meta-analysis. Shock. 2020;53(4):416–25. https://0-doi-org.brum.beds.ac.uk/10.1097/SHK.0000000000001434.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Vafaei A, Heydari K, Hashemi-Nazari SS, Izadi N, Hassan ZH. PIRO, SOFA and MEDS scores in predicting one-month mortality of Sepsis patients; a diagnostic accuracy study. Arch Acad Emerg Med. 2019;7(1):e59.

    PubMed  PubMed Central  Google Scholar 

  48. Badrinath K, Shekhar M, Sreelakshmi M, Srinivasan M, Thunga G, Nair S, et al. Comparison of various severity assessment scoring Systems in Patients with Sepsis in a tertiary care teaching hospital. Indian J Crit Care Med. 2018;22(12):842–5. https://0-doi-org.brum.beds.ac.uk/10.4103/ijccm.IJCCM_322_18.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Sam S, Corbridge TC, Mokhlesi B, Comellas AP, Molitch ME. Cortisol levels and mortality in severe sepsis. Clin Endocrinol. 2004;60(1):29–35. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1365-2265.2004.01923.x.

Download references

Acknowledgements

The authors wish to thank Wichor Bramer and Sabrina Meertens-Gunput from the Erasmus MC Medical Library for developing and updating the search strategies.

Funding

This manuscript was not funded by any funding body.

Author information

Authors and Affiliations

  1. Department of Emergency Medicine, Erasmus University Medical Center, Rotterdam, Postbus 2040, 3000, CA, Rotterdam, The Netherlands

    Kirby Tong-Minh, Iris Welten, Tjebbe Hagenaars & Yuri van der Does

  2. Department of Intensive Care, Erasmus University Medical Center, Rotterdam, the Netherlands

    Henrik Endeman & Diederik Gommers

  3. Department of Clinical Chemistry, Erasmus University Medical Center, Rotterdam, the Netherlands

    Christian Ramakers

  4. Department of Internal Medicine, Erasmus University Medical Center, Rotterdam, the Netherlands

    Eric van Gorp

  5. Department of Viroscience, Erasmus University Medical Center, Rotterdam, the Netherlands

    Eric van Gorp

Authors
  1. Kirby Tong-Minh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iris Welten
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henrik Endeman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tjebbe Hagenaars
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christian Ramakers
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Diederik Gommers
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Eric van Gorp
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Yuri van der Does
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KTM, IW, and YD were involved in the conception or design of the manuscript. KTM and IW did the screening of the articles and YD acted as referee. KTM and YD did the analysis and interpretation of the data. KTM drafted the manuscript. KTM, IW, HE, TH, CR, DG, EG and YD were involved in the critical revision of the manuscript and final approval of the manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Kirby Tong-Minh.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplemental Table 1

: overview of commonly used clinical scoring systems for mortality prediction. Supplemental table 2: Extended PROBAST checklist. Supplemental table 3: Signaling questions used in PROBAST checklist.

Appendix A

Appendix A

Complete search strategy.

embase.com

(‘sepsis’/exp. OR ‘infection’/exp. OR pneumonia/exp. OR (sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*):ab,ti) AND (‘emergency ward’/exp. OR ‘emergency patient’/de OR ‘emergency health service’/de OR ‘hospital emergency service’/de OR ‘emergency care’/de OR ‘emergency physician’/de OR ‘emergency medicine’/de OR (((emergency) NEAR/6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR ‘acute care’ OR ed):ab,ti) AND (‘biological marker’/exp. OR ‘marker’/de OR ‘molecular marker’/de OR ‘disease marker’/de OR ‘blood level’/de OR ‘lactate blood level’/de OR ‘protein blood level’/de OR (((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/3 marker*) OR biomarker* OR ((serum OR blood) NEAR/6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))):ab,ti) NOT (‘case report’/de OR (case-report*):ti) NOT ([Conference Abstract]/lim) AND [English]/lim NOT ((juvenile/exp. OR pediatrics/exp. OR ‘newborn sepsis’/de OR ‘pediatric emergency medicine’/de OR (child* OR adolescen* OR infan* OR newborn* OR neonat*):ti) NOT (adult/exp. OR (adult*):ti)) NOT ([animals]/lim NOT [humans]/lim)

Medline Ovid.

(exp Sepsis/ OR exp. Infection/ OR exp. Pneumonia/ OR (sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*).ab,ti.) AND (Emergency Medical Services/ OR Emergency Service, Hospital/ OR Emergency Medicine/ OR (((emergency) ADJ6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR acute care OR ed).ab,ti.) AND (exp Biomarkers/ OR blood.fs. OR (((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) ADJ3 marker*) OR biomarker* OR ((serum OR blood) ADJ6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))).ab,ti.) NOT (case reports/ OR (case-report*).ti.) AND english.la. NOT ((exp child/ OR exp. infant/ OR Pediatrics/ OR Neonatal Sepsis/ OR Pediatric Emergency Medicine/ OR (child* OR adolescen* OR infan* OR newborn* OR neonat*).ti.) NOT (exp adult/ OR (adult*).ti.)) NOT (exp animals/ NOT humans/)

Web of science.

TS = (((sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*)) AND ((((emergency) NEAR/5 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR “acute care” OR ed)) AND ((((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/2 marker*) OR biomarker* OR ((serum OR blood) NEAR/5 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))))) NOT TI = (((child* OR adolescen* OR infan* ORnewborn* OR neonat*)) NOT ((adult*))) AND DT = (article) AND LA = (english).

Cochrane CENTRAL.

((sepsis OR septic* OR Bacteremia OR Bacteraemia OR fungemia OR fungaemia OR urosepsis OR infection* OR pneumonia* OR meningitis* OR meningoencephalitis*):ab,ti) AND ((((emergency) NEAR/6 (ward* OR department* OR room OR unit OR cent* OR patient* OR care OR healthcare OR physician* OR medicine)) OR ‘acute care’ OR ed):ab,ti) AND ((((biological* OR bio* OR inflammat* OR diagnos* OR molecul* OR disease) NEAR/3 marker*) OR biomarker* OR ((serum OR blood) NEAR/6 (concentrate* OR level* OR marker* OR lactate OR protein* OR elevat*))):ab,ti) NOT (((child* OR adolescen* OR infan* OR newborn* OR neonat*):ti) NOT ((adult*):ti))

Google scholar.

sepsis|septic|Bacteremia|Bacteraemia|fungemia|fungaemia|urosepsis|infection|pneumonia|meningitis|meningoencephalitis “emergency ward|department|room”|"acute care” “biological|bio|inflammatory marker|markers”|biomarker|biomarkers -child -infant –newborn.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tong-Minh, K., Welten, I., Endeman, H. et al. Predicting mortality in adult patients with sepsis in the emergency department by using combinations of biomarkers and clinical scoring systems: a systematic review. BMC Emerg Med 21, 70 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12873-021-00461-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12873-021-00461-z

Keywords

BMC Emergency Medicine

ISSN: 1471-227X

Contact us