Systematic review of hospital performance assessment indicators
DOI:
https://doi.org/10.51481/amc.v55i2.789Keywords:
Quality of healthcare, quality of healthcare indicators, quality assurance in healthcareAbstract
Background: The objective of this study is to undertake a systematic review of the international scientific literature to identify hospital performance indicators which have the potential to be implemented in the Costa Rican public hospital system.
Methods: A literature review was undertaken using MEDLINE to identify relevant studies published between March 1, 2000 and September 30, 2011. The following search terms were used: ""hospital performance indicators"", ""hospital inpatient quality indicators"", ""hospital performance and top 100 hospitals"".
Results: From 994 potentially relevant articles, 56 met the inclusion criteria: 5% measure the impact of quality-strategies on hospital final outputs, 13% are systematic reviews about hospital performance indicators, 22% describe the conceptual framework and the indicators for quality projects and 60% include various methodological topics about hospital performance indicators.
We identified 23 agencies that measure hospital performance. There are 383 indicators related to these agencies: 51% are indicators on patient safety, 29% on efficiency and 10% are related to the timeliness and patient-centered care.
Conclusion: There is large number of available hospital performance indicators that could be applied in the Costa Rican public hospital system. In order to be successfully implemented, they must meet certain requirements: review of the current quality framework, definition of the measures, data collection, adequate analysis and interpretation and action upon the results.
Downloads
References
Pai M, McCulloch M, Gorman JD, Pai N, Enanoria W, Kennedy G et al. Systematic reviews and meta analyses: an illustrated, step-by-step guide. Natl Med J India 2004; 17:86-95.
Sackett D, Strauss S, Richardson W, Rosenberg W, Haynes R. Evidence-based medicine: how to practice and teach EBM. 2 nd. Ed. London: Churchill-Livingstone; 2000.
Centro Colaborador Español del Instituto Joanna Brigss Institute para los Cuidados de Salud Basados en la Evidencia. Introducción a las revisiones sistemáticas. Reproducido del Best Practice
;Sup1:1-6
The Cochrane Collaboration. The Cochrane Manual Issue 1, 2007. 5. Valoración de las revisiones sistemáticas. Best Practice 2000; 1:1-6.
Courtney E, Ankrett S, McCollum P. 28-Day emergency surgical re-admission rates as a clinical indicator of performance. Ann R Coll Surg Engl 2003; 85:75-8.
Lutfiyya N, Bhat Deepa, Gandhi S, Nguyen C, Weidenbacher V, Lipsky M. A comparison of quality of care indicators in urban acute care hospitals and rural critical access hospitals in the United States. Int J Qual Health Care; 19:141-9.
Solon O, Woo K, Quimbo S, Shimkhada R, Florentino J, Peabody J. A novel method for measuring health care system performance- experience from QIDS in the Philippines. Health Policy Plan 2009; 24:167-74.
Lombarts M, Rupp I, Vallejo P, Suñol R, Klazinga N. Application of quality improvement strategies in 389 European hospitals- results of the MARQuIS project. Qual Saf Health Care 2009; 18:i28-37.
Rivard P, Elwy A R, Loveland S, Zhao S, Tsilimingras D, Elixhauser A, Romano P S, Rosen A K. Applying Patient Safety Indicators (PSIs) across Healthcare Systems: Achieving Data Comparability. In: Henriksen K, Battles J B, Marks E, Lewin D I, editors. Advances in Patient Safety: From Research to Implementation. Rockville, MD: Agency for Healthcare Research and Quality; 2005; 2:7-25.
Jha Ashish, Li Z, Orav J Epstein A. Care in US hospital- The Hospital Quality Alliance program. N Engl J Med 2005; 353:265-74.
Kerssens J, Groenewegen P, Sixma H, Boerma W, van der Eijk I. Comparison of patient evaluations of health care quality in relation to WHO measures of achievement in 12 European countries. Bull World Health Organ 2004; 82:106-14.
Peters R. Hospital performance indicators in the netherland-a preterm delivery. Neth Heart J 2009; 17: 48-9.
Marshall MN, Romano PS. Impact of reporting hospital performance. Qual Saf Health Care 2005; 14:77-8.
DesHarnais S, McMahon L, Wroblewski R. Measuring Outcomes of Hospital Care Using Multiple Risk-Adjusted Indexes. Health Serv Res 1991; 26:425-45.
Ranking 35 hospitales y clínicas de América Latina. Disponible en: http://rankings.americaeconomia.com/2010/clinicas/ metodologia. Consultado 10 de Noviembre de 2011.
Gobierno Federal de México. Observatorio del Desempeño Hospitalario 2009. Secretaría de Salud. 1° Ed. 2010. México D.F.
Miller M, Elixhauser A, Zhan Ch, Meyer G. Patient Safety Indicators - using administrative data to identify potential patient safety concerns. Health Serv Res 2001; 36:110-32.
Jian W, Huang Y, Hu M, Zhang X. Performance evaluation of inpatient service in Beijing- a horizontal comparison with risk adjustment based on Diagnosis Related Groups. BMC Health Serv Res 2009; 9:72.
Gibberd R. Performance measurement- is it now more scientific. Int J Qual Health Care 2005; 17:185-6.
Chen J, Radford M, Wang Y, Marciniak T, Krumholz H. Performance of the ""100 top hospitals"": what does the report card report? Health Aff 1999; 18:53-68.
Scott I, Ward M. Public reporting of hospital outcomes based on administrative data- risks and opportunities. Med J Aust 2006; 184:571-5.
Bardach N, Chien A, Dudley A. Small Numbers Limit the Use of the Inpatient Pediatric Quality Indicadors for hospital comparison. Acad Pediatr. 2010; 10:266-73.
Hines A, Stranges E, Andrews RM. Trends in Hospital RiskAdjusted Mortality for Select Diagnoses by Patient Subgroups, 2000-2007: Statistical Brief #98. 2010 Oct. En: Healthcare Cost and Utilization Project (HCUP) Statistical Briefs [Internet]. Rockville (MD): Agency for Health Care Policy and Research (US); 2006 Feb. Disponible en: http://www.ncbi.nlm.nih.gov/ books/NBK52657/
Romano P, Mull H, Rivard P, Zhao Sh, Henderson W, Loveland S, Tsilimingras D, Christiansen C, Rosen A. Validity of selected AHRQ patient safety indicators based on VA National Surgical Quality Improvement Program data. Health Serv Res 2009; 44:182-204.
Shahian D, Wolf R, Iezzoni L, Kirle L, Normand S. Variability in the measurement of hospital-wide mortality rates. N Engl J Med 2010; 363:2530-9.
Groene O, Klazinga N, Kazandjian V, Lombrail P, Bartels P. WHO Performance Assessment Tool for Quality Improvement in Hospitals PATH- an analysis of the pilot implementation in 37 hospitals. Int J Qual Health Care 2008; 20:155-61.
Thomson Reuters. 100 Top hospitals: National Benchmarks 2009 Study. Thomson Reuters 17th ed. march 2010.
Arah OA, Westert G, Hurst J, Klazinga NS. A conceptual framework for the OECD Health Care Quality Indicators project. Int J Qual Health Care 2006; 18:5-13.
Veillard J, Champagne F, Klazinga N, Kazandjian V, Arah OA, Guisset al. A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. Int J Qual Health Care 2005; 17:487-96.
Australasian Clinical Indicator Report: 2001 - 2008. Determining the Potential to Improve Quality of Care: 10th Edition Australian Council on Healthcare Standards, 2008.
Collopy B. Clinical indicators in accreditation- an effective stimulus to improve patient care. Int J Qual Health Care 2000; 12: 211-16.
Garcia S, Gil ML, Wei L, Kelley E, the Members of the HCQI Expert Group. Health Care Quality Indicators Project 2006 Data Collection Update Report. OECD Health Working Papers 29, 2007.
García-Eroles L, Illa C, Arias A, Casas M. Los Top 20 2000: objetivos, ventajas y limitaciones del método. Rev Calidad Asistencial 2001; 16:107-16.
US Department of Health and Human Services, Agency for Healthcare Research and Quality. National Healthcare Quality Report 2010. Rockville, MD: Agency for Healthcare Research and Quality, 2011.
World Health Organization. Performance Assessment Tool for Quality Improvement in Hospitals: Indicators descriptive sheets ´09/10. Division of Country Health Systems, WHO Regional Office for Europe, 2010.
World Health Organization. Performance Assessment Tool for Quality Improvement in Hospitals. WHO Regional Office for Europe, 2007.
Iasist. Hospitales Top 20 Benchmarks para la excelencia 2011. 1a
Ed. Iasist, S.A. España, 2011. URL: http://www.iasist.com/files/ TOP_20_2011_publicacion.pdf. Consultado 10 de noviembre 2011.
Thomson R, Taber S, Lally J, Kazandjian V. UK Quality Indicator Project (UK QIP) and the UK independent health care sector: a new development. Int J Qual Health Care 2004; 16:i51-6.
World Health Organization. A review of determinants of hospital performance. WHO, District Health Systems, Geneva 1994.
Austin P. Bayes rules for optimally using bayesian hierarchical regression models in provider profiling to identify high-mortality hospitals. BMC Med Res Methodol 2008; 8:30.
Shahian D, Normand Sh. Comparison of risk-adjusted hospital outcomes. Circulation 2008; 117:1955-63.
Li P, Kim M, Doshi J. Comparison of the performance of Elixhauser comorbidity measures in predicting mortality. BMC Health Serv Res 2010; 10:245.
Li B, Evans D, Faris P, Dean S, Quan H. Risk adjustment performance of Charlson and Elixhauser comorbidities in ICD-9 and ICD-10 administrative databases. BMC Health Serv Res 2008, 8:12.
Stausberg J, Halim A, Fárber R. Concordance and robustness of quality indicator sets for hospitals-an analysis of routine data. Health Serv Res 2011; 11:106.
Noyez L. Control charts, Cusum techniques and funnel plots. A review of methods for monitoring performance in healthcare. Int Cardio Vasc Thorac Surg 2009; 9:494-9.
Van Lent W, de Beer R, Van Harten W. International benchmarking of specialty hospitals. A series of case studies on comprehensive cancer centres. BMC Health Serv Res 2010; 10:253.
Hannan E, Magaziner J, Wang J, Eastwood E, Silberzweig S, Gilbert M, Morrison S, McLaughlin MA, Orosz G, Siu A. Mortality and locomotion 6 months after hospitalization for hip fracture- risk factors and risk-adjusted hospital outcomes. JAMA 2001; 285(21):2736-42.
Silveira A, Machado M, Riboldi J, Guimarães J. Mortality prediction model using data from the Hospital Information System. Rev. Saúde Públ. 2010; 44:1-8.
Donabedian A. Twenty years of research on the quality of medical care. Eval. Health Prof. 1985; 8:243-65.
Giordani F, Rozenfeld S. Adverse drug events in hospitals- a systematic review. Cad. Saúde Pública Rio de Janeiro 2009; 25:S360-72.
Groene O, Skau JK, Frolich A. An international review of projects on hospital performance assessment. Int J Qual Health Care 2008; 20:162-71.
Copnell B, Hagger V, Wilson SG, Evans SM, Sprivulis PC, Cameron PA. Measuring the quality of hospital care: an inventory of indicators. Intern Med J. 2009; 39:352-60.
Haller G, Stoelwinder J, Myles P, McNeil J. Quality and Safety Indicators in Anesthesia: A Systematic Review. Anesthesiology 2009; 110:1158-75.
Davies S, Geppert J, McClellan M, McDonald K, Romano P, Shojania K. Refinement of the HCUP Quality Indicators. Agency for Healthcare Research and Quality; USA, May 2001.
Ross J, Mulvey G, Stauffer B, Patlolla V, Bernheim S, Keenan P, Krumholz H. Statistical models and patient predictors of readmission for heart failure: a systematic review. Arch Intern Med 2008; 168:1371-86.
De Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Vort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care 2009; 21:119-29.
López L, Hicks L, Cohen A, McKean S, Weissman J. Hospitalists and the Quality of Care in Hospitals. Arch Intern Med 2009; 169:1389-94.
Suñol R, Vallejo P, Thompson A, Lombarts M J M H, Shaw C D, Klazinga N. Impact of quality strategies on hospital outputs. Qual Saf Health Care 2009; 18:i62-8.
Gibberd R, Hancock S, Howley P, Kay R. Using indicators to quantify the potential to improve the quality of health care. Int J Qual Health Care 2004; 16: i37-43.
Lilford R, Mohammed MA, Spiegelhalter D, Thomson R: Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet 2004, 363:1147-54.
Downloads
Published
Versions
- 2013-04-23 (2)
- 2013-04-23 (1)
Issue
Section
License
Copyright (c) 2013 Acta Médica Costarricense
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Los autores que publican en la revista Acta Médica Costarricense pueden distribuir, copiar, remezclar, retocar, leer, descargar, imprimir, buscar y crear a partir de su obra de modo no comercial, indicando los créditos a la revista y sus autores y compartir su obra en las mismas condiciones. Para ello se aplica la licencia Creative Commons Reconocimiento-NoComercial-CompartirIgual 4.0 Internacional(CC BY-NC-SA 4.0)
