Skip to main content

Advertisement

Log in

The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Objective

The purpose of this paper is to summarize the best evidence regarding the impact of providing patient-reported outcomes (PRO) information to health care professionals in daily clinical practice.

Methods

Systematic review of randomized clinical trials (Medline, Cochrane Library; reference lists of previous systematic reviews; and requests to authors and experts in the field).

Results

Out of 1,861 identified references published between 1978 and 2007, 34 articles corresponding to 28 original studies proved eligible. Most trials (19) were conducted in primary care settings performed in the USA (21) and assessed adult patients (25). Information provided to professionals included generic health status (10), mental health (14), and other (6). Most studies suffered from methodologic limitations, including analysis that did not correspond with the unit of allocation. In most trials, the impact of PRO was limited. Fifteen of 23 studies (65%) measuring process of care observed at least one significant result favoring the intervention, as did eight of 17 (47%) that measured outcomes of care.

Conclusions

Methodological concerns limit the strength of inference regarding the impact of providing PRO information to clinicians. Results suggest great heterogeneity of impact; contexts and interventions that will yield important benefits remain to be clearly defined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Abbreviations

PRO:

Patient-reported outcomes

RCTs:

Randomized control trials

References

  1. Food and Dug Administration (2006). Draft guidance for industry on patient-reported outcome measures: Use in medicinal product development to support labeling claims. Federal Register, 71, 5862–5863.

    Google Scholar 

  2. Greenhalgh, J., & Meadows, K. (1999). The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: A literature review. Journal of Evaluation in Clinical Practice, 5, 401–416.

    Article  PubMed  CAS  Google Scholar 

  3. Espallargues, M., Valderas, J. M., & Alonso, J. (2000). Provision of feedback on perceived health status to health care professionals: A systematic review of its impact. Medical Care, 38, 175–186.

    Article  PubMed  CAS  Google Scholar 

  4. McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges. Annual Review of Public Health, 20, 309–335.

    Article  PubMed  CAS  Google Scholar 

  5. Lohr, K. N. (1992). Applications of health status assessment measures in clinical practice. Overview of the third conference on advances in health status assessment. Medical Care, 30, MS1–MS14.

    Article  PubMed  CAS  Google Scholar 

  6. Rothwell, P. M., McDowell, Z., Wong, C. K., & Dorman, P. J. (1997). Doctors and patient don’t agree: Cross sectional study of patients’ and doctors’ perceptions and assessments of disability in multiple sclerosis. British Medical Journal, 314, 1580–1583.

    PubMed  CAS  Google Scholar 

  7. Stimson, G. V. (1974). Obeying doctor’s orders: A view from the other side. Social Science & Medicine, 8(2), 97–104.

    Article  CAS  Google Scholar 

  8. Deyo, R. A., & Carter, W. B. (1992). Strategies for improving and expanding the application of health status measures in clinical settings. A researcher-developer viewpoint. Medical Care, 30(5 Suppl), MS176–MS186.

    Article  PubMed  CAS  Google Scholar 

  9. Deyo, R. A., & Patrick, D. L. (1989). Barriers to the use of health status measures in clinical investigation, patient care, and policy research. Medical Care, 27, S254–S267.

    Article  PubMed  CAS  Google Scholar 

  10. Morris, J., Perez, D., & McNoe, B. (1998). The use of quality of life data in clinical practice. Quality of Life Research, 7, 85–91.

    Article  PubMed  CAS  Google Scholar 

  11. Meadows, K. A., Rogers, D., & Greene, T. (1998a). Attitudes to the use of health outcome questionnaires in the routine care of patients with diabetes: A survey of general practitioners and practice nurses. The British Journal of General Practice, 48, 1555–1559.

    PubMed  CAS  Google Scholar 

  12. Hahn, E. A., Cella, D., Chassany, O., Fairclough, D. L., Wong, G. Y., & Hays, R. D. (2007). Clinical Significance Consensus Meeting Group. Precision of health-related quality-of-life data compared with other clinical measures. Mayo Clinic Proceedings, 82(10), 1244–1254.

    PubMed  Google Scholar 

  13. Fitzpatrick, R., Fletcher, A., Gore, S., Jones, D., Spiegelhalter, D., & Cox, D. (1992). Quality of Life measures in health care. I: Applications and issues in assessment. British Medical Journal, 305, 1074–1077.

    PubMed  CAS  Google Scholar 

  14. Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routine administered questionnaires for depression and anxiety: Systematic review. British Medical Journal, 322, 406–409.

    Article  PubMed  CAS  Google Scholar 

  15. Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002). Routine administration of Health Related Quality of Life (HRQoL) and needs assessments instruments to improve psychological outcome—a systematic review. Psychological Medicine, 32, 1345–1356.

    Article  PubMed  CAS  Google Scholar 

  16. von Elm, E., Poglia, G., Walder, B., & Tramèr, M. R. (2004). Different patterns of duplicate publication. An analysis of articles used in systematic reviews. The Journal of the American Medical Association, 291, 974–980.

    Article  Google Scholar 

  17. Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J., Gavaghan, D. J., et al. (1996). Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Controlled Clinical Trials, 17(1), 1–12.

    Article  PubMed  CAS  Google Scholar 

  18. Valderas, J. M., Rue, M., Guyatt, G., & Alonso, J. (2005). Systematic Use of Quality of Life Measures in the Clinical Practice Working Group. The impact of the VF-14 index, a perceived visual function measure, in the routine management of cataract patients. Quality of Life Research, 14(7), 1743–1753.

    Article  PubMed  CAS  Google Scholar 

  19. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.

    Article  Google Scholar 

  20. Kraemer, H. C. (1992). Measurement of reliability for categorical data in medical research. Statistical Methods in Medical Research, 1(2), 183–99. Review.

    Article  PubMed  CAS  Google Scholar 

  21. Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient reported outcome measures on routine practice: a structured review. Journal of Evaluation in Clinical Practice, 12(5), 559–568.

    Article  PubMed  Google Scholar 

  22. Brody, D. S., Lerman, C. E., Wolfson, H. G., & Caputo, G. C. (1990). Improvement in physicians’ counseling of patients with mental health problems. Archives of Internal Medicine, 150, 993–998.

    Article  PubMed  CAS  Google Scholar 

  23. Calkins, D. R., Rubenstein, L. V., Cleary, P. D., Davies, A. R., Jette, A. M., Fink, A., et al. (1994). Functional disability screening of ambulatory patients: A randomized controlled trial in a hospital-based group practice. Journal of General Internal Medicine, 9(10), 590–592.

    Article  PubMed  CAS  Google Scholar 

  24. Yager, J., & Linn, L. S. (1981). Physician-patient agreement about depression: Notation in medical records. General Hospital Psychiatry, 3, 271–276.

    Article  PubMed  CAS  Google Scholar 

  25. German, P. S., Shapiro, S., Skinner, E. A., Von Korff, M., Klein, L. E., Turner, R. W., et al. (1987). Detection and management of mental health problems of older patients by primary care providers. Journal of the American Medical Association, 257, 489–493.

    Article  PubMed  CAS  Google Scholar 

  26. Dailey, Y. M., Humphris, G. M., & Lennon, M. A. (2002). Reducing patients’ state anxiety in general dental practice: A randomized controlled trial. Journal of Dental Research, 81(5), 319–322.

    PubMed  Google Scholar 

  27. Detmar, S. B., Muller, M. J., Schornagel, J. H., Wever, L. D.V., & Aaronson, N. K. (2002). Health related quality of life assessments and patient physician communication: A randomized controlled trial. The Journal of the American Medical Association, 228(23), 3027–3034.

    Article  Google Scholar 

  28. Dowrick, C. (1995). Does testing for depression influence diagnosis or management by general practitioners? Family Practice, 12, 461–465.

    Article  PubMed  CAS  Google Scholar 

  29. Dowrick, C., & Buchan, I. (1995). Twelve month outcome of depression in general practice: Does detection or disclosure make a difference? British Medical Journal, 311, 1274–1276.

    PubMed  CAS  Google Scholar 

  30. Shapiro, S., German, P. S., Skinner, E. A., et al. (1987). An experiment to change detection and management of mental morbidity in primary care. Medical Care, 25, 327–339.

    Article  PubMed  CAS  Google Scholar 

  31. Goldsmith, G., & Brodwick, M. (1989). Assessing the functional status of older patients with chronic illness. Family Medicine, 21, 38–41.

    PubMed  CAS  Google Scholar 

  32. Hoeper, E. W., Nycz, G. R., Kessler, L. G., Burke, J. D. Jr., & Pierce, W. E. (1984). The usefulness of screening for mental illness. Lancet, 1, 33–35.

    Article  PubMed  CAS  Google Scholar 

  33. Kazis, L. E., Callahan, L. F., Meenan, R. F., & Pincus, T. (1990). Health status reports in the care of patients with rheumatoid arthritis. Journal of Clinical Epidemiology, 43, 1243–1253.

    Article  PubMed  CAS  Google Scholar 

  34. Linn, L. S., & Yager, J. (1980). The effect of screening, sensitization and feedback on notation of depression. Journal of Medical Education, 55, 942.

    PubMed  CAS  Google Scholar 

  35. Magruder-Habib, K., Zung, W. W.K., & Feussner, J. R. (1990). Improving physicians’ recognition and treatment of depression in general medical care. Results from a randomized clinical trial. Medical Care, 28, 239–250.

    Article  PubMed  CAS  Google Scholar 

  36. Mathias, S. D., Fifer, S. K., Mazonson, P. D., Lubeck, D. P., Buesching, D. P., & Patrick, D. L. (1994). Necessary but not sufficient: the effect of screening and feedback on outcomes of primary care patients with untreated anxiety. Journal of General Internal Medicine, 9, 606–615.

    Article  PubMed  CAS  Google Scholar 

  37. Mazonson, P. D., Mathias, S. D., Fifer, S. K., Buesching, D. P., Malek, P., & Patrick, D. L. (1996). The mental health patient profile: Does it change primary care physicians’ practice patterns? The Journal of the American Board of Family Practice, 9, 336–345.

    PubMed  CAS  Google Scholar 

  38. McCusker, J., Verdon, J., Tousignant, P., de Courval, L. P., Dendukuri, N., & Belzile, E. (2001). Rapid emergency department intervention for older people reduces risk of functional decline: Results of a multicenter randomized trial. Journal of the American Geriatrics Society, 49(10), 1272–1281.

    Article  PubMed  CAS  Google Scholar 

  39. McCusker, J., Dendukuri, N., Tousignant, P., Verdon, J., Poulin de Courval, J., & Belzile, E. (2003). Rapid two-stage emergency department intervention for seniors: impact on continuity of care. Academic Emergency Medicine, 10(3), 233–243.

    Article  PubMed  Google Scholar 

  40. Moore, J. T., Silimperi, D. R., & Bobula, J. A. (1978). Recognition of depression by family medicine residents: The impact of screening. The Journal of Family Practice, 7, 509–513.

    PubMed  CAS  Google Scholar 

  41. Rand, E. H., Badger, L. W., & Coggins, D. R. (1988). Toward a resolution of contradictions. Utility of feedback from the GHQ. General Hospital Psychiatry, 10, 189–196.

    Article  PubMed  CAS  Google Scholar 

  42. Zung, W. W. K., Magill, M., Moore, J. T., & George, D. T. (1983). Recognition and treatment of depression in a family medicine practice. The Journal of Clinical Psychiatry, 44, 3–6.

    PubMed  CAS  Google Scholar 

  43. Rubenstein, L. V., McCoy, J. M., Cope, D. W., Barrett, P. A., Hirsch, S. H., Messer, K. S., et al. (1995). Improving patient quality of life with feedback to physicians about functional status. Journal of General Internal Medicine, 10(11), 607–614.

    Article  PubMed  CAS  Google Scholar 

  44. Saitz, R., Horton, N. J., Sullivan, L. M., Moskowitz, M. A., & Samet, J. H. (2003). Addressing alcohol problems in primary care: A cluster randomized, controlled trial of a systems intervention. The screening and intervention in primary care (SIP) study. Annals of Internal Medicine, 138(5), 372–382.

    PubMed  Google Scholar 

  45. Smith, P. (1998). The role of the general health questionnaire in general practice consultations. The British Journal of General Practice, 48(434), 1565–1569.

    PubMed  CAS  Google Scholar 

  46. Velikova, G., Booth, L., Smith, A. B., Brown, P. M., Lynch, P., Brown, J. M., & Selby, P. J. (2004). Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. Journal of Clinical Oncology, 22(4), 714–724.

    Article  PubMed  Google Scholar 

  47. Wagner, A. K., Ehrenberg, B. L., Tran, T. A., Bungay, K. M., Cynn, D. J., & Rogers, W. H. (1997). Patient-based health status measurement in clinical practice: A study of its impact on epilepsy patients’ care. Quality of Life Research, 6, 329–341.

    Article  PubMed  CAS  Google Scholar 

  48. Wasson, J., Hays, R., Rubenstein, L., Nelson, E., Leaning, J., Johnson, D., et al. (1992). The short-term effect of patient health status assessment in a health maintenance organization. Quality of Life Research, 1(2), 99–106.

    Article  PubMed  CAS  Google Scholar 

  49. Wasson, J. H., Stukel, T. A., Weiss, J. E., Hays, R. D., Jette, A. M., & Nelson, E. C. (1999). A randomized trial of the use of patient self-assessment data to improve community practices. Effective Clinical Practice, 2(1), 1–10.

    PubMed  CAS  Google Scholar 

  50. White, P., Atherton, A., Hewett, G., & Howells, K. (1995). Using information from asthma patients: A trial of information feedback in primary care. British Medical Journal, 311(7012), 1065–1069.

    PubMed  CAS  Google Scholar 

  51. Whooley, M. A., Stone, B., & Soghikian, K. (2000). Randomized trial of case-finding for depression in elderly primary care patients. Journal of General Internal Medicine, 15(5), 293–300.

    Article  PubMed  CAS  Google Scholar 

  52. Williams, J. W. Jr., Mulrow, C. D., Kroenke, K., Dhanda, R., Badgett, R. G., Omori, D., et al. (1999). Case-finding for depression in primary care: A randomized trial. The American Journal of Medicine, 106(1), 36–43.

    Article  PubMed  Google Scholar 

  53. Kramer, M. S., & Feinstein, A. R. (1981). Clinical biostatistics LIV. The biostatistics of concordance. Clinical Pharmacology and Therapeutics, 29, 111–123.

    Article  PubMed  CAS  Google Scholar 

  54. Clarke, M., & Oxman, A. D. (Eds.) (2003). Cochrane Reviewers’ Handbook 4.2.0 [updated March 2003]. In: The Cochrane Library, Issue 2. Oxford: Update Software. Updated quarterly.

  55. Puhan, M. A., Soesilo, I., Guyatt, G. H., & Schunemann, H. J. (2006). Combining scores from different patient reported outcome measures in meta-analyses: When is it justified? Health and Quality of Life Outcomes, 4, 94.

    Article  PubMed  Google Scholar 

  56. Goodman, S. N. (1998). Multiple comparisons, explained. American Journal of Epidemiology, 147(9), 807–812; discussion 815.

    PubMed  CAS  Google Scholar 

  57. Moye, L. A. (2000). Alpha calculus in clinical trials: Considerations and commentary for the new millennium. Statistics in Medicine, 19(6), 767–779.

    Article  PubMed  CAS  Google Scholar 

  58. Rubenstein, L. V., Calkins, D. R., Young, R. T., Cleary, P. D., Fink, A., Kosecoff, J., et al. (1989). Improving patient function: A randomized trial of functional disability screening. Annals of Internal Medicine, 111(10), 836–842.

    PubMed  CAS  Google Scholar 

  59. Valderas, J. M., Alonso, J., Valderas, J. M., Alonso, J., Prieto, L., Espallargues, M., & Castells, X. (2004). Content-based interpretation aids for health-related quality of life measures in clinical practice. An example for the visual function index (VF-14). Quality of Life Research, 13(1), 35–44.

    Article  PubMed  CAS  Google Scholar 

  60. Rebollo, P., Valderas, J. M., & Ortega, F. (2005). Progress in Spain of the described barriers to the use of perceived health status measures in the clinical practice. Medicina Clínica, 125(18), 703–705.

    Article  PubMed  Google Scholar 

  61. Greenhalgh, J., Long, A. F., & Flynn, R. (2005). The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory? Social Science & Medicine, 60(4), 833–843.

    Article  Google Scholar 

  62. Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007). How quickly do systematic reviews go out of date? A survival analysis. Annals of Internal Medicine, 147(4), 224–233.

    PubMed  Google Scholar 

  63. Callahan, C. M., Hendrie, H. C., Dittus, R. S., Brater, D. C., Hui, S. L., & Tierney, W. M. (1994). Improving treatment of late life depression in primary care: A randomized clinical trial. Journal of the American Geriatrics Society, 42(8), 839–846.

    PubMed  CAS  Google Scholar 

  64. Callahan, C. M., Dittus, R. S., & Tierney, W. M. (1996). Primary care physicians’ medical decision making for late-life depression. Journal of General Internal Medicine, 11, 218–219.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

This work was supported in part by: Ministerio de Educación, Cultura y Deporte (SAB2001-0088); the Spanish Public Health Network (RCESP) “Investigación en Epidemiología y Salud Pública: Determinantes, Mecanismos, Métodos y Políticas” (Exp. C03/09), and the Instituto de Salud Carlos III: Red de Investigación Cooperativa IRYSS (Exp. G03/202), and Ayudas para contratos de Profesionales Post MIR (Exp. CM0300118). A preliminary report of this work was presented at the Annual Conference of the International Society for Quality of Life Research in Hong Kong, China (2004).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Alonso.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Valderas, J.M., Kotzeva, A., Espallargues, M. et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res 17, 179–193 (2008). https://doi.org/10.1007/s11136-007-9295-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-007-9295-0

Keywords

Navigation