Skip to main content
SpringerLink
Log in

Using UnGraph to extract data from image files: Verification of reliability and validity

  • Published:
Behavior Research Methods Aims and scope Submit manuscript

Abstract

Certain research tasks require extracting data points from graphs and charts. Using 91 graphs that presented results from single-case designs, we investigated whether pairs of coders extract similar data from the same graphs (reliability), and whether the extracted data match numerical descriptions of the graph that the original author may have presented in tables or text (validity). Coders extracted data using the UnGraph computer program. Extraction proved highly reliable over several different kinds of analyses. Coders nearly always extracted identical numbers of data points, and the values they assigned to those data points were nearly identical. Extraction also proved highly valid, with the means of extracted data correlating nearly perfectly with means reported in tables or text and with very few discrepancies in any single case. These results suggest that researchers can use extracted data with a high degree of confidence that they are nearly identical to the original data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Biosoft (2004). UnGraph for Windows (Version 5.0). Cambridge, U.K.: Author.

    Google Scholar 

  • Fantasia, K. L. (1982). An investigation of formal analysis as an intervention to improve word problem computation for learning disabled children (Doctoral dissertation, University of Washington, 1982). Dissertation Abstracts International, 42, 5085.

    Google Scholar 

  • Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidencebased practice: Quantitative synthesis of single-subject designs. In G. Julnes & D. J. Rog (Eds.), Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation (pp. 95–109). San Francisco: Jossey-Bass. SPSS, Inc. (2005). SPSS 14.0 for Windows. Chicago: Author.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. City University of New York, New York, New York

    Eden D. Nagler & David M. Rindskopf

  2. University of California Merced, P.O. Box 2039, 95344, Merced, CA

    William R. Shadish, Isabel C. C. Brasil, David A. Illingworth, Kristen D. White & Rodolfo Galindo

Authors
  1. William R. Shadish
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isabel C. C. Brasil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David A. Illingworth
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kristen D. White
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rodolfo Galindo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Eden D. Nagler
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. David M. Rindskopf
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to William R. Shadish.

Additional information

This research was supported in part by a grant from the Institute of Education Sciences, U.S. Department of Education.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shadish, W.R., Brasil, I.C.C., Illingworth, D.A. et al. Using UnGraph to extract data from image files: Verification of reliability and validity. Behavior Research Methods 41, 177–183 (2009). https://doi.org/10.3758/BRM.41.1.177

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3758/BRM.41.1.177

Keywords

Search

Navigation