Abstract
Certain research tasks require extracting data points from graphs and charts. Using 91 graphs that presented results from single-case designs, we investigated whether pairs of coders extract similar data from the same graphs (reliability), and whether the extracted data match numerical descriptions of the graph that the original author may have presented in tables or text (validity). Coders extracted data using the UnGraph computer program. Extraction proved highly reliable over several different kinds of analyses. Coders nearly always extracted identical numbers of data points, and the values they assigned to those data points were nearly identical. Extraction also proved highly valid, with the means of extracted data correlating nearly perfectly with means reported in tables or text and with very few discrepancies in any single case. These results suggest that researchers can use extracted data with a high degree of confidence that they are nearly identical to the original data.
Similar content being viewed by others
References
Biosoft (2004). UnGraph for Windows (Version 5.0). Cambridge, U.K.: Author.
Fantasia, K. L. (1982). An investigation of formal analysis as an intervention to improve word problem computation for learning disabled children (Doctoral dissertation, University of Washington, 1982). Dissertation Abstracts International, 42, 5085.
Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidencebased practice: Quantitative synthesis of single-subject designs. In G. Julnes & D. J. Rog (Eds.), Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation (pp. 95–109). San Francisco: Jossey-Bass. SPSS, Inc. (2005). SPSS 14.0 for Windows. Chicago: Author.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in part by a grant from the Institute of Education Sciences, U.S. Department of Education.
Rights and permissions
About this article
Cite this article
Shadish, W.R., Brasil, I.C.C., Illingworth, D.A. et al. Using UnGraph to extract data from image files: Verification of reliability and validity. Behavior Research Methods 41, 177–183 (2009). https://doi.org/10.3758/BRM.41.1.177
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BRM.41.1.177