Article2011

Assessing the reliability and validity of locally developed information literacy test items

42 citations0/0 files storedReference Services Review

No readable copy stored yet — this record is metadata only.

Library Science and Information Literacy Library Science and Information Information Science and Libraries

Abstract

Purpose With a call for increased accountability for student learning across higher education, it is becoming more important for academic libraries to show their value to the greater university community with the use of quantitative data. This paper seeks to describe the development of an information literacy test at the University of Arizona to measure student learning in an online credit course. In order to measure the impact of an online course, a test that was statistically valid, and reliable was created by local librarians. Design/methodology/approach The methodology involved administering test items to undergraduate students enrolled in an online information literacy course and applying both classical test theory and item response theory models to evaluate the validity and reliability of test items. This study included the longitudinal and cross‐sectional development of test items for pre and post‐testing across different student groups. Over the course of two semesters, 125 items were developed and administered to over 1,400 students. Findings The creation of test of items and the process of making test items reliable and valid is discussed in detail. Items were checked for construct validity with the use of a national standardized test of information literacy (SAILS). Locally developed items were found to have a higher than average reliability rating. Practical implications The process described here offers a method for librarians without a background in assessment to develop their own statistically valid and reliable instrument. Originality/value One of the unique features of this research design was the correlation of SAILS items with local items to test for validity. Although SAILS items have been used by many libraries in the past, they have not been used to create new test items. The use of the original SAILS test items is a valuable resource for instruction librarians developing items locally.

Citations in this library

Stored only when both papers are in the corpus — 42 citations exist upstream.

References

2000Information Literacy Competency Standards for Higher Education 2005Psychological Testing: A Practical Approach to Design and Evaluation 1985The basics of item response theory 1994Measurement and Assessment in Teaching 1993An NCME Instructional Module on 2008Dangers and Opportunities: A Conceptual Map of Information Literacy Assessment Approaches 2009Information literacy assessment 2007The Development and Validation of the Information Literacy Test

Cited by

2016Information literacy in 2015: International graduate business students' perceptions of information literacy skills compared to test-assessed skills 2012African culturally and linguistically diverse communities’ blood donation intentions in A ustralia: integrating knowledge into the theory of planned behavior 2012Performance-based Assessment in an Online Course: Comparing Different Types of Information Literacy Instruction 2014LibGuides and Web-Based Library Guides in Comparison: Is There a Pedagogical Advantage?2012Examining demographic and socio‐economic correlates of accurate knowledge about blood donation among A frican migrants in A ustralia

Imported from OpenAlex (CC0) — nothing here is generated.